版本
環境
安裝需求
1. 安裝 PIP、DEV
確認是否已安裝 python 2.7
安裝 python-pip
1
2
3
4
5
6
7
8
9
|
sudo yum -y install python-devel
sudo yum -y install epel-release
sudo yum -y install python-pip
pip --version
sudo pip install --upgrade pip
|
2. 安裝 ElastAlert
確認套件，安裝的過程中可能會遇到相依套件的問題，請參考 ElastAlert requirements.txt 中的需求套件清單
例如，在安裝 blist 套件時，需要安裝 GCC
1
|
sudo yum -y install gcc
|
例如，在更新 requests 套件時，需要強制移除安裝
1
|
sudo pip install requests --ignore-installed requests
|
安裝 ElastAlert
1
|
sudo pip install elastalert
|
3. 設定 ElastAlert
在 ElastAlert 目錄下新增設定檔 config.yaml。以我的環境為例 /usr/lib/python2.7/site-packages/elastalert
建議複製 ElastAlert config.yaml.example
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
|
# This is the folder that contains the rule yaml files
# Any .yaml file will be loaded as a rule
rules_folder: /usr/lib/python2.7/site-packages/elastalert/alert_rules
# How often ElastAlert will query Elasticsearch
# The unit can be anything from weeks to seconds
run_every:
# seconds:
minutes: 1
# hours:
# ElastAlert will buffer results from the most recent
# period of time, in case some log sources are not in real time
buffer_time:
minutes: 15
# The Elasticsearch hostname for metadata writeback
# Note that every rule can have its own Elasticsearch host
es_host: elasticsearch.example.com
# The Elasticsearch port
es_port: 9200
# elastalert-create-index to set a mapping
writeback_index: elastalert_status
alert_time_limit:
days: 2
|
4. 設定 Elasticsearch Client
確認 Elasticsearch Client 的版本和 Elasticsearch 的版本相符。以我的環境為例，需要將 lasticsearch Client 更新至 6.X 版
1
2
3
4
5
|
pip list
sudo pip uninstall elasticsearch
sudo pip install "elasticsearch<7"
|
在 Elasticsearch 增加一個 ElastAlert 的索引
1
|
elastalert-create-index
|
5. 設定通知規則
新增通知規則設定檔 filebeat_frequency.yaml。以我的環境為例 /usr/lib/python2.7/site-packages/elastalert/alert_rules
這裡以 IIS Log 為例，當 http status != 200 時，發送一個訊息至 Slack
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
es_host: elasticsearch.example.com
es_port: 9200
name: Example frequency rule
type: frequency
index: filebeat-*
# (Required, frequency specific)
# Alert when this many documents matching the query occur within a timeframe
num_events: 50
# (Required, frequency specific)
# num_events must occur within this amount of time to trigger an alert
timeframe:
hours: 4
filter:
- query:
query_string:
query: "NOT iis.access.response_code: 200 AND event.dataset: iis.access"
alert:
- slack:
slack_webhook_url: "http://slack_webhook_url"
|
測試規則設定檔
1
|
elastalert-test-rule alert_rules/filebeat_frequency.yaml
|
6. 設定 ElastAlert 服務
執行測試
1
|
python -m elastalert --verbose --rule alert_rules/filebeat_frequency.yaml
|
新增服務
1
2
3
4
|
sudo mkdir -p /etc/elastalert/rules
cd /etc/elastalert/
sudo cp /usr/lib/python2.7/site-packages/elastalert/config.yaml config.yaml
sudo cp /usr/lib/python2.7/site-packages/elastalert/alert_rules/filebeat_frequency.yaml rules/filebeat_frequency.yaml
|
修改 config.yaml
rules_folder: /etc/elastalert/rules
新增服務設定檔
1
2
|
cd /etc/systemd/system/
sudo vi elastalert.service
|
elastalert.service
1
2
3
4
5
6
7
8
9
10
11
12
|
[Unit]
Description=elastalert
[Service]
Type=simple
User=root
Group=root
Restart=on-failure
WorkingDirectory=/usr/lib/python2.7/site-packages/elastalert
ExecStart=/usr/bin/elastalert --config /etc/elastalert/config.yaml --rule /etc/elastalert/rules/filebeat_frequency.yaml
[Install]
WantedBy=multi-user.target
|
啟動服務
1
2
3
|
sudo systemctl enable elastalert.service
sudo systemctl start elastalert.service
sudo systemctl status elastalert.service
|
參考
ElastAlert Repo
ElastAlert Doc
