Elastic Stack 8 : Install Filebeat2022/12/09 |
Install Filebeat that easily ships log file data to Elasticsearch or Logstash.
|
|
[1] | Install Filebeat. Configure Elasticsearch repository before it. |
[root@dlp ~]# dnf -y install filebeat
|
[2] | Configure basic settings and start Filebeat. |
[root@dlp ~]#
vi /etc/filebeat/filebeat.yml # line 28 : set items to collect data # if collect logs, turn to [enabled: true] # by default, /var/log/*.log files are shipped
- type: filestream
# Unique ID among all inputs, an ID is required.
id: my-filestream-id
# Change to true to enable this input configuration.
enabled: true
# Paths that should be crawled and fetched. Glob based paths.
paths:
- /var/log/*.log
#- c:\programdata\elasticsearch\logs\*
# Exclude lines. A list of regular expressions to match. It drops the lines that are
# matching any regular expression from the list.
# Line filtering happens after the parsers pipeline. If you would like to filter lines
# before parsers, use include_message parser.
#exclude_lines: ['^DBG']
# Include lines. A list of regular expressions to match. It exports the lines that are
# matching any regular expression from the list.
# Line filtering happens after the parsers pipeline. If you would like to filter lines
# before parsers, use include_message parser.
#include_lines: ['^ERR', '^WARN']
.....
.....
# line 108 : if use Kibana, uncomment and specify output host # if SSL is enabled on Kibana, hostname should be the same with the hostname in certs # [username] and [password] is the admin user's one # if using self-signed certificate, specify [ssl.verification_mode: none] setup.kibana: ..... host: "https://dlp.srv.world:5601" protocol: "https" username: "elastic" password: "password" ssl.enabled: true ssl.verification_mode: none # line 144 : specify output of Elasticsearch # [username] and [password] is the admin user's one # [ssl.certificate_authorities] is the cacert generated by Elasticsearch installation output.elasticsearch: # Array of hosts to connect to.l hosts: ["https://dlp.srv.world:9200"] protocol: "https" username: "elastic" password: "password" ssl.certificate_authorities: "/etc/elasticsearch/certs/http_ca.crt" ..... .....
[root@dlp ~]#
vi /etc/filebeat/filebeat.reference.yml # line 15 : set items to collect data - module: system # Syslog syslog: enabled: true ..... ..... # Authorization logs auth: enabled: true # line 4720 : if use Kibana, uncomment and specify output host # if SSL is enabled on Kibana, uncomment ssl related lines # [username] and [password] is the admin user's one # if using self-signed certificate, specify [ssl.verification_mode: none] setup.kibana: # Kibana Host # Scheme and port can be left out and will be set to the default (http and 5601) # In case you specify and additional path, the scheme is required: http://localhost:5601/path # IPv6 addresses should always be defined as: https://[2001:db8::1]:5601 host: "https://dlp.srv.world:5601" # Optional protocol and basic auth credentials. protocol: "https" username: "elastic" password: "password" # Optional HTTP Path #path: "" # Use SSL settings for HTTPS. Default is true. ssl.enabled: true ..... ..... # after very careful consideration. It is primarily intended as a temporary # diagnostic mechanism when attempting to resolve TLS errors; its use in # production environments is strongly discouraged. # The default value is full. ssl.verification_mode: none[root@dlp ~]# systemctl enable --now filebeat
|
[3] | Verify status the data has been collected normally. |
# index list [root@dlp ~]# curl -u elastic --cacert /etc/elasticsearch/certs/http_ca.crt https://127.0.0.1:9200/_cat/indices?v Enter host password for user 'elastic': health status index uuid pri rep docs.count docs.deleted store.size pri.store.size yellow open .ds-filebeat-8.5.3-2022.12.09-000001 u0HPkEGHRD256vQWbUiyAQ 1 1 0 0 668.4kb 668.4kb yellow open .ds-metricbeat-8.5.3-2022.12.09-000001 M5Aeg-pHQL6llaMBUD3JuA 1 1 2455 0 3.3mb 3.3mb yellow open .ds-packetbeat-8.5.3-2022.12.09-000001 8fLB4BygSyaQgo0naZMsYw 1 1 22781 0 6.5mb 6.5mb yellow open test_index yWfKwu85RpWT_LdWnsnV9Q 1 1 1 0 6.4kb 6.4kb # document list on the index [root@dlp ~]# curl -u elastic --cacert /etc/elasticsearch/certs/http_ca.crt https://127.0.0.1:9200/.ds-filebeat-8.5.3-2022.12.09-000001/_search?pretty Enter host password for user 'elastic': { "took" : 0, "timed_out" : false, "_shards" : { "total" : 1, "successful" : 1, "skipped" : 0, "failed" : 0 }, "hits" : { "total" : { "value" : 6420, "relation" : "eq" }, "max_score" : 1.0, "hits" : [ { "_index" : ".ds-filebeat-8.5.3-2022.12.09-000001", "_id" : "wCED9oQBSb5fRSPmV4lu", "_score" : 1.0, ..... ..... |
[4] | If Kibana is running, it's possible to import data to sample Dashboards. |
[root@dlp ~]# filebeat setup --dashboards Loading dashboards (Kibana must be running and reachable) Loaded dashboards |
Sponsored Link |