文章詳情頁

ELK收集Tomcat日志的實現

瀏覽：406日期：2023-03-19 16:51:58

01 Tomcat 安裝與測試

1.1 安裝 Tomcat

安裝Tomcat的本體和相關官方測試demo，參考鏈接

apt-get install tomcat8 -y # 安裝Tomcat本體apt-get install tomcat8-docs tomcat8-examples tomcat8-admin -y # 安裝測試demo

1.2 Tomcat 啟動檢查

systemctl start tomcat8 # 啟動Tomcatsystemctl status tomcat8netstat -lntup|grep 8080 # 端口測試lsof -i:8080# 端口檢查得到輸出COMMAND  PID    USER   FD   TYPE DEVICE SIZE/OFF NODE NAMEjava    4502 tomcat8   63u  IPv6 125026      0t0  TCP *:http-alt (LISTEN)

1.3 查看 Tomcat 日志

啟動tomcat之后，使用本地瀏覽器訪問http://localhost:8080/訪問tomcat頁面，在頁面中點擊按鈕產生HTTP請求，讓tomcat產生日志

tail -f /var/log/tomcat8/localhost_access_log.2021-08-01.txt

02 修改 Tomcat 日志為 Json 格式

打開Tomcat的server.xml配置文件進行修改，在日志文件中的文末修改如下對應設置

# 編輯配置文件vim /etc/tomcat8/server.xml#將以下內容替換配置文件中135行對應內容<Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs"       prefix="localhost_access_log" suffix=".log"       pattern="{&quot;client&quot;:&quot;%h&quot;,  &quot;client user&quot;:&quot;%l&quot;,   &quot;authenticated&quot;:&quot;%u&quot;,   &quot;access time&quot;:&quot;%t&quot;,     &quot;method&quot;:&quot;%r&quot;,   &quot;status&quot;:&quot;%s&quot;,  &quot;send bytes&quot;:&quot;%b&quot;,  &quot;Query?string&quot;:&quot;%q&quot;,  &quot;partner&quot;:&quot;%{Referer}i&quot;,  &quot;Agent version&quot;:&quot;%{User-Agent}i&quot;}"/># 查看修改內容cat -n /etc/tomcat8/server.xml

重新啟動tomcat并查看日志，檢驗是否配置成功，產生新的日志還是需要通過使用瀏覽器訪問8080端口，在Tomcat的demo樣例中對tomcat發(fā)送請求產生日志。

# 先清空日志> /var/log/tomcat8/localhost_access_log.2021-08-02.txt # 重新啟動Tomcatsystemctl restart tomcat8# 查看日志root@master:/var/log/tomcat8# tail -f /var/log/tomcat8/localhost_access_log.2021-08-02.log  # 查看日志命令{"client":"172.16.255.1", "client user":"-", "authenticated":"-", "access time":"[02/Aug/2021:02:23:55 +0000]", "method":"GET /examples/servlets/images/return.gif HTTP/1.1", "status":"200",  "send bytes":"1231",  "Query?string":"", "partner":"http://172.16.255.131:8080/examples/servlets/", "Agent version":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36"}{"client":"172.16.255.1", "client user":"-", "authenticated":"-", "access time":"[02/Aug/2021:02:23:57 +0000]", "method":"GET /examples/servlets/servlet/RequestParamExample HTTP/1.1", "status":"200",  "send bytes":"673",  "Query?string":"", "partner":"http://172.16.255.131:8080/examples/servlets/", "Agent version":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36"}{"client":"172.16.255.1", "client user":"-", "authenticated":"-", "access time":"[02/Aug/2021:02:24:01 +0000]", "method":"GET /host-manager/html HTTP/1.1", "status":"401",  "send bytes":"2044",  "Query?string":"", "partner":"http://172.16.255.131:8080/", "Agent version":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36"}

03 配置 Filebeat 采集 Tomcat 日志

新增Filebeat輸入配置，將tomcat日志參照Nginx的Json格式日志采集方式配置如下

vim小技巧：將連續(xù)多行內容復制對應位置使用t命令，在Normal模式中輸入:2,7t11表示將第二到第七行的內容復制到第十一行開頭；將連續(xù)多行內容移動對應位置使用m命令，在Normal模式中輸入:2,7m11表示將第二到第七行的內容移動到第十一行開頭

vim小技巧：在輸入內容時要使用到某個文件路徑可以是用!命令然后使用shell命令查看內容，例如查看某個文件的路徑可以在Normal模式中輸入:!ls /var/log/tomcat8/...提示

# ================== Filebeat inputs ===============# ------------------------------Tomcat----------------------------------- type: log  enabled: true  paths:    # - /var/log/tomcat8/localhost_access_log.2021-08-02.log    # 為了能夠采集所有日期的日志，將文件名中的指定日期改成通配符`*`    - /var/log/tomcat8/localhost_access_log.*.log  json.keys_under_root: true  json.overwrite_keys: true  tags: ["tomcat"]# ================================== Outputs ===================================# ---------------------------- Elasticsearch Output ----------------------------output.elasticsearch:  hosts: ["172.16.255.131:9200"]  indices:      - index: "nginx-access-%{[agent.version]}-%{+yyyy.MM}"when.contains:    tags: "access"      - index: "nginx-error-%{[agent.version]}-%{+yyyy.MM}"when.contains:    tags: "error"# 在輸出配置中添加如下索引設置識別tomcat日志，值得注意的時這里不需要再重新編輯template設置，應該pattern配置只在第一次使用時進行匹配識別      - index: "tomcat-access-%{[agent.version]}-%{+yyyy.MM}"when.contains:    tags: "tomcat"