| 基于 Elasticsearch 的实时集群日志采集和分析系统实现 |
| |
| 作者姓名： | 胡庆宝 姜晓巍 石京燕 程耀东 梁翠萍 |
| |
| 作者单位： | 1. 中国科学院高能物理研究所，北京 100049;2. 北京大学信息科学技术学院，北京 100871 |
| |
| 摘 要： | 传统日志工具采集时间长、处理效率低下，无法支持大规模集群日志采集和分析需求。我们从实际需求出发，结合Flume和Elasticsearch设计实现了集群日志的实时采集和快速查询分析系统。通过预设日志规则库，实时统计并展示集群系统的运行状态，提供预警信息。
|
| 关 键 词： | 日志采集 flume elasticsearch 日志报警 |
| 收稿时间： | 2016-03-12 |
A Real-Time Cluster Log-Collection and Analysis System Based on Elasticsearch |
| |
| Authors: | Hu Qingbao Jiang Xiaowei Shi Jingyan Cheng Yaodong Liang Cuiping |
| |
| Affiliation: | 1. Institute of High Energy Physics, Chinese Academy of Sciences, Beijing 100049, China;2. School of Electronics Engineering and Computer Science Peking University, Beijing 100871, China |
| |
| Abstract: | The processing efficiency of the traditional log-collect system is low, which cannot support the needs of large-scale cluster log collection and analysis. In this paper, we present the design and implementation of a real-time collection and analysis system based on Elasticsearch and flume. This system can provide early warning by defined log rules, and display the running state of the cluster system in real-time. |
| |
| Keywords: | log collection flume elasticsearch log alarm |
|
| 点击此处可从《》浏览原始摘要信息 |
|
点击此处可从《》下载全文 |
