| 众核与Spark结合的高速流量监测系统 |
| |
| 引用本文： | 周小宇,雒江涛,罗林,唐刚.众核与Spark结合的高速流量监测系统[J].计算机系统应用,2017,26(6):112-117. |
| |
| 作者姓名： | 周小宇 雒江涛 罗林 唐刚 |
| |
| 作者单位： | 重庆邮电大学 电子信息与网络工程研究院, 重庆 400065,重庆邮电大学 电子信息与网络工程研究院, 重庆 400065,重庆邮电大学 电子信息与网络工程研究院, 重庆 400065,重庆邮电大学 电子信息与网络工程研究院, 重庆 400065 |
| |
| 基金项目： | 重庆市基础科学与前沿技术研究重点项目（cstc2015jcyjB0415）；重庆市科技创新领军人才计划支持项目（CSTCKJCXLJRC20） |
| |
| 摘 要： | 互联网应用的广泛普及导致了互联网流量的高速增长，这给网络运营商运营带来了巨大挑战，传统的流量监测系统的性能和可扩展性已经无法满足运营商的需求.本文尝试将众核技术与Spark相结合，基于校园网流量，提出了众核与Spark结合的高速流量监测系统.其中，众核处理器负责高速的流量采集、处理以及流量日志生成；Spark平台负责存储流量日志数据，并对其进行高速并行分析；Web Server负责数据的可视化.本文以校园网DNS流量为监测对象充分验证了该方案的可行性与扩展性.
|
| 关 键 词： | 众核 Spark DNS 流量监测系统 |
| 收稿时间： | 2016/11/22 0:00:00 |
| 修稿时间： | 2017/1/4 0:00:00 |
High-Speed Traffic Monitoring System Based on Many-Core and Spark |
| |
| ZHOU Xiao-Yu,LUO Jiang-Tao,LUO Lin and TANG Gang.High-Speed Traffic Monitoring System Based on Many-Core and Spark[J].Computer Systems& Applications,2017,26(6):112-117. |
| |
| Authors: | ZHOU Xiao-Yu LUO Jiang-Tao LUO Lin and TANG Gang |
| |
| Affiliation: | Electronic Information and Networking Research Institute, Chongqing University of Posts and Telecommunications, Chongqing 400065, China,Electronic Information and Networking Research Institute, Chongqing University of Posts and Telecommunications, Chongqing 400065, China,Electronic Information and Networking Research Institute, Chongqing University of Posts and Telecommunications, Chongqing 400065, China and Electronic Information and Networking Research Institute, Chongqing University of Posts and Telecommunications, Chongqing 400065, China |
| |
| Abstract: | Popularity of Internet applications has led to the rapid growth of Internet traffic, which brings great challenges for Network operators, and the performance and scalability of traditional flow monitor system cannot meet the needs of operators. Based on the campus network traffic monitoring, this paper attempts to combine many-core technology with Spark, and presents a high-speed traffic monitor system. Many-core processor part is responsible for high-speed traffic collection, processing and log generation; Spark platform handles the distributed storage of large amounts of log data and its high-speed parallel processing. Web Server is used for data visualization. The DNS traffic of the campus network is taken as the object of monitoring, which verifies the feasibility and extensibility of the system. |
| |
| Keywords: | many-core Spark DNS flow monitoring system |
|
| 点击此处可从《计算机系统应用》浏览原始摘要信息 |
|
点击此处可从《计算机系统应用》下载全文 |
|
