| 实时大数据挖掘系统的设计与实现 |
| |
| 引用本文： | 罗俊,于水,杨维,孔华锋.实时大数据挖掘系统的设计与实现[J].计算机应用与软件,2020,37(3):57-60,122. |
| |
| 作者姓名： | 罗俊 于水 杨维 孔华锋 |
| |
| 作者单位： | 公安部第三研究所 上海 201203;上海铱芯信息科技有限公司 上海 201206;武汉商学院 湖北 武汉 430056 |
| |
| 基金项目： | 国家重点研发计划;上海科委项目 |
| |
| 摘 要： | 针对海量视频人脸数据的场景限制和1DK]∶N结果过多的困境,结合其他非视距信息采集手段,设计并实现一个大规模实时数据碰撞系统,解决了专门机关实际工作中依靠单一手段研判的诸多缺陷。进行分布式大数据系统的架构设计和组件选取,设计人脸结构化数据和车牌、手机采集信息的实时碰撞比对算法。多地实际运行的结果表明,该系统实时可靠,效果显著,满足一线专门机关案情及时研判和精准挖掘的需求。
|
| 关 键 词： | 大数据 IMSI MAC 人脸识别 |
DESIGN AND IMPLEMENTATION OF REAL-TIME BIG DATA MINING SYSTEM |
| |
| Luo Jun,Yu Shui,Yang Wei,Kong Huafeng.DESIGN AND IMPLEMENTATION OF REAL-TIME BIG DATA MINING SYSTEM[J].Computer Applications and Software,2020,37(3):57-60,122. |
| |
| Authors: | Luo Jun Yu Shui Yang Wei Kong Huafeng |
| |
| Affiliation: | (The Third Research Institute,Ministry of Public Security,Shanghai 201203,China;Shanghai Yixin Information Technology Co.,Ltd.,Shanghai 201206,China;Wuhan Business University,Wuhan 430056,Hubei,China) |
| |
| Abstract: | In order to solve the problem of massive faces and the dilemma of 1∶N excessive results,we design and implement a large-scale real-time data collision system by combining other non-line-of-sight information collection methods.Many shortcomings of relying on a single method in the actual work of specialized agencies have been solved.We carried out the architecture design and component selection of the distributed big data system,and designed real-time collision comparison algorithm of the face structured data and the information collected by the license plate and mobile phone.The results show that the system is reliable and effective in real-time.And it can meet the needs of timely investigation and judgment of cases and accurate excavation of cases by specialized agencies. |
| |
| Keywords: | Big data IMSI MAC Face recognition |
| 本文献已被 维普 万方数据 等数据库收录！ |
|
