多源异构大数据平台的建设及应用
2021-10-09刘琦
刘琦



摘 要:针对公安机关使用的信息系统普遍存在“数据壁垒”,不利于侦查办案的实际问题,设计并实现了多源异构大数据平台。该平台能够实现侦查、治安、交管等多类业务系统结构化、非结构化、半结构化异构数据的有效汇集整合,通过数据处理、目录管理、分析研判等功能,解决由于数据无法有效利用而导致“信息孤岛”、无法服务于侦查破案的问题。该平台应用结果表明,平台的建设能够有效地汇聚数据资源,实现多源异构数据的分析处理及态势预测,具有较高的行业应用价值。
关键词:多源异构数据;大数据平台;SolrCloud
中图分类号:TP391 文献标识码:A
Construction and Application of Multi-source Heterogeneous Big Data Platform
LIU Qi
(Network Security Department, Henan Police College, Zhengzhou 450000, China)
569797767@qq.com
Abstract: Data barriers widely exist in the information systems of public security organs, which are not conducive to investigating and handling cases. Aiming at this problem, this paper proposes a multi-source heterogeneous big data platform. The platform can realize various business systems such as investigation, public security, and traffic management, and effectively collect and integrate structured, unstructured, and semi-structured heterogeneous data. Functions of data processing, catalog management, analysis and judgment are performed to solve problems of information islands and the inability to serve investigations and resolution of cases, due to ineffective use of data. The platform application results show that the platform construction can effectively gather data resources, realize the analysis and processing of multi-source heterogeneous data and forecast the situation. It has high industry application value.
Keywords: multi-source heterogeneous data; big data platform; SolrCloud
1 引言(Introduction)
随着经济和科技的高速发展,伴随而来的各种新型犯罪活动频率高并且难以侦破[1]。经过多年持续不断的建设,公安信息化已经步入智慧公安时代,其发展重点逐步从基础设施建设向管理与应用转换。但是,由于技术、管理等多方面因素限制,“数据壁垒”问题尤为突出[2],各业务警种各自占据不同的數据资源,却无法甚至不愿意进行资源共享,使得数据、信息流转不畅,对侦查办案支撑不力。为解决上述棘手问题,各地公安机关纷纷通过建设公安大数据中心、搭建公安大数据平台的方式,实现数据汇聚、资源共享并完成研判分析等工作[3]。
随着公安大数据中心建设的不断推进,根据工作需要,公安机关数据中心纷纷建设多源异构大数据平台,组建与之匹配的机构,分配专职工作人员,用以满足业务需要。……
