基于灰色熵权法的大数据质量评估

目前电力大数据的质量不高,提高电力大数据的质量有利于提高电网智能化水平.根据对电力系统数据质量评估流程及架构的分析,提出了MapReduce并行化的K-means算法,用于对大数据进行分类处理;构建了电力大数据评价指标体系;采用熵权法确定电力大数据的指标权重;最后通过灰色评估方法求取数据质量评价等级.最后对所提方法进行...

Evaluation of Big Data Quality Based on Grey Entropy Weight Method

The quality of power big data is not high,hence improving the quality of power big data is conducive to increasing the intelligence level of power grid.The process and structure of power system data quality evaluation are analyzed.The parallel K-means algorithm of MapReduce is proposed,and used to classify and process big data.The evaluation index system of power big data is constructed.Entropy weight method is adopted to determine the index weight of power big data.The evaluation level of data quality is obtained by grey evaluation method.Finally,the proposed method is simulated with an example.The simulation results show that the data collected by the detected power system is at a good level,which verifies that the proposed method is applicable to the quality assessment of power data in the context of big data.