信息熵在曲线拟合辨识中的应用.pdf

第 26 卷 第 2 期 电子测量与仪器学报 Vol. 26 No. 2 2012 年 2 月 JOURNAL OF ELECTRONIC MEASUREMENT AND INSTRUMENT · 171 · DOI: 10.3724/SP.J.1187.2012.00171 信息熵在曲线拟合辨识中的应用 1,2 1 曾金芳 滕召胜 (1. 湖南大学电气与信息工程学院, 长沙 410082; 2. 湘潭大学材料与光电物理学院, 湘潭 411105) 摘 要: 在对测量数据进行曲线拟合辨识时, 常用的误差指标, 如均方根误差和误差平方和, 没有考虑样本数据的概率统 计特性。基于信息熵原理介绍了一种新的曲线拟合辨识方法。将曲线拟合过程看作加性信道, 建立了曲线拟合模型。首先将样 本数据进行多种曲线拟合, 采用最大熵方法根据样本值估计出自变量的概率密度函数和信息熵; 再根据拟合曲线计算拟合结果 熵和误差熵, 最后计算出拟合模型的互信息, 选取互信息最大的曲线作为样本的最佳拟合曲线, 并给出了应用实例。由于该方法 充分考虑了样本数据的概率统计规律, 因此能提高测量精度, 具有更大的适用范围, 对于测量信息论的研究有一定的参考价值。 关键词: 曲线拟合; 信息熵; 误差熵; 互信息 中图分类号: TP202 文献标识码: A 国家标准学科分类代码: 510.40 Application of information entropy in curve fitting recognition Zeng Jinfang1,2 Teng Zhaosheng1 (1. College of Electrical and Information Engineering, Hunan University, Changsha 410082, China; 2. College of Materials, Optoelectronics and Physics, Xiangtan University, Xiangtan 411105, China) Abstract: In the recognition of curve fitting for measurement data, common error indexes, such as RMS error and error square sum, don’t consider sample’s probability statistics properties. A curve fitting recognition method was introduced based on information entropy. A curve fitting model was established through taking a curve fitting course as an additive channel. First, variety curves were selected to fit sample. The Maximum Entropy Method was used to estimate the independent variable’s probability density function and information entropy according to sample. Then, the fitting result entropy and the error entropy were calculated according to