Criterion for minimum of mean information deviation for distinguishing random signals with similar characteristics

Vladimir V. Savchenko

doi:10.3103/S0735272718090042

Authors

Vladimir V. Savchenko Nizhny Novgorod State Linguistic University, Russian Federation https://orcid.org/0000-0003-3045-3337

DOI:

https://doi.org/10.3103/S0735272718090042

Keywords:

random signal, signals distinguishing, statistical hypotheses verification, maximum likelihood criterion, problem of similar hypotheses, information-theoretic approach

Abstract

The problem of distinguishing random signals with similar spectral and correlational characteristics is considered. To solve this problem, a criterion for a minimum of the mean divergence of the hypotheses taken with respect to the true distribution in the Kullback–Liebler information metric is proposed. Using this criterion, an optimal algorithm is synthesized, which allows achieving a guaranteed efficiency gain in discriminating random signals of similar structure. An example of its implementation in the problem of automatic speech recognition at the basic, phonetic level of signal processing is considered. Estimates of its effectiveness are obtained. Theoretical estimates of the effectiveness are confirmed by the results of the experiment. The author’s special-purpose information system was used for this. On the basis of the obtained results, recommendations are given for the practical application of the proposed criterion in problems of statistical signal processing, where a problem of verifying close statistical hypotheses arises.

References

KOLCHEV, A.A.; NEDOPEKIN, A.E. “Application of model of mixture of probabilistic distributions for definition of the signals of radiophysical probing,” Radioelectron. Commun. Syst., v.59, n.8, p.362-368, 2016. DOI: https://doi.org/10.3103/S0735272716080057.

SKACHKOV, V.V.; CHEPKYI, V.V.; BRATCHENKO, H.D.; EFYMCHYKOV, A.N. “Entropy approach to the investigation of information capabilities of adaptive radio engineering system in conditions of intrasystem uncertainty,” Radioelectron. Commun. Syst., v.58, n.6, p.241-249, 2015. DOI: https://doi.org/10.3103/S0735272715060011.

PRODEUS, A.M.; DIDKOVSKYI, V.S. “Objective estimation of the quality of radical noise suppression algorithms,” Radioelectron. Commun. Syst., v.59, n.11, p.502-509, 2016. DOI: https://doi.org/10.3103/S0735272716110042.

SAVCHENKO, V.V. “Enhancement of the noise immunity of a voice-activated robotics control system based on phonetic word decoding method,” J. Commun. Technol. Electron., v.61, n.12, p.1374 (2016). DOI: https://doi.org/10.1134/S1064226916120226.

SAVCHENKO, V.V. “Estimation of the phonetic speech quality using the information theoretic approach,” J. Commun. Technol. Electron., v.63, n.1, p.53, 2018. DOI: https://doi.org/10.1134/S1064226918010126.

AKIMOV, A.V.; SIROTA, A.A. “Synthesis and analysis of algorithms for digital signal recognition in conditions of deforming distortions and additive noise,” Radioelectron. Commun. Syst., v.60, n.10, p.458-468, 2017. DOI: https://doi.org/10.3103/S0735272717100041.

NEUIMIN, O.S.; ZHUK, S.Y. “Adaptive sequential detection of target trajectory using decision statistics of pips at the unknown signal-to-noise ratio,” Radioelectron. Commun. Syst., v.59, n.8, p.352-361, 2016. DOI: https://doi.org/10.3103/S0735272716080045.

SAVCHENKO, V.V. “Solving the problem of multiple comparisons for automatic signal recognition at the output of the voice communication path,” Elektrosvyaz’, n.12, p.22-27, 2017.

SAVCHENKO, A.V. “Clustering and maximum likelihood search for efficient statistical classification with medium-sized databases,” Optimization Lett., v.11, n.2, p.329-341, 2017. DOI: https://doi.org/10.1007/s11590-015-0948-6.

LEMAN, E. Testing of Statistical Hypotheses [in Russian]. Moscow: Nauka, 1979.

BOROVKOV, A.A. Mathematical Statistics [in Russian]. St. Petersburg: Lan’, 2010.

LEVIN, B.R. Theoretical Fundamentals of Statistical Radioenginering, 3rd ed. Moscow: Radio i Svyaz’, 1989.

LEHMANN, E.L.; ROMANO, J.P. Testing Statistical Hypotheses, 3rd ed. New York: Springer, 2005. DOI: http://doi.org/10.1007/0-387-27605-X.

RYBIN, A.I.; NIZHEBETSKAYA, Y.K. “Analysis of images similarity and difference using normal orthogonal conversion,” Radioelectron. Commun. Syst., v.53, n.3, p.167-172, 2010. DOI: https://doi.org/10.3103/S0735272710030076.

POPOV, A.A. “Sampling theorem for signals of the space built on the generalized Boolean algebra with measure,” Radioelectron. Commun. Syst., v.53, n.1, p.25-32, 2010. DOI: https://doi.org/10.3103/S073527271001005X.

LEMESHKO, B.Y.; LEMESHKO, S.B.; POSTOVALOV, S.N. “The power of goodness of fit tests for close alternatives,” Meas. Tech., v.50, n.2, p.132, 2007. DOI: https://doi.org/10.1007/s11018-007-0036-0.

SAVCHENKO, V.V.; SAVCHENKO, A.V. “Information-theoretic analysis of efficiency of the phonetic encoding-decoding method in automatic speech recognition,” J. Commun. Technol. Electron., v.61, n.4, p.430, 2016. DOI: https://doi.org/10.1134/S1064226916040112.

ZHUK, S.Y.; KOVALEV, V.I. “Algorithm for combined filtering of the speech signal and estimate of the synchronization error in a two-channel measuring system,” Radioelectron. Commun. Syst., v.43, n.6, p.36, 2000. URI: http://radio.kpi.ua/article/view/S0021347000060078.

SAVCHENKO, A.V. “Sequential three-way decisions in efficient classification of piecewise stationary speech signals,” Int. Joint Conf. Rough Sets, v.10314, p.264-277,, 2017. DOI: https://doi.org/10.1007/978-3-319-60840-2_19.

KULLBACK, S. Information Theory and Statistics. New York: Dover Publications, 1997.

SAVCHENKO, V.V. “Principle of minimax entropy for statistical classification problems,” Radioelectron. Commun. Syst., v.33, n.12, p.35, 1990.

ZHOU, D.; PLATT, J.C.; BASU, S.; MAO, Yi. “Learning from the Wisdom of crowds by minimax entropy,” Proc. of 25th Int. Conf. on Neural Information Processing Systems, 3-6 Dec. 2012, Lake Tahoe, Nevada, USA. 2012, v.2, p.2195-2203.

MARPLE, S.L. Digital Spectral Analysis. Englewood Cliffs. NJ: Prentice Hall, 1987.

BYLINKIN, A.A.; KONOV, S.L. “Methods of random signals recognition according to the form of spectrum,” Information Security Questions, n.2, p.30-36, 2017. URI: https://elibrary.ru/item.asp?id=29207442.

KONEV, A.A.; MESHCHERYAKOV, R.V.; KHODASHYNSKIY, I.A. “Recognition of vowel sounds using first and second harmonics,” Proc. of Sixth Interdisciplinary Seminar on Analysis of Spoken Russian Language. Saint Petersburg State University, 2012 [ed. by A. L. Ronzhyn], p.35.