Chapter 10. Estimating Functions and Superefficiency for ICA and Deconvolution

  1. Andrzej Cichocki1,2 and
  2. Shun-ichi Amari1

Published Online: 17 JUL 2002

DOI: 10.1002/0470845899.ch10

Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications

Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications

How to Cite

Cichocki, A. and Amari, S.-i. (2002) Estimating Functions and Superefficiency for ICA and Deconvolution, in Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications, John Wiley & Sons, Ltd, Chichester, UK. doi: 10.1002/0470845899.ch10

Author Information

  1. 1

    Riken Brain Science Institute, Japan

  2. 2

    Warsaw University of Technology, Poland

Publication History

  1. Published Online: 17 JUL 2002
  2. Published Print: 2 MAY 2002

ISBN Information

Print ISBN: 9780471607915

Online ISBN: 9780470845899

SEARCH

Keywords:

  • estimating functions;
  • semiparametric statistical models;
  • superefficiency;
  • likelihood;
  • score functions;
  • batch estimator;
  • information geometry;
  • stability analysis

Summary

Chapter 10 introduces the method of estimating functions to elucidate the common structures in most of the ICA/BSS and MBD algorithms. We use information geometry for this purpose, and define estimating functions in semiparametric statistical models, which include unknown functions as parameters. Differences in most existing algorithms are only in the choices of estimating functions. We then give error analysis and stability analysis in terms of estimating functions. This makes it possible to design various adaptive methods for choosing unknown parameters included in estimating functions, which control accuracy and stability. The Newton method is automatically derived by the standardized estimating functions. First the standard BSS/ICA problem is formulated in the framework of the semiparametric model and a family of estimating functions. Furthermore, the present chapter discusses and extends further convergence and efficiency of the batch estimator and natural gradient learning for blind separation/deconvolution via the semiparametric statistical model and estimating functions and standardized estimating functions derived by using efficient score functions elucidated recently by Amari et al. We present the geometrical properties of the manifold of the FIR filters based on the Lie group structure and formulate the multichannel blind deconvolution problem within the framework of the semiparametric model deriving a family of estimating functions for blind deconvolution. We then analyze the efficiency of the batch estimator based on estimating function, obtaining its convergence rate. Finally, we show that both batch learning and on-line natural gradient learning are superefficient under given nonsingular conditions.