Generalized Stochastic Gradient Learning
Loading...
Date
2005-09-19
Authors
Evans, George W., 1949-
Honkapohja, Seppo, 1951-
Journal Title
Journal ISSN
Volume Title
Publisher
University of Oregon, Dept of Economics
Abstract
We study the properties of generalized stochastic gradient (GSG) learning in forwardlooking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.
Description
35 p.
Keywords
Adaptive learning, E-stability, Recursive least squares, Robust estimation