Title:	Adaptation of a feedforward artificial neural network using a linear transform
Other Titles:	Adaptace ANN pomocí LT
Authors:	Trmal, Jan Zelinka, Jan Müller, Luděk
Citation:	TRMAL, Jan; ZELINKA, Jan; MÜLLER, Luděk. Adaptation of a feedforward artificial neural network using a linear transform. In: Text, speech and dialogue. Berlin: Springer, 2010, p. 423-430. (Lecture notes in computer science; 6231). ISBN 3-642-15759-9.
Issue Date:	2010
Publisher:	Springer
Document type:	článek article
URI:	http://www.kky.zcu.cz/cs/publications/TrmalJan_2010_Adaptationof http://hdl.handle.net/11025/16968
ISBN:	3-642-15759-9
Keywords:	MLP ANN;aplikace informačních systémů;human computer interaction
Keywords in different language:	MLP ANN;information systems applications;human computer interaction
Abstract in different language:	In this paper we present a novel method for adaptation of a multi-layer perceptron neural network (MLP ANN). Nowadays, the adaptation of the ANN is usually done as an incremental retraining either of a subset or the complete set of the ANN parameters. However, since sometimes the amount of the adaptation data is quite small, there is a fundamental drawback of such approach – during retraining, the network parameters can be easily overfitted to the new data. There certainly are techniques that can help overcome this problem (earlystopping, cross-validation), however application of such techniques leads to more complex and possibly more data hungry training procedure. The proposed method approaches the problem from a different perspective. We use the fact that in many cases we have an additional knowledge about the problem. Such additional knowledge can be used to limit the dimensionality of the adaptation problem. We applied the proposed method on speaker adaptation of a phoneme recognizer based on traps (Temporal Patterns) parameters. We exploited the fact that the employed traps parameters are constructed using log-outputs of mel-filter bank and by virtue of reformulating the first layer weight matrix adaptation problem as a mel-filter bank output adaptation problem, we were able to significantly limit the number of free variables. Adaptation using the proposed method resulted in a substantial improvement of phoneme recognizer accuracy.
Rights:	© Jan Trmal - Jan Zelinka - Luděk Müller
Appears in Collections:	Články / Articles (KKY)

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.