Evolution-strategy-based automation of system development for high-performance speech recognition

Takafumi Moriya*, Tomohiro Tanaka, Takahiro Shinozaki, Shinji Watanabe, Kevin Duh

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)


The state-of-the-art large vocabulary speech recognition systems consist of several components including hidden Markov model and deep neural network. To realize the highest recognition performance, numerous meta-parameters specifying the designs and training setups of these components must be optimized. A prominent obstacle in system development is the laborious effort required by human experts in tuning these meta-parameters. To automate the process, we propose to tune the meta-parameters of a whole large vocabulary speech recognition system using the evolution strategy with a multi-objective Pareto optimization. As the result of the evolution, the system is optimized for both low word error rate and compact model size. Since the approach requires repeated training and evaluation of the recognition systems that require large computation, we make use of parallel computation on cloud computers. Experimental results show the effectiveness of the proposed approach by discovering appropriate configuration for large vocabulary speech recognition systems automatically.

Original languageEnglish
Article number8470178
Pages (from-to)77-88
Number of pages12
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Issue number1
Publication statusPublished - 2019 Jan
Externally publishedYes


  • Speech recognition
  • covariance matrix adaptation evolution strategy (CMA-ES)
  • deep neural network (DNN)
  • genetic algorithm
  • multi-objective optimization

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Evolution-strategy-based automation of system development for high-performance speech recognition'. Together they form a unique fingerprint.

Cite this