Abstract: This paper gives the whole procedures of designing recurrent neural networks combining the actual example，which include the choice of the structure and the learning algorithm of the networks，and the training process of the parameters of the networks.The key point of this paper is focusing on the method of selecting the initial learning rates and the adjusting order of the learning rates.The design method of recurrent neural networks proposed in this paper is applicable to various recurrent neural networks.