关键词: 单峰梯形线性单元（SPTLU）, SPTLU神经元, SPTLU网络, 对比实验

Abstract: Recently, deep learning has obtained a great success in many research areas. The activation function is one of the key factors in deep learning. In this paper, according to characteristics of biological neurons, an improved Single-Peaked Trapezoid Linear Unit（SPTLU） activation function is presented for the right-hand response unbounded of ReLU. SPTLU is in line with the biological neuron biological essence and achieves the excellent performance of equivalent or beyond ReLU. The experiments show the proposed activation function achieves good effectiveness on different datsets, e.g., MNIST, Fashion-MNIST, SVHN, CALTECH101 and CIFAR10 datasets.

Key words: Single-Peaked Trapezoid Linear Unit（SPTLU）, SPTLU neuron, SPTLU network, comparative experiment