Translations:Searching for Activation Functions/paper/95/en
![[Uncaptioned image]](/File:Arxiv_1710_05941_x8.png)
| Model | Top-1 Acc. (%) | Top-5 Acc. (%) | ||||
|---|---|---|---|---|---|---|
| LReLU | 73.8 | 73.9 | 74.2 | 91.6 | 91.9 | 91.9 |
| PReLU | 74.6 | 74.7 | 74.7 | 92.4 | 92.3 | 92.3 |
| Softplus | 74.0 | 74.2 | 74.2 | 91.6 | 91.8 | 91.9 |
| ELU | 74.1 | 74.2 | 74.2 | 91.8 | 91.8 | 91.8 |
| SELU | 73.6 | 73.7 | 73.7 | 91.6 | 91.7 | 91.7 |
| GELU | 74.6 | - | - | 92.0 | - | - |
| ReLU | 73.5 | 73.6 | 73.8 | 91.4 | 91.5 | 91.6 |
| Swish-1 | 74.6 | 74.7 | 74.7 | 92.1 | 92.0 | 92.0 |
| Swish | 74.9 | 74.9 | 75.2 | 92.3 | 92.4 | 92.4 |