Neural networks are one typical structure on which artificial intelligence can be based. The term “neural” describes their learning ability, which to some extent mimics the functioning of neurons in our brains. To be able to work, several key ingredients are required: one of them is an activation function which introduces nonlinearity into the structure.