Neural Networks

<aside> 💡

Here, we’re specifically talking about **MLP(Multi-Layer Perceptron)**s

Note: Also, all functions explained does have learnable bias but are omitted!

</aside>

1 Layer Neural Network (or a Perceptron)

y = Wx + b

$$ f = Wx $$

2+ Layer Neural Network (mlp)

Ex. 2-Layer Neural Network

Introduces Non-linearity (비선형성)

Perceptron 의 대표적인 한계이자 인공지능 겨울을 불러일으킨 XOR Problem — Linear Regression으로 해결이 불가능한 경우