Apr 26, 2020
Differential Equations as a Neural Network Layers
Posted by Genevieve Klien in categories: information science, robotics/AI
The main idea of artificial neural networks (ANN) is to build up representations for complicated functions using compositions of relatively simple functions called layers.
A deep neural network is one that has many layers, or many functions composed together.
Although layers are typically simple functions(e.g. relu(Wx + b)) in general they could be any differentiable functions.