Apr 26, 2020

Differential Equations as a Neural Network Layers

Posted by in categories: information science, robotics/AI

The main idea of artificial neural networks (ANN) is to build up representations for complicated functions using compositions of relatively simple functions called layers.

A deep neural network is one that has many layers, or many functions composed together.

Although layers are typically simple functions(e.g. relu(Wx + b)) in general they could be any differentiable functions.

Comments are closed.