What is the difference between Deep and Shallow networks?

A Deep Neural Network consists of two or more hidden layers. While a single layer perceptron can be used as a binary classifier for data that is linearly separable, a Neural Network with one hidden layer is the usual case in Traditional Machine Learning.  This is also the minimum number of layers required to be useful for such a case, and this configuration is called a ‘Shallow Network’. As more layers are added to the Neural Network, the model moves towards being a ‘Deep Network’. 

Author

Help us improve this post by suggesting in comments below:

– modifications to the text, and infographics
– video resources that offer clear explanations for this question
– code snippets and case studies relevant to this concept
– online blogs, and research publications that are a “must read” on this topic

Leave the first comment

Partner Ad
Find out all the ways that you can
Contribute
Here goes your text ... Select any part of your text to access the formatting toolbar.