Deep Learning Interview Questions
- What is a Perceptron? Discuss its various components
- What is a Multilayer Perceptron (MLP), also commonly known as Feed Forward Neural Network?
- What do you mean by pretraining, finetuning and transfer learning?
- Describe the training process of a Neural Network model (Forward and Backward propagation)
- What are the key hyper-parameters of a neural network model?
- What is an activation function, and what are the common choices for activation functions?
- What are some options to address overfitting in Neural Networks?
- Why do we add bias component in a perceptron / neural network?
- What is Rectified Linear Unit (ReLU) activation function? Discuss its advantages and disadvantages
- What is the “dead ReLU” problem and, why is it an issue in Neural Network training?
- What is the vanishing and exploding gradient problem, and how are they typically addressed?
- What do you mean by saturation in neural network training? Discuss the problems associated with it
- Discuss Softmax activation function
- How does dropout work?
- Explain the Transformer Architecture
- What are the primary advantages of transformer models?
- What are the limitations of transformer models?
- Explain Self-Attention, and Masked Self-Attention as used in Transformers
- What are recurrent neural networks (RNNs), and what are their applications?
- What is Long-Short Term Memory (LSTM)?
More resources:
- Top 100 Machine Learning Interview Questions and Answers (All Free)
- Top 50 Supervised Learning Interview Questions with detailed Answers (All free)
- Top 20 Deep Learning Interview Questions with detailed Answers (All free)
- Top 25 Interview Questions on Classification with detailed Answers (All free)
- Top 20 Interview Questions on Ensemble Learning with detailed Answers (All free)
