NPTEL Deep Learning – IIT Ropar Week 8 Assignment Solutions
NPTEL Deep Learning – IIT Ropar Week 8 Assignment Answer 2023
1. Which of the following best describes the concept of saturation in deep learning?
- When the activation function output approaches either 0 or 1 and the gradient is close to zero.
- When the activation function output is very small and the gradient is close to zero.
- When the activation function output is very large and the gradient is close to zero.
- None of the above.
Answer :-For Answer Click Here
2. Which of the following methods can help to avoid saturation in deep learning?
- Using a different activation function.
- Increasing the learning rate.
- Increasing the model complexity
- All of the above.
Answer :- For Answer Click Here
3. Which of the following is true about the role of unsupervised pre-training in deep learning?
- It is used to replace the need for labeled data
- It is used to initialize the weights of a deep neural network
- It is used to fine-tune a pre-trained model
- It is only useful for small datasets
Answer :- For Answer Click Here
4. Which of the following is an advantage of unsupervised pre-training in deep learning?
- It helps in reducing overfitting
- Pre-trained models converge faster
- It improves the accuracy of the model
- It requires fewer computational resources
Answer :- For Answer Click Here
5. What is the main cause of the Dead ReLU problem in deep learning?
- High variance
- High negative bias
- Overfitting
- Underfitting
Answer :- For Answer Click Here
6. How can you tell if your network is suffering from the Dead ReLU problem?
- The loss function is not decreasing during training
- The accuracy of the network is not improving
- A large number of neurons have zero output
- The network is overfitting to the training data
Answer :- For Answer Click Here
7. What is the mathematical expression for the ReLU activation function?
- f(x) = x if x < 0, 0 otherwise
- f(x) = 0 if x > 0, x otherwise
- f(x) = max(0,x)
- f(x) = min(0,x)
Answer :- For Answer Click Here
8. What is the main cause of the symmetry breaking problem in deep learning?
- High variance
- High bias
- Overfitting
- Equal initialization of weights
Answer :- For Answer Click Here
9. What is the purpose of Batch Normalization in Deep Learning?
- To improve the generalization of the model
- To reduce overfitting
- To reduce bias in the model
- To ensure that the distribution of the inputs at different layers doesn’t change
Answer :- For Answer Click Here
10. In Batch Normalization, which parameter is learned during training?
- Mean
- Variance
- γ
- ϵ
Answer :- For Answer Click Here
| Course Name | Deep Learning – IIT Ropar |
| Category | NPTEL Assignment Answer |
| Home | Click Here |
| Join Us on Telegram | Click Here |
