Are you looking for NPTEL Introduction to Machine Learning Assignment Week 12 Answers? If yes, you will find the answers to the questions asked in the NPTEL Introduction to Machine Learning quiz exam here. If you are preparing for this exam this article will help you in finding the latest and updated answers.

There is a total of 7 questions related to Learning Theory, Introduction to Reinforcement Learning, and Optional videos (RL framework, TD learning, Solution Methods, Applications). The correct answers are marked in Green Color with a tick sign.

Note: If the questions in the exam is not same/changed please share them with us, so that we update with the latest questions & answers

NPTEL Introduction to Machine Learning Assignment Week 12 Answers

1. You have been recruited as a lead engineer by ArrEll corporation which wants to enter the self-driving car market. In the context of the standard Reinforcement Leaming framework, what would you classify as the state and actions? Note that your system does not have access to previous states.

  1. State-(Current steering wheel position, Current pedal positions, Current speed) Actions-(Turn the wheel, Press pedals)
  2. State-(Current steering wheel position, Current pedal positions, Current acceleration) Actions-(Turn the wheel, Press pedals)
  3. State-(Current steering wheel position, Current pedal positions, Current speed) Actions-(Change direction, Change speed)
  4. State-(Current steering wheel position, Current pedal positions, Current acceleration) Actions-(Change direction, Change speed)

2. After completing Introduction to Machine Leaming on NPTEL, you have landed a job as a Data Scientist at YumEll Solutions Inc. Your first assignment as a trainee is to learn a classifier given some data and present insights on it to your manager, who apparentily doesn’t seem to have any knowledge on Machine Learning. Which of the following classification models would you pick to best explain the nature of the data and the underlying distribution to your manager?

  1. Linear Models
  2. Support Vector Machines
  3. Decision Trees
  4. Artificial Neural Networks

3. What happens when your model complexity (such as interaction terms in linear regression, order of polynomial in SVM, etc.) increases?(multiple options may be Corfect)

  1. Model Bias increases
  2. Model Bias decreases
  3. Variance of the model increases
  4. Variance of the model decreases

4. In the context of Reinforcement Learning algorithms, which of the following definitions constitutes a valid Markov State? (multiple options may be correct)

  1. For Chess: Positions of yours and the opponent’s remaining pleces
  2. For Tic-Tac-Toe: A snapshot of the game board (all Xs, Os and empty spaces)
  3. For Chess: Positions of your pieces and the identities of the opponents defeated pieces.
  4. For Tennis: Position of the ball

5. Suppose we want an RL agent to learn to play the game of golf. For training purposes, we make use of a golf simulator program. Assume that the original reward distribution gives a reward of +10 when the golf ball is hit into the hole and -1 for all other transitions. To aid the agent’s learning process, we propose to give an additional reward of +3 whenever the ball is within a 1 metre radius of the hole. Is this additional reward a good idea or not? Why?

  1. Yes. The additional reward will help speed-up learning.
  2. Yes. Getting the bal to within a metre of the hole is like a sub-goal and hence, should be rewarded.
  3. No. The additional reward may actually hinder learning.
  4. No. It violates the idea that a goal must be outside the agent’s direct control.

6. You waht to toss a fair coin a number of times and obtain the probability of getting heads by taking a simple average. What is the estimated number of times you’ll have to toss the coin to make sure that your estimated probability is within 10% of the actual probability, at least 90% of the time?

  1. 400*In(20)
  2. 800*In(20)
  3. 200*In (20)

7. You face a particularily challenging RL problem, where the reward distribution keeps changing with time. In order to gain maximum reward in this scenario, does it make sense to stop exploration or continue exploration?

  1. Stop exploration
  2. Continue exploration
NPTEL Introduction to Machine Learning Assignment Answers

FAQ

What is NPTEL Introduction to Machine Learning?

NPTEL Introduction to Machine Learning Course is an online free course by IIT Madras that has been developed by Prof. Balaraman Ravindran. The main aim of this course is to provide the basic concepts of machine learning from a mathematically well-motivated perspective.

Are These Answers Correct?

Yes, all these answers are 100% correct.

Are These Answers Updated?

Yes, these answers are up to date with the latest questions.

Will I Get a Certificate?

Yes, you will get a certificate but it costs ₹1000 exam fee.

Wrap Up

I hope now you know all the NPTEL Introduction to Machine Learning Assignment Week 12 Answers. If this article helped you find the NPTEL Introduction to Machine Learning Course Answer don’t forget to share it with your friends who are looking for NPTEL Introduction to Machine Learning Assignment Answers.

Disclaimer: These Answers are only for educational purposes so please don’t use them for any cheating purposes. We urge you to do assignments on your own.

Leave a Reply

Your email address will not be published.