2020 Exam Q14-Q17

Hi! I have a question regarding the answers to Q14 to Q17 in the 2020 Exam. I am not sure I understand very well what is the intuition behind figuring out the answers based on the plot. I would really appreciate some guidance. Thank you!

Top comment

The learning curves reflect features of the different algorithms and setups such as

  • Oscillatory vs monotonic; (SGD vs GD)
  • Constant step size vs decreasing learning rates;
  • How the choice of decreasing step sizes influence the convergence rate;
  • ...

Hi, I was also wondering if one should classify Alg A as GD when it looks like a gradient ascent?

Well you can exclude SGD for algorithm A, so it must be GD. Perhaps your roommate was using a negative step size.

Page 1 of 1

Add comment

Post as Anonymous Dont send out notification