lab 13 gradients of Loss wrt to w and u

Hello I can't figure out how to find the same gradients derived in lab 13, So i figured it would be one of the following options :

Did I do an error in my derivation ?
Capture d’écran 2022-01-17 114923.jpg

Or is there a missing 1/2 in the loss function provided in the lab ? ( in the course notes there's a 1/2 term but not in the notebook)
Capture d’écran 2022-01-17 114633.jpg
Capture d’écran 2022-01-17 115056.jpg

Or is there an error in the derivative of the loss function in the solution ? Maybe the 2 was just factorized and just considered part of the learning rate ?

Capture d’écran 2022-01-17 115214.jpg

Thank you for your time,

Top comment

I think the 1/2 factor indeed should be present in the original objective. Otherwise one immediately gets (as in your derivations) the 2 factor in the derivative/gradient due to the derivative of the square function.

Okay, thank you for the clarification!

Page 1 of 1

Add comment

Post as Anonymous Dont send out notification