###### Computational cost for projected gradient descent
Lectures · 125 · 2 · 13 Jan '21
What is the Computational cost for projected gradient descent?
###### Computaional cost for grid search
Lectures · 79 · 2 · 11 Jan '21
I am having trouble computing the computational cost for grid search. Can someone please help with …
###### Computational cost
Lectures · 168 · 4 · 9 Jan '21
If the cost to compute $$\mathbf{e}$$ is $$O(N*D) + O(N)$$ and the cost to compute \(…
###### minibatch implementation
Lectures · 72 · 3 · 8 Jan '21
Good evening, Looking online I find different ways to implement minibatch GD. Some select B rand…
###### second order condition
Lectures · 81 · 2 · 5 Jan '21
Hi, In lecture 2 page 22 formula (2) I don't understand why the condition is stated as positive …
###### Convergence : gradient descent 1-param model
Lectures · 65 · 1 · 28 Dec '20
How would you prove the convergence of the sequence only for gama in (0;2)? ![Captură de ecran 2…
Lectures · 188 · 4 · 28 Dec '20
According to the definition of subgradient  \mathcal{L}(\mathbf{u}) \geq \mathcal{L}(\mathbf{…
###### Constrained optimization & feature normalization
Lectures · 113 · 2 · 26 Sep '20
Thank you so much for answering all my previous questions :) I have the following questions fr…
###### SGD and (N<D)
Lectures · 81 · 3 · 24 Sep '20
We said that (N<D) case is undetermined for linear regression problem. But if we use SGD we may ev…
###### GD: gammas that guarantee convergence
Lectures · 96 · 3 · 24 Sep '20
Can you explain further in detail how to calculate/compute the range of gammas that guarantee conve…
###### GD on Hyperparameters
Lectures · 105 · 5 · 24 Sep '20
In the lecture, Martin mentioned that Grid Search is the simplest but not the best optimization alg…