In this scenario, what would be \(\frac{\partial \mathcal{L}}{\partial w_{2}}\) ?
My guess is that if the independent weight of \(\frac{\partial \mathcal{L}}{\partial w_{2}}\) and \(\frac{\partial \mathcal{L}}{\partial w_{3}}\) is 1, and if w2=w3, then \(\frac{\partial \mathcal{L}}{\partial w_{3}}\) for the network with weight sharing would be 2.
However, I am confused because it says that the condition was already fulfilled, then would the weights of both be 1/2?
I know that the question asks for w1 but I think this question could help me understand weight sharing better :)
weight sharing
Dear TAs,
In this scenario, what would be \(\frac{\partial \mathcal{L}}{\partial w_{2}}\) ?
My guess is that if the independent weight of \(\frac{\partial \mathcal{L}}{\partial w_{2}}\) and \(\frac{\partial \mathcal{L}}{\partial w_{3}}\) is 1, and if w2=w3, then \(\frac{\partial \mathcal{L}}{\partial w_{3}}\) for the network with weight sharing would be 2.
However, I am confused because it says that the condition was already fulfilled, then would the weights of both be 1/2?
I know that the question asks for w1 but I think this question could help me understand weight sharing better :)
Thank you in advance :)
1
Add comment