Gradient Descent
Next topic
Video
Notes
Code
ŷ = a x + b
x
y
a:
-2
-1
0
1
2
3
b:
-2
-1
0
1
2
3
alpha:
0.001
0.005
0.01
0.05
0.1
0.5
1.0
5.0
10
50
Initialize
Next
\(x\)
\(y\)
\(ŷ\)
\(ŷ-y\)
\(2(ŷ-y)\)
\((ŷ-y)^2\)
Epoch:
L (loss):
\(\partial L \over \partial ŷ\):
\(\partial ŷ \over \partial a\):
\(\partial ŷ \over \partial b\):
\(\partial L \over \partial a\):
\(\partial L \over \partial b\):
a:
b:
chart:
X-Y Plot
Loss
a
b