You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Line 202 : optimizer = optim.Adam(model.parameters(), lr=0.001)
In practice, I think the effect of Adam is quite bad. When epoch = 10, cost is 1.6; when epoch = 100 or 1000, cost is still equal to 1.6.
So I think we can change Adam to SGD, that is, optimizer = optim.SGD(model.parameters(), lr=0.001)
Line 202 :
optimizer = optim.Adam(model.parameters(), lr=0.001)
In practice, I think the effect of Adam is quite bad. When epoch = 10, cost is 1.6; when epoch = 100 or 1000, cost is still equal to 1.6.
So I think we can change Adam to SGD, that is,
optimizer = optim.SGD(model.parameters(), lr=0.001)
Here are the effects of using SGD:
The text was updated successfully, but these errors were encountered: