thchang-opt
thchang-opt t1_j41pklt wrote
Reply to [D] Are there any papers on optimization-based approaches which combine learned parameter initializations with learned optimisers? by Decadz
Is this along the lines of what you were thinking?
thchang-opt t1_j34pr2r wrote
Reply to comment by thchang-opt in [D] Simple Questions Thread by AutoModerator
Nvmd it’s the double function for lazy module initialization I was looking for I think
thchang-opt t1_j34lb34 wrote
Reply to [D] Simple Questions Thread by AutoModerator
How do I set PyTorch to use double precision for all layers and calculations when creating my torch.nn model?
thchang-opt t1_j42820e wrote
Reply to comment by Decadz in [D] Are there any papers on optimization-based approaches which combine learned parameter initializations with learned optimisers? by Decadz
I see, well for what it’s worth, here is what I can remember concerning applications:
I believe one of the motivating applications he was looking at was a control problem, where the current world state was one input and the optimization solution produced the optimal control/action to take from this state, according to some fixed problem dynamics. So he was discussing prediction of next solutions in a sequence of (I think convex) optimization problems for real-time control