IDe-
IDe- t1_j0wgjqo wrote
Reply to comment by mileseverett in [D] Will there be a replacement for Machine Learning Twitter? by MrAcurite
If you search it with hashtags you'll get a lot more relevant/topical posts (e.g. https://sigmoid.social/tags/nlproc). The local timeline may be full of ML people, but not everything ML people post is about ML. If you want a curated feed you'll have to create that yourself just like on any other SNS.
IDe- t1_iz77rsw wrote
Reply to comment by bohreffect in [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots
Ah, I didn't intend to say that it's old or useless, just that I think it receives disproportionate research focus/effort.
IDe- t1_iz6z4y3 wrote
Reply to comment by bohreffect in [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots
The issue is that requiring a model to be differentiable puts far too many limitations on the types of models you can formulate. Much of the research in the last few decades has focused on how to deal with issues caused purely because of the artificial constraint of differentiability. It's purely "local optimization" in the space of potential models, when what we really should be doing is "basin-hopping".
IDe- t1_iz356pg wrote
Reply to [R] The Forward-Forward Algorithm: Some Preliminary Investigations [Geoffrey Hinton] by shitboots
Backprop has really overstayed its welcome. It's great to see people doing something about it.
IDe- t1_jdv5f5b wrote
Reply to comment by bpooqd in [D]GPT-4 might be able to tell you if it hallucinated by Cool_Abbreviations_9
I mean it is a (higher order) Markov chain.