mocny-chlapik

mocny-chlapik t1_j69h5ud wrote

More and more information is popping up about the huge human annotation efforts going on at OpenAI. It seems that the secret ingredient missing was money, that could buy you lots of relevant data. This has several implications: (1) It might be impossible to replicate some of these models without millions of dollars invested in similar data collection efforts, (2) The range of applications can actually be broader than thought previously, if we are willing to pay people to generate the data. (3) They were not able to find significant improvements with scaling anymore. The scaling era might be nearly over.

34

mocny-chlapik t1_j08w90k wrote

Can aiplanes fly? They clearly do not flap their wings so we shouldn't say they fly. In the nature, we can see that flying is based on flapping wings, not on jet engines. Thus we shouldn't say that airplanes fly, since clearly jet engines are not capable of flight, they are merely moving air with their turbines. Even though we can see that the airplanes are in the air, it is only a trick and they are actually not flying in the philosophical sense of that word.

30