Dr_Love2-14

Dr_Love2-14 t1_j7lxp7k wrote

Leader in the space?... It is starting to irk me to see so many articles and discussions about this "AI war" between OpenAI and Google and their respective chatbots. OpenAI's main chatbot is GPT3, Google has LaMDA among many others. One thing for sure, they are both large and perform differently depending on the metric used.

Companies such as Facebook, Google, NVIDA, and Chinese ones like Baidu, ect. all heavily invest in AI research. The contribution of these research scientists nation and worldwide are all noteworthy and build on eachother. Google employs far more research scientists than OpenAI, and the volume of ML publications and impact factor of these publications altogether is therefore greater. Deepmind, an AI research subsidiary of Google, has been a leader in AI research and deep learning for many years.

but to directly answer your question, and for what it's worth, I would say NASA is the leader in space. Honestly your question is vague and poorly defined and you shouldn't equate chatbots to their companies.

32

Dr_Love2-14 t1_j7aqm6x wrote

During model training, I imagine the model would benefit from some form of "self-reflection" at recurrent intervals, similar to human sleep. For a crude workflow, one could design the model to recall through auto-prompting onto a context window everything its learned that is relevant to the newly exposed training data, and then the model makes a rationale decision (following a constant pre-encoded prompt) to restate the information and classify it as factual or non-factual, and then this self-generated text is backpropagated to the model.

(Disclaimer: I follow ML research as a layman)

1