DeepMind rolls out human-style encouragement to enhance AI math abilities

Share post:

Google DeepMind researchers have developed a new technique to improve the math ability of AI language models by using human-style encouragement. The technique, called Optimization by PROmpting (OPRO), uses natural language to guide the language model in problem-solving.

OPRO improves LLMs using natural language. It uses two LLMs; one to rate solutions and one to create them.

It works by the scorer LLM describing the problem, then the optimizer LLM finds a solution. The scorer LLM rates the solution, and the optimizer LLM adjusts based on feedback. This repeats until the scorer LLM is satisfied.

In one experiment, the researchers used OPRO to improve the performance of Google’s PaLM 2 language model on a dataset of grade-school math word problems. They found that the most effective prompt was “Take a deep breath and work on this problem step by step.” This prompt helped PaLM 2 achieve an accuracy score of 80.2%, compared to just 34% without any prompting.

The researchers believe that human-style encouragement works because it helps the language model to tap into its knowledge of human reasoning and problem-solving. They are hopeful that OPRO can be used to improve the performance of AI language models on a wide range of tasks, including education, translation, and code generation.

The sources for this piece include an article in ArsTechnica.

SUBSCRIBE NOW

Related articles

Anthropic’s AI Agents Take a Big Leap: Direct Computer Control

Anthropic has unveiled a groundbreaking capability for its Claude large language model: the ability to directly interact with...

AI Agents Could Surpass Humans as Primary App Users by 2030, Accenture Predicts

AI agents are poised to transform the way we interact with digital systems, potentially becoming the primary users...

Is Oracle killing off MySQL?

Yesterday we covered a story about how Oracle was now cracking down on licensing Java, which started as...

Research Raises Concerns Over AI Impact on Code Quality

Recent findings from GitClear, a developer analytics firm, indicate that the increasing reliance on AI assistance in software...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways