Wolfram Research and Google set to improve ChatGPT’s math skills

Share post:

ChatGPT has been struggling with math problems according to a study by Stanford University and UC Berkeley.

The study found that ChatGPT can perform simple math operations with small numbers, but it struggles with large numbers and complex problems. The study also found that ChatGPT’s performance has been getting worse over time.

The introduction of GPT-4 showed improvements in handling mathematical queries, yet persistent errors stemmed primarily from miscalculations and arithmetic blunders. Acknowledging this issue, Google, a prominent player in the tech industry, stepped in to address the limitations of LLMs. Their research, titled “Teaching Language Models to Reason Algorithmically,” embraces an in-context learning approach to enhance reasoning capabilities.

This algorithm helps models like ChatGPT understand and perform logical processes better. Google thinks this can improve math skills in AI chatbots. The new method teaches models step by step instead of all at once. Researchers, including Stanford’s James Zou, tested ChatGPT on 1,000 numbers. GPT-4 identified 84% as prime in March, but dropped to 51% by June, showing declining performance.

Wolfram Research, a pioneer in fusing technology with math education, is also working on a way to improve ChatGPT’s math skills with a plugin that solves math problems and creates equations. The plugin offers step-by-step solutions, visuals like graphs, and converts text into math equations using ChatGPT’s language skills and Wolfram’s programming expertise.

Conrad Wolfram, co-founder, shared that after the implementation, ChatGPT scored 43% independently on a math exam, but when paired with Wolfram’s resources, it scored 96%.

The sources for this piece include an article in AnalyticsIndiaMag.

Featured Tech Jobs


Related articles

Research Raises Concerns Over AI Impact on Code Quality

Recent findings from GitClear, a developer analytics firm, indicate that the increasing reliance on AI assistance in software...

Microsoft to train 100,000 Indian developers in AI

Microsoft has launched an ambitious program called "AI Odyssey" to train 100,000 Indian developers in artificial intelligence by...

NIST issues cybersecurity guide for AI developers

Paper identifies the types of cyberattacks that can manipulate the behavior of artificial intelligen

Canada, U.S. sign international guidelines for safe AI development

Eighteen countries, including Canada, the U.S. and the U.K., today agreed on recommended guidelines to developers in their nations for the secure design, development, deployment, and operation of artificial intelligent systems. It’s the latest in a series of voluntary guardrails that nations are urging their public and private sectors to follow for overseeing AI in

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways