Meta launches new open-source AI models 

Share post:

Meta has unveiled its latest open-source model, MMS, “Massively Multilingual Speech and LIMA “Less is More for Alignment,” a new language model.

MMS can process speech-to-text and text-to-speech in 1100 languages, as well as recognize up to 4,000 spoken languages. LIMA, as the name implies, is designed to demonstrate that a few samples are adequate to get high-quality outcomes with an extensively pre-trained AI model.

MMS described the extensive range of supported languages as “a 10x increase from previous work.” Meta’s aspirations to extend into speech translation for many more languages appeared to be hinted at in the research paper launching MMS. According to Meta’s blog, many of the world’s languages are on the verge of extinction, and the limits of existing voice detection and generating technologies will further hasten this tendency.

In test settings, LIMA reaches GPT-4 and Bard level performance, albeit fine-tuned with relatively few samples. It has an incredible 65 billion parameters, uses LLaMA as its base, and is fine-tuned using a supervised loss approach using only 1,000 precisely picked prompts and replies. Meta created it in partnership with major universities such as Carnegie Mellon, the University of Southern California, and Tel Aviv University.

The sources for this piece include an article in AnalyticsIndiaMag.

SUBSCRIBE NOW

Related articles

Anthropic’s AI Agents Take a Big Leap: Direct Computer Control

Anthropic has unveiled a groundbreaking capability for its Claude large language model: the ability to directly interact with...

AI Agents Could Surpass Humans as Primary App Users by 2030, Accenture Predicts

AI agents are poised to transform the way we interact with digital systems, potentially becoming the primary users...

Target’s new AI is aimed at employees

Target is introducing a new generative artificial intelligence tool aimed at enhancing the efficiency of its store employees...

The good and the bad of AI generated code

Generative AI tools are transforming the coding landscape, making both skilled and novice developers more efficient. However, the...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways