Mistral AI’s Mixtral 8x7B: Upstart new open source offering rivals or surpasses results of larger models

Share post:

Mistral AI, a Paris-based startup, is shaking up the AI industry with its Mixtral 8x7B model, outperforming giants like ChatGPT and Llama with speed and efficiency.

Mistral AI steps into the competitive field with Mixtral 8x7B, an open-source model leveraging Sparse Mixture of Experts architecture for efficient pre-training and scalability. The model and its “Mixture of Experts” approach achieves the performance of larger models with far less compute and far less time required for training.

Demonstrating impressive performance, Mixtral 8x7B matched ChatGPT 3.5 in testing and outdid Llama 2 70B on benchmarks, with six times faster inference.

With significant funding secured, Mistral AI introduces ‘La Plateforme’ for model API endpoints, offering Mistral Tiny and Small, and monetizing the forthcoming Mistral Medium. This dual-revenue strategy boosts Mistral’s open-source venture, propelling its valuation potentially over two billion dollars.

Sources include: Analytics India

SUBSCRIBE NOW

Related articles

Resignations at OpenAI. Hashtag Trending for Friday, May 17, 2024

The question changes from “where’s Ilya” to what took so long?  Did Musk’s Neuralink team know there might...

Google does the unthinkable – reportedly erasing a 125 billion dollar pension fund

It's reported that Google inadvertently erased the Google Cloud account of UniSuper, an Australian pension fund valued at...

MIT students exploit blockchain vulnerability to steal 25 million dollars

Two MIT students have been implicated in a highly sophisticated cryptocurrency heist, where they reportedly exploited a vulnerability...

iOS update brings back photos users thought were permanently deleted

After a recent iOS update, a number of iPhone users have found themselves facing unexpected blasts from the...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways