Mistral AI’s Mixtral 8x7B: Upstart new open source offering rivals or surpasses results of larger models

Share post:

Mistral AI, a Paris-based startup, is shaking up the AI industry with its Mixtral 8x7B model, outperforming giants like ChatGPT and Llama with speed and efficiency.

Mistral AI steps into the competitive field with Mixtral 8x7B, an open-source model leveraging Sparse Mixture of Experts architecture for efficient pre-training and scalability. The model and its “Mixture of Experts” approach achieves the performance of larger models with far less compute and far less time required for training.

Demonstrating impressive performance, Mixtral 8x7B matched ChatGPT 3.5 in testing and outdid Llama 2 70B on benchmarks, with six times faster inference.

With significant funding secured, Mistral AI introduces ‘La Plateforme’ for model API endpoints, offering Mistral Tiny and Small, and monetizing the forthcoming Mistral Medium. This dual-revenue strategy boosts Mistral’s open-source venture, propelling its valuation potentially over two billion dollars.

Sources include: Analytics India

Featured Tech Jobs

SUBSCRIBE NOW

Related articles

Robot startup uses ChatGPT to enhance its communications and reasoning skills

Humanoid robot startup Figure has secured a significant $675 million investment from a group of high-profile investors, including...

Lawsuit requires Pegasus spyware to provide code used to spy on WhatsApp users

NSO Group, the developer behind the sophisticated Pegasus spyware, has been ordered by a US court to provide...

OpenAI claims New York Times manipulated ChatGPT “fabricate data”

OpenAI has challenged the New York Times' copyright lawsuit, asserting the newspaper manipulated ChatGPT to fabricate evidence. The...

Wendy’s leverages digital tech to test “surge pricing”

Wendy's is set to experiment with Uber-like surge pricing, a concept referred to as "dynamic pricing," starting in...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways