Mistral AI’s Mixtral 8x7B: Upstart new open source offering rivals or surpasses results of larger models

Share post:

Mistral AI, a Paris-based startup, is shaking up the AI industry with its Mixtral 8x7B model, outperforming giants like ChatGPT and Llama with speed and efficiency.

Mistral AI steps into the competitive field with Mixtral 8x7B, an open-source model leveraging Sparse Mixture of Experts architecture for efficient pre-training and scalability. The model and its “Mixture of Experts” approach achieves the performance of larger models with far less compute and far less time required for training.

Demonstrating impressive performance, Mixtral 8x7B matched ChatGPT 3.5 in testing and outdid Llama 2 70B on benchmarks, with six times faster inference.

With significant funding secured, Mistral AI introduces ‘La Plateforme’ for model API endpoints, offering Mistral Tiny and Small, and monetizing the forthcoming Mistral Medium. This dual-revenue strategy boosts Mistral’s open-source venture, propelling its valuation potentially over two billion dollars.

Sources include: Analytics India

SUBSCRIBE NOW

Related articles

CrowdStrike faces backlash over $10 “apology” voucher

CrowdStrike is facing criticism after offering a $10 UberEats voucher to apologize for a global IT outage that...

North Korean hacker infiltrates US security vendor, loads malware

KnowBe4, a US-based security vendor, unknowingly hired a North Korean hacker who attempted to introduce malware into the...

Security company accidentally hires a North Korean state hacker: Cybersecurity Today for Friday, July 26, 2024

A security company accidentally hires a North Korean state actor posing as a software engineer. CrowdStrike issues its...

Security vendor CrowdStrike issues an update from their initial Post Incident Review

Security vendor CrowdStrike released an update from their initial Post Incident Review (PIR) today. The company's CEO has...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways