Apple open source 200B parameter LLM code

Share post:

Apple has open sourced the code for its 200 billion parameter LLM, Ajax GPT. The code is available on GitHub and can be used by anyone to train their own large language models.

This is a departure from Apple’s previous closed-source approach to AI development, as Apple has been previously criticized for its secrecy. According to a report by The Information, Apple is training this Ajax GPT on 200 billion parameters, potentially surpassing the prowess of GPT-3.5.

The open sourcing of AXLearn could help to foster innovation in the AI research community, as other researchers can now build on Apple’s work. It could also help to attract top talent to Apple, as engineers will be more likely to want to work for a company that is open and collaborative.

AXLearn is designed to facilitate the rapid training of machine-learning models, leverages the power of Google TPUs. Apple’s venture into open source is a stark departure from its traditionally closed-door approach, drawing comparisons to the likes of Meta’s Llama-2 and Anthropic’s Claude-2.

Apple has not released any details about its potential applications. However, it is possible that the model could be used to improve the performance of Apple’s products, such as Siri and the Photos app.

The sources for this piece include an article in AnalyticsIndiaMag.

Featured Tech Jobs


Related articles

Polar: A new way of funding open source projects

A company called Polar is introducing a new idea in open-source funding, aiming to allow open source developers...

Hashtag Trending Jan.19-Impact of AI on employment headlines at Davos; New study shows how much data is shared with Facebook; Starlink announces pricey Gigabit...

Where does Open Source fit into the global AI picture? Davos is abuzz with concerns about AI. A new study shows just how much data is shared with Facebook, Starlink announces Gigabit internet but it comes with a steep price, and your smart headphones might be raising eyebrows – literally.   All this and more

Open-source code fuels rise in supply chain cyberattacks

Recent research highlights a concerning trend in cybersecurity: the increasing use of open-source code and legitimate hacking tools...

Hashtag Trending Oct.31-White House issues orders to regulate AI; Can open source help combat the monopolization of AI by giants? A new version of...

The U.S. President issues executive orders to regulate AI, while some are asking if Open source can keep AI from being dominated by a few giants. Remote work isn’t going away without a fight.  Linus Torvald says he’s “run out of excuses” and releases a new version of the Linux core.   These and more

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways