Meta releases open-source AI tool for text-to-audio conversion

Share post:

Meta has released an open-source AI tool called AudioCraft that can create sound from text-based prompts. The tool is bundled with three models namely; AudioGen, EnCodec, and MusicGen. AudioGen is designed for creating sound effects based on a written description, EnCodec is a decoding engine, and MusicGen is designed for creating music from text.

Meta is making the code and model weights for AudioCraft available on GitHub. This will allow developers and researchers to experiment with the tool and contribute to its development.

AudioCraft is regarded as a significant advancement in generative AI. Previous advancements in generative AI have focused on text and image generation. AudioCraft, on the other hand, tackles the complex task of text-to-audio conversion. By training language models over their proprietary EnCodec neural audio codec, Meta has enabled AudioCraft to understand the associations between audio and text.

AudioCraft could be used to create realistic sound effects for video games, generate music for digital worlds, or even create new forms of art.

Meta is making AudioCraft available for research use, but it is yet announced any commercial applications for the tool.

The sources for this piece include an article in Axios.

Featured Tech Jobs

SUBSCRIBE NOW

Related articles

Microsoft and OpenAI partner to build a $100 Billion AI supercomputer “Stargate”

In a bold stride towards computational supremacy, Microsoft, in partnership with OpenAI, is reported to be laying the...

US Bill Aims to Unveil AI Training Data Sources Amid Copyright Concerns

In a significant move toward transparency, a bill was introduced in the US Congress on Tuesday by California...

AI presents an “extinction level threat” – US Gov’t Report: Hashtag Trending for Tuesday, March 12, 2024

A new US government report warns that AI presents an “extinction level threat to the human species. Elon Musk is outsourcing his Grok AI code. Hackers have breached the Cybersecurity and Infrastructure Security Agency in the US and a researcher shows how to steal a Tesla by leveraging a feature of the Tesla charging stations.

Robot startup uses ChatGPT to enhance its communications and reasoning skills

Humanoid robot startup Figure has secured a significant $675 million investment from a group of high-profile investors, including...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways