AI model transparency index reveals lack of transparency in the AI industry

Share post:

In a new report, researchers at Stanford University have found that the biggest AI companies are not being transparent about their massive and powerful AI models.

The Foundation Model Transparency Index, which graded 10 of the biggest AI models on 100 different metrics of transparency, found that even the highest-scoring model, Meta’s Llama 2, only received a score of 54 out of 100.

The report’s authors say that this lack of transparency is a major concern, as it makes it difficult to assess the potential risks and benefits of these models. For example, the researchers found that most companies are not disclosing what data their models were trained on, or how those models are being used in the real world. This makes it difficult to know whether the models are biased, or whether they are being used in ways that could harm people.

The report also found that most companies are not being transparent about the labor practices that go into developing and maintaining their AI models. For example, many companies are using low-wage workers in developing countries to train their models. However, the companies are not disclosing who these workers are, what they are paid, or what working conditions they are subjected to.

The report’s authors say that the AI industry needs to be more transparent about its models in order to build trust with the public and to ensure that these models are used responsibly. They call on companies to disclose more information about their models, including the data they were trained on, how they are being used, and the labor practices that go into developing and maintaining them.

The sources for this piece include an article in SpectrumIEEE

Featured Tech Jobs


Related articles

OpenAI acknowledges “ChatGPT had a melt down”

ChatGPT had what witnesses are describing as a "meltdown" over the past day. Various reports surfaced with incidents...

OpenAI faces social media backlash with launch of Sora for text to image

OpenAI's launch of its new text-to-video model, Sora, has stirred up considerable debate and concern among the public...

Microsoft develops its own chip and network card as cheeper and faster alternative to Nvidia

Microsoft is reportedly developing its own AI server gear, including a new network card, to enhance the performance...

Adobe Acrobat introduces its own AI assistant

Adobe Acrobat is introducing an AI Assistant as a beta feature for its PDF management software, aiming to...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways