AI companies pledge to make AI systems more trustworthy

Share post:

The Biden-Harris administration has announced that eight major tech companies have agreed to red team their AI applications and prioritize research that will make their systems more trustworthy.

The companies involved are Adobe, Cohere, IBM, Nvidia, Palantir, Salesforce, Scale AI, and Stability AI. They have all committed to developing machine-learning software and models in a safe, secure, and trustworthy way.

Under the agreement, the companies will submit their software to internal and external audits, where independent experts can attack the models to see how they can be misused.

They will also safeguard their intellectual property and make sure that the weights of their proprietary neural networks don’t leak.

Additionally, they will give users a way to easily report vulnerabilities or bugs, and publicly report their technology’s capabilities and limits, including fairness and biases, and define inappropriate use cases that are prohibited.

Also, they will focus on research to investigate societal and civil risks AI might pose if they lead to discriminatory decision-making or have weaknesses in data privacy.

The U.S. government is also encouraging the companies to develop watermarking techniques that can identify AI-generated content.

Finally, the companies have committed to building models for good, such as fighting climate change or improving healthcare.

The sources for this piece include an article in TheRegister.


Related articles

Google’s search secrets are accidentally leaked

Documents that describe Google's search ranking processes were accidentally published online, sparking a frenzy among search engine optimization...

OpenAI head of AI safety defects to rival Anthropic

Jan Leike, formerly the superalignment leader at OpenAI, has joined rival AI company Anthropic. This move comes after...

Canadian schools sue social media giants over alleged harm to children

Five Ontario school boards along with two private schools have joined lawsuits that claim that social media platforms...

Microsoft tries to regain trust of government cybersecurity leadership

Microsoft has embarked on an aggressive campaign to restore and enhance its cybersecurity image and regain trust within...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways