Zoho Corporation announced today that it is leveraging NVIDIA’s open-source large language models (LLMs), including NVIDIA NeMo, to build and deploy advanced AI capabilities across its software-as-a-service (SaaS) applications. This collaboration positions Zoho as a leader in bringing cutting-edge AI models to commercial usage, utilizing open-source weights and training data provided by NVIDIA.
By integrating NVIDIA’s AI accelerated computing platform and NeMo toolkit, Zoho aims to develop LLMs tailored for a wide range of business use cases. The company has invested over $10 million in NVIDIA’s AI technology and GPUs in the past year, with plans to invest an additional $10 million in the coming year. This substantial investment underscores Zoho’s commitment to enhancing its AI infrastructure and offering advanced solutions to its global customer base of over 700,000 businesses.
Zoho’s Director of AI, Ramprakash Ramamoorthy, emphasized the company’s focus on context-driven AI solutions: “Many LLMs on the market today are designed for consumer use, offering limited value for businesses. At Zoho, our mission is to develop LLMs tailored specifically for a wide range of business use cases. Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context.”
The partnership leverages NVIDIA’s open-source models, including weights and training data—a notable development in the AI industry. Zoho is accelerating its LLMs using NVIDIA Hopper GPUs and is utilizing NVIDIA NeMo for developing custom generative AI models. Early testing has shown a 60% increase in throughput and a 35% reduction in latency compared to previous open-source frameworks.
“The ability to choose from a range of AI model sizes empowers businesses to tailor their AI solutions precisely to their needs, balancing performance with cost-effectiveness,” said Vishal Dhupar, Managing Director, Asia South at NVIDIA. “With NVIDIA’s AI software and accelerated computing platform, Zoho is building a broad range of models to help serve the diverse needs of its business customers.”
Zoho maintains that privacy is still a key part of their AI strategy. The company says it ensures that its LLMs are compliant with privacy regulations from the ground up and will not be trained on customer data. This is made possible because Zoho not only controls its entire tech stack, but also owns and operates its data centers, providing complete oversight of customer data, privacy, and security.
