NVIDIA Unveils NIM to Accelerate Generative AI Development for 28 Million Developers
Jessie A Ellis Jun 01, 2024 18:56
NVIDIA launches NIM to enhance generative AI development for global developers.
Revolutionizing AI Development
NVIDIA has announced the release of NVIDIA NIM™, a groundbreaking suite of inference microservices, set to transform the landscape of generative AI development. Available for download, NIM enables the world’s 28 million developers to deploy models as optimized containers across clouds, data centers, or workstations, according to the NVIDIA Newsroom.
NVIDIA NIM aims to expedite the development of complex generative AI applications—such as copilots and chatbots—by reducing deployment times from weeks to mere minutes. This innovation brings significant advantages to enterprises, allowing them to maximize infrastructure investments and boost operational efficiency.
Enhanced Efficiency and Productivity
The new suite of microservices simplifies the integration of multiple models that generate text, images, video, and speech, among other types of data. For instance, running Meta Llama 3-8B with NIM can yield up to three times more generative AI tokens on accelerated infrastructure, significantly enhancing computational efficiency.
Nearly 200 technology partners, including Cadence, Cloudera, Cohesity, DataStax, NetApp, Scale AI, and Synopsys, have already integrated NIM into their platforms. These collaborations aim to expedite the deployment of domain-specific applications, such as digital human avatars, code assistants, and copilots.
Industry-Wide Integration
Jensen Huang, founder and CEO of NVIDIA, emphasized the widespread accessibility of NIM, stating, “Integrated into platforms everywhere, accessible to developers everywhere, running everywhere—NVIDIA NIM is helping the technology industry put generative AI in reach for every organization.”
Enterprises can deploy AI applications in production using the NVIDIA AI Enterprise software platform. Starting next month, members of the NVIDIA Developer Program will gain free access to NIM for research, development, and testing on their preferred infrastructure.
Powering Generative AI Models
Over 40 NVIDIA and community models are available as NIM endpoints, including Databricks DBRX, Google’s open model Gemma, Meta Llama 3, Microsoft Phi-3, and Snowflake Arctic. Developers can access these models via platforms like Hugging Face, enabling easy deployment and operation of generative AI models.
NIM also supports applications for generating text, images, video, speech, and digital humans. For example, NVIDIA BioNeMo™ NIM microservices allow researchers to build novel protein structures, accelerating drug discovery. Dozens of healthcare companies are deploying NIM to enhance surgical planning, digital assistants, and clinical trial optimization.
Expanding Applications and Ecosystem
With new NVIDIA ACE NIM microservices, developers can build interactive, lifelike digital humans for customer service, telehealth, education, gaming, and entertainment. Industry leaders like Foxconn, Pegatron, Amdocs, Lowe’s, ServiceNow, and Siemens are leveraging NIM for various generative AI applications across manufacturing, healthcare, financial services, and retail.
Foxconn is using NIM to develop domain-specific LLMs for smart manufacturing and smart cities, while Pegatron is advancing local LLMs for industry-specific applications. Amdocs utilizes NIM to run customer billing LLMs, significantly reducing costs and improving response times.
Availability and Future Prospects
Developers can experiment with NVIDIA microservices at ai.nvidia.com at no charge. Enterprises can deploy production-grade NIM microservices with NVIDIA AI Enterprise running on NVIDIA-Certified Systems and leading cloud platforms. Starting next month, members of the NVIDIA Developer Program will gain free access to NIM for research and testing.
Watch Huang’s COMPUTEX keynote to learn more about NVIDIA NIM.
Image source: Shutterstock.jpg)