NVIDIA Introduces NIM Microservices to Enhance AI Application Safety
Ted Hisokawa Jan 16, 2025 08:58
NVIDIA's new NIM microservices aim to bolster the security and reliability of AI applications, offering enhanced safety and control for enterprises across various industries.
NVIDIA has unveiled its latest innovation in AI technology, introducing the NVIDIA NIM microservices as part of its NeMo Guardrails suite. These microservices are designed to enhance the accuracy, security, and control of AI applications, according to NVIDIA.
NVIDIA NeMo Guardrails and NIM Microservices
The new NIM microservices are a crucial addition to the NVIDIA NeMo Guardrails platform, which provides a comprehensive set of tools for developing and managing AI guardrails. These microservices are portable and optimized for inference, assisting companies in improving the safety, precision, and scalability of their generative AI applications.
NeMo Guardrails, a part of the broader NVIDIA NeMo platform, aids developers in integrating and managing AI guardrails within large language model (LLM) applications. Notable industry players such as Amdocs, Cerence AI, and Lowe’s are leveraging NeMo Guardrails to safeguard their AI applications.
Industry Adoption and Benefits
Enterprises across various sectors, including automotive, finance, healthcare, and retail, are adopting NVIDIA's NIM microservices to enhance customer service by ensuring AI-generated responses are safe and reliable. These microservices help developers build AI agents that operate within specified parameters, providing contextually appropriate responses and resisting jailbreak attempts.
For instance, Amdocs has integrated NeMo Guardrails into its amAIz platform to deliver safer AI-driven customer interactions. Similarly, Cerence AI is utilizing these tools to ensure its in-car assistants offer secure and context-aware interactions.
Open-Source Tools and Community Engagement
NVIDIA is also offering NeMo Guardrails to the open-source community, enabling developers to orchestrate AI software policies that enhance LLM application security. The platform supports integration with various AI safety models and observability tools, furthering its versatility and robustness in AI application development.
In addition, NVIDIA has introduced Garak, an open-source toolkit developed by the NVIDIA Research team, to help developers test the effectiveness of AI safety measures. Garak allows developers to identify potential vulnerabilities in AI systems, such as data leaks and prompt injections, thereby enhancing the robustness of AI models.
Availability
NVIDIA NeMo Guardrails microservices, along with the NeMo Guardrails platform and the Garak toolkit, are now available for developers and enterprises. These tools provide a robust framework for building secure and reliable AI applications, setting new standards for AI safety and performance.
For more information, visit the official NVIDIA blog.
Image source: Shutterstock.jpg)