NVIDIA AI Enterprise Enhances Security and Deployment of AI Agents
Ted Hisokawa Oct 29, 2024 16:23
NVIDIA AI Enterprise introduces new features for secure and efficient AI agent deployment, enhancing productivity and innovation across industries.
NVIDIA AI Enterprise has unveiled its latest release, focusing on enhancing the security and deployment of AI agents, according to NVIDIA's official blog. This new iteration aims to improve organizational efficiency and innovation by integrating advanced AI capabilities.
Simplified AI Pipeline Management
One of the significant updates includes the introduction of the NVIDIA NIM Operator, which streamlines the deployment and management of AI pipelines on Kubernetes. This tool automates deployment and optimizes performance with features like intelligent model pre-caching, reducing initial inference latency and enabling faster autoscaling. Users can now scale based on various metrics, including CPU, GPU, and NIM-specific standards.
Enhanced Security and API Stability
NVIDIA AI Enterprise offers monthly feature branch releases for developers seeking the latest advancements. However, to address the need for stability, NVIDIA also provides production branches that ensure API consistency and regular security updates, essential for deploying AI in stable environments. These branches are released biannually and maintained for nine months, with continuous monitoring for vulnerabilities and monthly security patches.
The update includes several new NIM microservices, such as Meta’s Llama 3.1 models and Mistral AI’s models, enhancing the suite of tools available for building secure and reliable AI applications.
AI Applications in Healthcare
For industries requiring long-term software support, such as healthcare, NVIDIA AI Enterprise includes long-term support branches (LTSB) with stable APIs for up to three years. The latest release adds Holoscan, a platform for AI sensor processing, crucial for developing AI-enabled medical devices with extended supportability.
Cloud Integration and Deployment
NVIDIA AI Enterprise supports deployment on both on-premises and cloud services. Notably, Google Cloud has integrated NVIDIA NIM into its Kubernetes Engine, allowing enterprise customers to deploy optimized models directly from the Google Cloud Marketplace, simplifying the process for users.
Availability
The updated version of NVIDIA AI Enterprise is now available, with production branch versions of most AI software containers ready for download. NIM microservices are expected to join the production branch by the end of November, providing license holders with enhanced tools and enterprise support.
Image source: Shutterstock