LLM
Together AI Launches Cost-Efficient Batch API for LLM Requests
Together AI introduces a Batch API that reduces costs by 50% for processing large language model requests. The service offers scalable, asynchronous processing for non-urgent workloads.
NVIDIA Introduces EoRA for Enhancing LLM Compression Without Fine-Tuning
NVIDIA unveils EoRA, a fine-tuning-free solution for improving compressed large language models' (LLMs) accuracy, surpassing traditional methods like SVD.
NVIDIA Enhances Long-Context LLM Training with NeMo Framework Innovations
NVIDIA's NeMo Framework introduces efficient techniques for long-context LLM training, addressing memory challenges and optimizing performance for models processing millions of tokens.
NVIDIA Unveils Advanced Optimization Techniques for LLM Training on Grace Hopper
NVIDIA introduces advanced strategies for optimizing large language model (LLM) training on the Grace Hopper Superchip, enhancing GPU memory management and computational efficiency.
NVIDIA Grace Hopper Revolutionizes LLM Training with Advanced Profiling
Explore how NVIDIA's Grace Hopper architecture and Nsight Systems optimize large language model (LLM) training, addressing computational challenges and maximizing efficiency.
Exploring LLM Agents and Their Role in AI Reasoning and Test Time Scaling
Discover the impact of large language model (LLM) agents on AI reasoning and test time scaling, highlighting their use in workflows and chatbots, according to NVIDIA.
Together Introduces Code Interpreter API for Seamless LLM Code Execution
Together.ai launches the Together Code Interpreter (TCI), an API enabling developers to execute LLM-generated code securely and efficiently, enhancing agentic workflows and reinforcement learning operations.
NVIDIA Unveils Nemotron-CC: A Trillion-Token Dataset for Enhanced LLM Training
NVIDIA introduces Nemotron-CC, a trillion-token dataset for large language models, integrated with NeMo Curator. This innovative pipeline optimizes data quality and quantity for superior AI model training.
Understanding the Complexities of Agent Frameworks
Explore the intricacies of agent frameworks, their role in AI systems, and the challenges in ensuring reliable context for LLMs, as discussed in LangChain Blog.
Ensuring AI Reliability: NVIDIA NeMo Guardrails Integrates Cleanlab's Trustworthy Language Model
NVIDIA's NeMo Guardrails, in collaboration with Cleanlab's Trustworthy Language Model, aims to enhance AI reliability by preventing hallucinations in AI-generated responses.
NVIDIA Launches DriveOS LLM SDK for Autonomous Vehicle Innovation
NVIDIA introduces the DriveOS LLM SDK to facilitate the deployment of large language models in autonomous vehicles, enhancing AI-driven applications with optimized performance.
OpenEvals Simplifies LLM Evaluation Process for Developers
LangChain introduces OpenEvals and AgentEvals to streamline evaluation processes for large language models, offering pre-built tools and frameworks for developers.
Exploring LLM Red Teaming: A Crucial Aspect of AI Security
LLM red teaming involves testing AI models to identify vulnerabilities and ensure security. Learn about its practices, motivations, and significance in AI development.
NVIDIA Introduces Nemotron-CC: A Massive Dataset for LLM Pretraining
NVIDIA debuts Nemotron-CC, a 6.3-trillion-token English dataset, enhancing pretraining for large language models with innovative data curation methods.
Enhancing AI Workflow Security with WebAssembly Sandboxing
Explore how WebAssembly provides a secure environment for executing AI-generated code, mitigating risks and enhancing application security.