NVIDIA NIM, 2,800만 개발자에 생성AI 배포 제공
무슨 발표인가
- NVIDIA NIM이 클라우드·데이터센터·워크스테이션 배포 지원
- 150개 이상 파트너 기업이 구축 중
- Meta Llama 3-8B NIM 운영 시 생성AI 토큰 3배 증가
원문 (영어)
150+ Partners Across Every Layer of AI Ecosystem Embedding NIM Inference Microservices to Speed Enterprise AI Application Deployments From Weeks to Minutes NVIDIA Developer Program Members Gain Free Access to NIM for Research, Development and Testing COMPUTEX— NVIDIA today announced that the world’s 28 million developers can now download NVIDIA NIM — inference microservices that provide models as optimized containers — to deploy on clouds, data centers or workstations, giving them the ability to easily build generative AI applications for copilots, chatbots and more, in minutes rather than weeks.
These new generative AI applications are becoming increasingly complex and often utilize multiple models with different capabilities for generating text, images, video, speech and more. NVIDIA NIM dramatically increases developer productivity by providing a simple, standardized way to add generative AI to their applications.
NIM also enables enterprises to maximize their infrastructure investments. For example, running Meta Llama 3-8B in a NIM produces up to 3x more generative AI tokens on accelerated infrastructure than without NIM. This lets enterprises boost efficiency and use the same amount of compute infrastructure to generate more responses.
Nearly 200 technology partners — including Cadence, Cloudera , Cohesity , DataStax , NetApp , Scale AI and Synopsys — are integrating NIM into their platforms to speed generative AI deployments for domain-specific applications, such as copilots, code assistants and digital human avatars.
Hugging Face is now offering NIM — starting with Meta Llama 3 . “Every enterprise is looking to add generative AI to its operations, but not every enterprise has a dedicated team of AI researchers,” said Jensen Huang, founder and CEO of NVIDIA.
원문: NVIDIA News — "NVIDIA NIM Revolutionizes Model Deployment, Now Available to Transform World’s Millions of Developers Into Generative AI Developers" (2024-06-03) 공식 원문: https://nvidianews.nvidia.com/news/nvidia-nim-model-deployment-generative-ai-developers