AI21’s Jamba model integrated with Microsoft Azure AI, with 256K context window and 3X throughput
AI21, a leader in developing foundational models and AI systems for enterprises, has announced a new collaboration with Microsoft. This partnership will integrate AI21’s latest Jamba-Instruct model into Microsoft Azure AI as part of its Model-as-a-Service (MaaS) offering. This integration allows Azure customers to benefit from AI21’s advanced models, leveraging a novel architecture that enhances quality, performance, and cost-efficiency.
Jamba-Instruct: A Breakthrough in AI Technology
Jamba-Instruct is the latest innovation from AI21, featuring the groundbreaking hybrid Mamba-Transformer architecture. This new architecture blends high-quality output, high throughput, and a 256K context window, setting a new benchmark for enterprise-grade AI solutions. Unlike traditional LLMs that rely solely on the Transformer architecture and face challenges like high memory usage and slow inference with increasing context, Jamba-Instruct offers a superior alternative.
Benefits for Azure Customers
Azure customers will soon have access to Jamba-Instruct through Models-as-a-Service, eliminating the need to manage the underlying infrastructure. This makes Microsoft Azure the first hyperscaler cloud to offer this advanced model. The integration highlights Microsoft’s commitment to providing cutting-edge AI tools and technologies that drive innovation and digital transformation across various industries.
Performance and Applications
Jamba-Instruct is designed to deliver exceptional value, quality, and performance for enterprise applications. Its large context window can process the equivalent of a 400-page novel, making it ideal for tasks such as:
- Question answering
- Document summarization
- Building chatbots for sustained and reference-based conversations
Jamba-Instruct surpasses competitors in both quality and cost, making it an excellent choice for enterprises seeking advanced AI solutions that prioritize efficiency without compromising performance and reliability.
Built-in Features and Benefits
Jamba-Instruct includes built-in safety guardrails, chat capabilities, and enhanced command comprehension, which accelerate the time to production for enterprise applications and reduce total cost of ownership (TCO). This enables organizations to achieve a shorter time to value.
Executive Insights
“We are thrilled to collaborate with Microsoft to soon introduce Jamba-Instruct to Microsoft Azure customers. This collaboration underscores our shared commitment to empowering enterprises with some of the most innovative AI solutions available,” said Pankaj Dugar, SVP, GM North America of AI21. “Microsoft’s dedication to putting customers first and making cutting-edge technology accessible aligns perfectly with our mission at AI21. With Jamba-Instruct soon available on Azure AI, customers will have access to a transformative tool that will revolutionize how they approach language processing and drive unprecedented levels of efficiency and insight.”
“We’re pleased to collaborate with AI21 to soon introduce the Jamba-Instruct model in our extensive Microsoft Azure AI model catalog offering developers a choice of foundation and open models,” said Eric Boyd, Corporate Vice President, Azure AI Platform at Microsoft. “With its unique architecture and window context length, Jamba-Instruct presents developers with a great opportunity to build at a lower cost while maintaining outstanding quality and performance.”
The collaboration between AI21 and Microsoft Azure marks a significant milestone in the AI industry. By bringing the revolutionary Jamba-Instruct model to Azure’s Model-as-a-Service offering, enterprises can now access a powerful AI tool that enhances performance, efficiency, and cost-effectiveness. This partnership not only benefits Azure customers but also sets a new standard for enterprise-grade AI solutions.