Databricks, the Data and AI company, has announced a strategic collaboration agreement (SCA) with Amazon Web Services (AWS) aimed at accelerating the development of custom models using Databricks Mosaic AI on AWS. This partnership will utilize AWS Trainium chips as the preferred AI chip, enhancing the model training and serving capabilities of Mosaic AI on AWS.
1. Mosaic AI Model Capabilities
- The collaboration enables joint customers to leverage Mosaic AI for pretraining, fine-tuning, augmenting, and serving large language models (LLMs) on their private data.
- Customers can benefit from the scalability, performance, and security provided by AWS.
- New integrations will be available through Databricks on the AWS Marketplace.
2. Enhancing Custom AI Applications
- Databricks’ expanded Mosaic AI capabilities, including Mosaic AI Model Serving, supports a variety of model providers, such as those available through Amazon Bedrock.
- The partnership allows for scalable model training at a low cost using AWS Trainium chips, making it possible for thousands of joint customers to build, deploy, and monitor high-quality, customized AI applications without sacrificing control over their data.
3. Quotes from Leaders
- Ali Ghodsi, Co-founder and CEO of Databricks, emphasized that “Generative AI is disrupting every industry… our collaboration with AWS allows us to provide customers with unmatched scale and price-performance.”
- Matt Garman, CEO of AWS, remarked, “This powerful combination will allow businesses of all sizes to gain valuable insights from their data, helping customers innovate faster.”
4. Investment in Joint Offerings
- The partnership aims to invest in product capabilities to support customers, including:
- Custom Model Optimization & Enhanced Security: Collaboration on custom models using AWS Trainium chips to improve cost and performance for training and running LLMs.
- Migration and Modernization for Generative AI: Assistance with migrating data estates to AWS and modernizing data platforms.
- Tailored Industry Solutions: Development of industry-specific solutions to drive innovation in sectors like Media, Entertainment, and Financial Services.
- Enhanced Ease of Use: Simplifying adoption and operation of Databricks on AWS with new integrations on AWS Marketplace.
The strategic collaboration between Databricks and AWS underscores a shared commitment to delivering substantial business value to joint customers, including Block, Rivian, and SEGA. As SEGA’s CTO, Stuart Wright, noted, this collaboration provides the model choice, scalability, security, and price-performance necessary to enhance the gaming experience and foster brand loyalty. The partnership aims to accelerate the adoption of generative AI, enabling organizations to innovate more efficiently in an increasingly data-driven landscape.