Artificial intelligence is in the midst of transforming organizations across industries. As AI workloads become increasingly compute-intensive, many believe the need for scalable AI infrastructure has grown to meet these rising demands.
“This AI thing is real. It’s AI everywhere … powering all the trends, all the markets … all the way through the stack,” said Dave Vellante, co-founder and chief analyst of theCUBE Research, in March.
In this new era, companies such as Anyscale Inc. have sought to respond with a goal to redefine enterprise AI deployments through LLMs and beyond. The scale required by AI workloads is creating hard infrastructure challenges, according to Robert Nishihara, co-founder of Anyscale.
“The number one question people would always ask us was whether distributed computing was really necessary. Isn’t a single machine enough?” Nishihara wrote in a blog in July. “It wasn’t until ChatGPT and the generative AI wave that the need for scale became abundantly clear.”
The road ahead for scalable AI will be a key area of interest during Anyscale’s Ray Summit 2024 event. The event will be a chance to learn more about how Anyscale is leveraging strategic partners, such as Nvidia Corp., to further its growth.
On Oct. 1, analysts with theCUBE will discuss scalable AI and the latest product announcements while talking with company executives and industry experts. Join us for exclusive coverage of Ray Summit 2024, live on theCUBE, SiliconANGLE Media’s livestreaming studio. (* Disclosure below.)
New leadership, scalable AI and strategic alliances
Anyscale is behind Ray, which is an open-source framework for scalable AI. The company is now under new leadership, having named Aruba Networks founder Keerti Melkote as its chief executive officer in July.
“I am excited to join Robert, Philipp and Ion, along with the incredibly talented team at Anyscale, to capitalize on the head start Ray has in this emerging category of AI infrastructure,” Melkote said in a release.
In recent months, Anyscale has sought to deliver advancements in LLM development and deployment through new frameworks, partnerships and services. That includes a July 2024 announcement tied to RouteLLM, an open-source framework for cost-effective LLM routing, from researchers from Anyscale, Canva Inc. and University of California, Berkeley.
Anyscale also announced a partnership with Nvidia in September 2023, intended to supercharge LLM performance and efficiency. The companies announced they would integrate Nvidia AI software into Anyscale’s scalable computing platforms.
“LLMs are at the heart of today’s generative AI transformation, and the developers creating and customizing these models require full-stack computing with efficient orchestration throughout the AI life cycle,” said Manuvir Das, vice president of enterprise computing at Nvidia, in a release. “The combination of Nvidia AI and Anyscale unites incredible performance with ease of use and the ability to scale rapidly with success.”
Anyscale’s next steps for scalable AI under its new leadership will be studied during Ray Summit 2024 event. TheCUBE will provide full coverage of the event while talking with industry professionals about use cases on the impact of Anyscale’s open-source contributions. You can follow theCUBE’s wall-to-wall coverage for firsthand insights.
TheCUBE event livestream
Don’t miss theCUBE’s coverage of the Anyscale Ray Summit 2024 event on Oct. 1. Plus, you can watch theCUBE’s event coverage on-demand after the live event.
How to watch theCUBE interviews
We offer you various ways to watch theCUBE’s coverage of the Anyscale Ray Summit 2024 event, including theCUBE’s dedicated website and YouTube channel. You can also get all the coverage from this year’s events on SiliconANGLE.
TheCUBE Insights podcast
SiliconANGLE also has podcasts available of archived interview sessions, available on iTunes, Stitcher and Spotify, which you can enjoy while on the go.
SiliconANGLE also has analyst deep dives in our Breaking Analysis podcast, available on iTunes, Stitcher and Spotify.
Guests
During the Anyscale Ray Summit 2024 event, theCUBE analysts will speak with machine learning experts, software engineers and analysts to discuss the innovations redefining API management for scaling AI infrastructure
(* Disclosure: TheCUBE is a paid media partner for Ray Summit 2024. Neither Anyscale Inc., the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)