During the Google I/O conference, the extensive integration of generative AI throughout the Google portfolio took center stage. The highlight of the event was the unveiling of PaLM 2, a powerful large language model (LLM) that promises to revolutionize various Google services. Notably, the cloud sector is set to receive a significant enhancement through deep integration with generative AI.
Google is introducing a new interface, powered by Duet AI, a Google technology, which leverages the PaLM 2 model as its foundation. This integration aims to empower cloud developers and users, fostering increased productivity and efficiency within the cloud environment. By combining the capabilities of generative AI and cloud services, Google is poised to deliver transformative advancements that redefine the cloud computing experience.
How Duet AI could completely change how cloud is managed and developed
For new and experienced users of the cloud alike, there can often be a lot of complexity, which can lead to confusion about how to execute certain types of operations.
Seroter joked that when an individual buys a new car, they usually just get in and drive, without the need to first read the car manual. Cloud doesn’t work the same way in that users typically need to read some documentation — and there is a lot of documentation to go through.
The goal with Duet AI is to bring a conversational experience to the process of learning how to best deploy code and manage applications in the cloud. So instead of a user scrolling through StackOverflow answers, Google search results or YouTube videos, the user can simply ask a question and get an answer right in the cloud console.
“If I can pull good practices, including getting started and improving expert practices, into an in-console chat, that can steer me to some of the right places, I think it’s gonna be really powerful for people who feel intimidated by this giant powerful, awesome cloud experience,” Seroter said.
Duet AI was trained on Google Cloud data to optimize deployment
The modern cloud consists of many different options for developers to consider for app deployment, including different types of containers as well as virtual machines.
Seroter said that the complexity of cloud deployment is why Google had to fine-tune Duet AI specifically with information about Google Cloud.
“So we found all of our docs, which is well over a million pages of docs, not to mention every code sample we’ve written, every reference application, every blog post and every YouTube video transcript,” Seroter said.
Rather than just relying on generic information that PaLM 2 might have, Duet AI has the right specific contextual information to provide accurate responses about Google Cloud.
The future of Duet AI in the cloud is ‘day two’ operations and SRE
The initial rollout of Duet AI for Google Cloud has a focus on developers, which will expand in the coming months to what are called “day two” operations, or ongoing cloud management (in software development parlance, development and deployment of code is typically referred to as a “day one” operation, which ongoing maintenance is “day two”).
Seroter said that future iteration of Duet AI for Google cloud will help organizations with site reliability engineering (SRE) and best practices at the architecture level that keep cloud applications running on day two and beyond. Going a step further, Seroter sees a future where Duet AI can also help with cloud cost optimization, to help organizations be more efficient with how they deploy and manage cloud infrastructure and applications.
“AI is the new interface for the cloud,” Seroter said. “It’s not just sitting outside the cloud, this is infused into the cloud experience.”
