Google has announced Gemini 1.5, its next-generation artificial intelligence (AI) model. The search giant made this move a week after rolling out its most capable model, the Gemini 1.0 Ultra. Google has also recently rebranded its AI chatbot, Bard, as Gemini.
“We’re ready to introduce the next generation: Gemini 1.5. It shows dramatic improvements across a number of dimensions and 1.5 Pro achieves comparable quality to 1.0 Ultra, while using less compute,” said Google and Alphabet CEO Sundar Pichai in a blog post. The company said that the first Gemini 1.5 model they are releasing for early testing is the Gemini 1.5 Pro. According to the tech giant, Gemini 1.5 Pro is a mid-size multimodal model optimized for scaling across several tasks. Google also claims that it performs at a similar level to 1.0 Ultra.
A larger context window is one of the significant advancements in Gemini 1.5. Google explained that an AI model’s “context window” is made up of tokens, which are the building blocks used for processing information. The bigger a model’s context window, the more information it can take in and process at a given prompt. Google highlighted that the Gemini 1.5 Pro arrives with a standard 128,000 token context window.
At the same time, Google also noted that a limited group of developers and enterprise customers can try it with a context window of up to 1 million tokens through AI Studio and Vertex AI in private preview. Gemini 1.5 Pro has the ability to process huge amounts of information in one go. This includes 1 hour of video, 11 hours of audio, codebases with over 30,000 lines of code, or over 700,000 words. Google CEO Sundar Pichai said that longer context windows will enable entirely new capabilities and help developers build more useful models and applications.
According to Google, Gemini 1.5 is built upon their leading research on Transformer and MoE architecture. The tech giant claims that their latest innovations in model architecture permit the latest AI model to learn complex tasks more quickly and maintain quality. The company said that Gemini 1.5 Pro maintains high levels of performance even as its context window increases. Currently, a limited preview of 1.5 Pro is available to developers and enterprise customers.