From Android 15, to Sora-like AI video generator, here's everything announced at Google I/O 2024

The latest Google I/O event was all about AI. They introduced many new features, especially for Android 15, which is still being tested. Most of the updates were about making AI more central to how Android works and how we search on Google.

Gemini, a feature introduced last year, is getting even more integrated into Pixel phones. Soon, you'll be able to use Gemini over any app to easily add AI-generated text or pictures. They're also improving Circle to Search and Gemini Nano to understand text, images, and audio better.

AI was a big focus, mentioned 121 times in the keynote. Here are the main updates Google announced.

Gemini gets some updates and a new version

Google has announced a new AI model called Gemini 1.5 Flash, which is optimised for greater speed and efficiency. Flash sits between Gemini 1.5 Pro and Gemini 1.5 Nano, which is the company’s smallest model that runs locally on the device.

Google said that it created Flash because developers wanted a lighter and less expensive model than Gemini Pro to build AI-powered apps and services while keeping some of the things like a long context window of one million tokens that differentiates Gemini Pro from competing models.

Google will also increase or rather almost double Gemini’s context window to two million tokens later this year. This will allow it to be able to process two hours of video, 22 hours of audio, more than 60,000 lines of code or more than 1.4 million words at the same time.

Google introduced Gemini 1.5 Flash, a new AI model focused on speed and efficiency. It fills the gap between Gemini 1.5 Pro and Gemini 1.5 Nano, the smallest model that operates locally on devices.

This decision was made based on developers' requests for a lighter and more affordable alternative to Gemini Pro for building AI-powered apps and services while retaining features like a long context window of one million tokens, which distinguishes Gemini Pro from other models.

Later this year, Google plans to expand Gemini's context window to two million tokens, enabling it to process two hours of video, 22 hours of audio, over 60,000 lines of code, or more than 1.4 million words simultaneously.

Project Astra

Project Astra was also showcased, representing an early iteration of a universal AI-powered assistant. Described by Google's DeepMind CEO Demis Hassabis as Google's equivalent of an AI agent for everyday use, Astra was demonstrated through a video filmed in a single take.

android, from android 15, to sora-like ai video generator, here's everything announced at google i/o 2024

Project Astra Google IO 2024-2024-05-e253f851e46557910857a817988aad64

Image Credit: Google

In the video, a user navigates Google's London office with their phone, engaging in natural conversations with the app while pointing the camera at various objects such as a speaker, code on a whiteboard, and the view outside a window.

Notably, Astra accurately identifies the location of the user's glasses without them mentioning it. The video concludes with a revelation that the glasses contain an onboard camera system and can seamlessly interact with Project Astra, hinting at Google's potential development of smart glasses comparable to Meta's Ray Ban.

Google Photos answers everything

Google Photos has stepped up its game with AI, making it even smarter at finding specific images or videos. If you're a Google One subscriber in the US, you'll soon be able to ask Google Photos complex questions like "show me the best photo from each national park I've visited."

This feature, rolling out over the next few months, will use GPS info and Google's own judgment to present you with options. Additionally, you can ask Google Photos to generate captions for your photos to share on social media.

Imagine Imagen 3 and Veo

Google has introduced two new AI-powered media creation engines: Veo and Imagen 3. Veo is Google's response to OpenAI's Sora, capable of producing high-quality 1080p videos that can last longer than a minute. It's equipped to understand cinematic concepts like timelapses.

android, from android 15, to sora-like ai video generator, here's everything announced at google i/o 2024

Google VEO

Image Credit: Google

Imagen 3, on the other hand, is a text-to-image generator that Google claims surpasses its previous version, Imagen 2. This upgraded model produces the company's highest quality text-to-image results with an incredible level of detail, creating photorealistic, lifelike images with fewer flaws. This places it in competition with OpenAI's DALLE-3.

Search reborn

Google is revolutionising the core functionality of Search with significant updates. While many of the announced features, such as the ability to ask intricate questions or plan meals and trips using Search, will only be accessible through opting into Search Labs, a platform for testing experimental features.

A major new addition called AI Overviews, which Google has been testing for a year, is now rolling out to millions of users in the US. This feature will display AI-generated answers at the top of search results by default and is slated to reach over a billion users worldwide by year's end.

Android 15 gets painted with AI

Google is directly integrating Gemini into the Android operating system. With the release of Android 15 later this year, Gemini will be contextually aware of the app, image, or video being used, allowing users to summon it as an overlay for specific inquiries. The implications for Google Assistant, which currently fulfils similar functions, remain unclear as it was not addressed in today's keynote.

Other updates include the addition of digital watermarks to AI-generated content, the integration of Gemini into the side panel of Gmail and Docs, the implementation of a virtual AI teammate in Workspace, real-time detection of potential scams during phone calls, and various other enhancements.

(With inputs from agencies)

OTHER NEWS

2 hrs ago

Dry days in Bengaluru: Liquor sale banned for 5 days in June; check out

2 hrs ago

Jawa 42 Bobber Red Sheen Launched in India, Prie Starts at Rs 2.30 Lakh

2 hrs ago

Virat Kohli To Miss Warm-Up Game vs Bangladesh After Travel To US Delayed Due To Pending Paperwork: Reports

2 hrs ago

Saroj Goenka, Daughter-In-Law Of Ramnath Goenka, Dies At 94

3 hrs ago

Go Digit IPO: D-Street Debut Listing At 5% Premium, Opportunity In General Insurance | Kamesh Goyal

3 hrs ago

Who is Anasuya Sengupta? The first Indian actor to win Best Actress at Cannes once felt ‘claustrophobic, lost’ in Mumbai’s film industry

3 hrs ago

Sam Altman under fire amid AI safety concerns, legal tussle at OpenAI

3 hrs ago

Truecaller will soon let you create an AI version of your voice to answer calls

3 hrs ago

Thanks to this researcher, soon, you might be able to charge a dead phone in ten minutes FLAT

3 hrs ago

Phi-3: Microsoft’s small language model will make AI tools accessible for developers

3 hrs ago

India's chemicals market to hit $29.7 bn

3 hrs ago

Have you tried this zesty lemon snacking trend yet?

3 hrs ago

Boeing says its spacecraft is leaking but it's still safe to launch US astronauts next week

3 hrs ago

Hindalco Q4: Copper Biz EBITDA Seen At ₹630 Cr, Aluminium Biz To Be Primarily Led By Lower Costs

4 hrs ago

Kedarnath News: Narrow Escape For Pilot Along With 6 Passengers As Helicopter Makes Emergency Landing

4 hrs ago

Petrol Diesel Price Today: Check Latest Fuel Prices In Your City On May 25

4 hrs ago

PV Sindhu reaches first final in 14 months at Malaysia Masters

4 hrs ago

'When I raised my concern, no one agreed to it': Shreyas Iyer opens up on struggle with back injury after ODI World Cup

4 hrs ago

Nothing Phone 3 Could Have iPhone-Like Action Button, Carl Pei Teases With New Photo

4 hrs ago

Evacuations on as Cyclone Remal set to make landfall

4 hrs ago

2nd T20I: Jos Buttler knock guides England to 23-run victory over Pakistan

4 hrs ago

Go to mental hospital for wife's discharge, Bombay HC rebukes man

4 hrs ago

Rajeev Chandrasekhar Slams Congress, Says It Has Countered Every Scheme | Moneycontrol Exclusive

4 hrs ago

'Bhaiyya Ji' box office day 1: Manoj Bajpayee's 100th film opens with Rs 1.44 crore

4 hrs ago

Cyclone Remal: Kolkata airport to suspend flight operations for 21 hours

4 hrs ago

Cannes 2024: Aditi Rao Hydari’s Gaurav Gupta Couture Gown Paints A Surreal Picture In Monochrome

4 hrs ago

Lok Sabha Elections 2024 | Voter Turn Out Increase , Trouble For I.N.D.I.A Bloc? | PM Modi | News18

4 hrs ago

Kevin Costner's Horizon: An American Saga Receives Standing Ovation At Cannes, Sees Walkouts As Well

4 hrs ago

Malaysia Masters 2024: PV Sindhu Storms Into Finals After Dominant Showing in Semis

4 hrs ago

Canada dissolves two firms citing national security concerns

4 hrs ago

Rahul Gandhi mocks dip in 'dignity of speeches'

4 hrs ago

Teaser Of Kannada Film Maarige Daari Out. Watch It Now

5 hrs ago

Even home-made foods can be unhealthy, according to ICMR; here’s what you should keep in mind

5 hrs ago

Severe Cyclone Remal heads for Bengal coast, Odisha braces for impact

5 hrs ago

Interview: Sobhita Dhulipala calls Cannes 2024 ‘incredible year for Indian films’

5 hrs ago

Who's actually buying Apple's iPads?

5 hrs ago

'They Were Strongly Against It’: Triple H and Roman Reigns on The Rock Winning the WWE Universal Championship At WrestleMania

5 hrs ago

Cyclone Remal Alert! IMD issues warnings for THESE states; relief teams deployed as IMD predicts heavy rainfall

5 hrs ago

ICC Unveils Elite List Of Commentators For T20 World Cup 2024

5 hrs ago

Newcastle miss out on Europe after Man Utd FA Cup win