From handling Magic Eraser to Zoom Enhance, Pixel 8 Pro's on-device generative AI sure does pack a punch. (Image: Anuj Bhatia/The Indian Express)
Listen to this articleYour browser does not support the audio element.
You might think that large language models (LLMs) with billions or even trillions of parameters, such as ChatGPT, are the ultimate tools for natural language processing. But these models come with a huge cost: they require massive amounts of computing power and are super-pricey to run. That’s why many experts believe that smaller, more specialised models trained on richer data will soon take over today’s general-purpose LLMs.
And guess what? The future is already here. Google has just announced that its new Pixel 8 Pro smartphone comes with its own generative AI models built in. This doesn’t mean that you can run Bard, Google’s own version of ChatGPT, offline on your phone. But it does mean that you can use some of its features without relying on the cloud. Let’s see how.
You have exhausted your monthly limit of free stories.
Read more stories for free with an Express account.
At the Made by Google event this week, Rick Osterloh, SVP of devices and services at Google, revealed that the Pixel 8 Pro’s custom-made Tensor G3 chip, which is optimized for AI tasks, can run “distilled” versions of Google’s state-of-the-art models for generating text and images. These models can power various applications on the phone, such as image editing.
Tensor G3 enables better audio and video quality. (Image: Google)
“We’ve worked closely with our research teams across Google to take advantage of their most advanced foundation models and distill them into a version efficient enough to run on our flagship Pixel,” Osterloh said.
Unfortunately, the Pixel 8 didn’t make the cut, even though it has the same SoC (system on chip) as its bigger brother.
Google’s main selling point for the Pixel phones is their artificial intelligence capabilities. These phones have the Tensor chip, which may not score very high on benchmarks, but excels at AI performance. It is Tensor that handles the Pixel’s famous computational photography and its smart speech recognition features. And since the phone already has a chip that can handle AI, it makes sense to run AI models on it.
Having AI models on the phone means that it doesn’t need to send data to the cloud for processing, which can improve speed, privacy, and battery life. Now let’s take a look at what AI models on the Pixel 8 Pro can do.
Google Photos has had a Magic Eraser tool for some time now, but it’s getting an upgrade thanks to on-device large language models. Now you can erase bigger objects and people from your photos without leaving any traces behind. The new Magic Eraser fills in the gaps with generated pixels that match the surrounding area, giving you a cleaner and more realistic result.
Zoom Enhance
It isn’t perfect (notice the cables), but it’ll probably get better with time. (Image: Google)
But the most impressive feat of on-device AI is Zoom Enhance, a feature that can sharpen your zoomed-in photos and get rid of any pixelation. Google showed off this feature by zooming in on one of the towers of the Golden Gate Bridge and enhancing it with a proprietary imaging model. The Google Pixels have always had great zoom capabilities, but they still lag behind Samsung’s insane 100x zoom cameras. Now Google is using artificial intelligence to bridge the gap.
Recorder app’s summarisation tool
Google is also applying on-device generative AI to its Recorder app, which will soon be able to automatically summarise your conversations and give you some key bullet points. This feature will be available later this year on the Pixel 8 and Pixel 8 Pro.
Smart replies in Gboard
Another large language model running on the Pixel 8 Pro will power smart replies in Gboard, Google’s keyboard app. The improved Gboard will offer “higher-quality” reply suggestions that are more aware of the context and tone of the conversation.
Zohaib is a tech enthusiast and a journalist who covers the latest trends and innovations at The Indian Express's Tech Desk. A graduate in Computer Applications, he firmly believes that technology exists to serve us and not the other way around. He is fascinated by artificial intelligence and all kinds of gizmos, and enjoys writing about how they impact our lives and society. After a day's work, he winds down by putting on the latest sci-fi flick. • Experience: 3 years • Education: Bachelor in Computer Applications • Previous experience: Android Police, Gizmochina • Social: Instagram, Twitter, LinkedIn ... Read More
Technology on smartphone reviews, in-depth reports on privacy and security, AI, and more. We aim to simplify the most complex developments and make them succinct and accessible for tech enthusiasts and all readers. Stay updated with our daily news stories, monthly gadget roundups, and special reports and features that explore the vast possibilities of AI, consumer tech, quantum computing, etc.on smartphone reviews, in-depth reports on privacy and security, AI, and more. We aim to simplify the most complex developments and make them succinct and accessible for tech enthusiasts and all readers. Stay updated with our daily news stories, monthly gadget roundups, and special reports and features that explore the vast possibilities of AI, consumer tech, quantum computing, etc.
