Exclusive: Along with new camera hardware, Google's $899 phone's Tensor G2 AI brain helps you zoom, focus, unblur faces and shoot in the dark.

With new hardware, software and artificial intelligence technology, Google expects significant camera improvements to its Pixel 7 Pro smartphone. And CNET has the exclusive deep dive into exactly what the company has done.

In part because of that photography technology, Google positions its $899 flagship Android phone to compete directly against Apple’s $1,099 iPhone 14 Pro Max, though the smaller $999 iPhone 14 Pro has the same camera hardware.

Google’s Pixel phones haven’t sold well compared with models from Samsung and Apple. But they’ve earned high marks for photography year after year. And if anything is going to win customers over, it’ll be camera technology.


Last year’s Pixel 6 Pro sported a “camera bar” housing three rear cameras — its 50-megapixel main camera, a 0.7x ultrawide angle and a 4x telephoto. The Pixel 7 models’ keeps the same 50-megapixel camera but houses it in a restyled camera bar. On the Pixel 7 Pro, the ultrawide has the same sensor as last year but gets a macro mode, autofocus and a wider 0.5x zoom. The 7 Pro’s telephoto’s zoom magnification extends to 5x, and a new 48-megapixel telephoto sensor enables a 10x zoom mode without using any digital magnification tricks. Both phones get a new front-facing selfie camera.

But the Pixel 7 Pro’s improved hardware foundation is only part of the story. New computational photography technology enabled by new AI algorithms and Google’s new Tensor G2 processor speeds up Night Sight, unblurs faces, stabilizes video better and merges data from multiple cameras to improve image quality for intermediate zoom levels like 3x. That’s more like how a traditional camera behaves.

“What we really tried to do is give you a 12mm-240mm camera,” said Pixel camera hardware leader Alexander Schiffhauer, translating the Pixel 7 Pro’s 0.5x to 10x magnification range into traditional 35mm camera terms. “That’s like the Holy Grail travel lens,” an all-purpose setup that photo enthusiasts have long enjoyed for portability and flexibility.

Here’s a deeper look into what Google is up to.

Virtual 2x and 10x cameras on the Pixel 7 Pro

High-end smartphones now come with at least three rear-facing cameras so you can capture a wider range of shots. Ultrawide angle cameras are good for photographing people crammed into a room and interesting buildings. Telephoto cameras are better for portraits and more distant subjects.

But having a big gap between zoom levels can be a problem. The Pixel 7 Pro’s 50-megapixel main camera and 48-megapixel telephoto cameras offer something of a fix.

Ordinarily, those cameras use a technique called pixel binning to turn a 2×2 grid of pixels into a single larger pixel. That makes 12-megapixel shots with better color and a wider dynamic range of dark and light tones.

But by skipping pixel binning and using only the central 12 megapixels, the 1x main camera can take a 2x shot, and the 5x telephoto can take a 10x shot. The smaller pixels mean image quality isn’t as high, but it’s still useful, and Google applies its Super Res Zoom technology to improve color and sharpness, too. (The 2x mode works on Google’s Pixel 7, too.) 

Apple took the exact same approach with its iPhone 14 Pro phones, but only with the main 1x camera.

The Pixel 7 Pro’s 1x camera can take photos zoomed to 2x with its central pixels, and its 5x camera can take 10x photos. Google; Screenshot by Stephen Shankland/CNET

Where Apple went farther is letting you shoot full 48-megapixel photos with the iPhone 14 Pro’s 1x camera. At 1x, Google always uses pixel binning and thus captures only 12 megapixels.

‘Zoom fusion’ for more photo flexibility

When shooting between 2.5x and 5x zoom, the Pixel 7 Pro blends image data from the wide and telephoto cameras to improve image quality. That improves photos compared with just digitally upscaling a photo from the main camera, Schiffhauer said.

But it’s difficult. The phone has to reconcile the two cameras’ perspectives, which means foreground objects block ones in the background differently. You can see this for yourself by covering first one eye and then the other to see how a scene changes. The two cameras also focus differently because of their different focal lengths.

To avoid discontinuities, Google uses artificial intelligence, also called machine learning, and other processing techniques to figure out which portions of each image to include or reject.

Zoom fusion takes place after other processing methods. Those include HDR+, which merges several frames into one image for better dynamic range, and an AI algorithm that monitors hand shake to take photos when the camera is most stable.

Technology called zoom fusion improves the quality of photos taken between 2.5x and 5x zoom by adding pixels from the 5x camera to the central portion of the image. AI helps align the two views and reconcile differences. Google; Screenshot by Stephen Shankland/CNET

Unfortunately for those who like to shoot raw photos, an image format that offers higher quality and more editing flexibility, zoom fusion isn’t an option there. You’ll get full 12-megapixel raw images only at the Pixel 7 Pro’s fixed zoom levels of 0.5x, 1x, 2x, 5x and 10x.

The Pixel 7 Pro’s new unblurring technology

Google introduced technology in 2021 to marry data from the main and ultrawide cameras to cope with motion blur in faces that can spoil photos. This face unblur technology now kicks in three times more often, said Pixel camera software leader Isaac Reynolds.

Specifically, it’ll work more often in ordinary light, activate more when it’s dim, and function even on faces that aren’t in focus.

For processing photos after the fact, the Google Photos app gets a new tool to unblur shots. It works even with digitized film photos from the bygone age of analog photography.

Eye detection and other autofocus upgrades

The Pixel 7 Pro has several autofocus improvements, starting with the addition of autofocus hardware on the ultrawide camera. For all the cameras, though, Google now uses an AI algorithm to process focusing data from the image sensor.

The camera also will be able to spot eyes, not just faces, for autofocus that works more like that found in high-end cameras from companies like Sony, Nikon and Canon.

New AI technology also can focus better as people move in a scene. “If someone turns their head away from the camera or walks away, we can maintain focus on their head,” Reynolds said.

The Pixel 7 phones also do better when faces are hard to recognize, like with big hats or really large dark sunglasses.

And new AI-based autofocus technology makes it much faster to switch to telephoto shooting. The Pixel 6 Pro often pauses when activating its telephoto camera. 

Better photo upscaling

From 5x to 10x zoom, the Pixel 7 Pro uses the central pixels of the 5x camera to take a 12-megapixel photo.

With digital magnification methods, though, the camera can reach up to 30x zoom, up from 20x in the Pixel 6 Pro. Google developed a method called Super Res Zoom that takes advantage of hand shake to gather more detailed data about the subject and zoom better.

The Pixel 7 Pro has three rear-facing cameras: the main 1x camera with a 50-megapixel sensor, a 0.5x ultrawide camera that now also can take close-up macro photos, and a “periscope” style 5x telephoto camera that reflects light inside the phone body to accommodate the longer optics required. Google; Screenshot by Stephen Shankland/CNET

Google’s digital zoom also can use AI techniques to magnify images. This year, Google trained its AI to predict new pixels better. The phone also calculates a scene attribute called an anisotropic kernel to better predict the subtle changes from one pixel to neighbors to better fill in new data while magnifying.

“Obviously, the quality of 30x isn’t going to be quite what it is at 10x,” Schiffhauer said. “But you still get these really beautiful photos that you can share.”

Faster Night Sight photos

Night Sight, the pioneering and now widely copied technology to take better shots when it’s dim or dark, is now twice as fast. That’s because Google uses image frames it collects from before you tap the shutter release button. (That’s possible because the camera continuously collects imagery, stashing it in memory but only keeping it if you actually take a photo.)

“Users are waiting half as much time to capture a Night Sight photo,” Reynolds said. “They’re getting sharper results, and they’re paying no penalty on noise.”

Google’s Tensor G2 processor doubles Night Sight photo speeds on the Pixel 7 and Pixel 7 Pro, capturing some frames for the photo earlier and reducing noise with more effective AI processing. Google; Screenshot by Stephen Shankland/CNET

For the Pixel line’s astrophotography mode — the extreme version of Night Sight — new AI technology for removing noise speckles now preserves stars better.

Better stabilization and other video improvements

Google also overhauled the Pixel 7 cameras’ video, a weak point compared with iPhones in many reviewers’ eyes. For starters, all Pixel 7 Pro cameras shoot up to 60 frames per second at 4K resolution now, but there’s a lot more:

  • The cameras can shoot in a 10-bit HDR (high dynamic range) mode for better high contrast scenes, like those with bright skies or dark shadows.
  • Google is now on its eighth generation of video stabilization technology. It helps particularly when tracking moving subjects with heavy zoom magnification. 
  • Speech enhancement technology better captures subjects’ voices when you’re shooting with the rear-facing cameras.
  • More serious videographers can lock white balance, exposure and focus — something possible before only with photos.
  • Cinematic blur lets you artificially blur backgrounds in video, a feature previously available only for photos.
  • Copying the iPhone’s approach, time lapse videos are now always 15 to 30 seconds long. Previously, you’d have to calculate the best settings yourself.
  • And with a technology called blur injection, the Pixel 7 Pro can ease the sometimes jittery video that you get when it’s bright out and shutter speeds are extremely fast.

Together, the improvements show Google is fighting hard to maintain its leading smartphone camera technology. “We’re pushing hardware, software and machine learning as far as you can go,” Schiffhauer said.

Correction, 7:52 a.m. Oct. 7: This story incorrectly described the Pixel 7 and 7 Pro phones’ main 50-megapixel camera. The camera is the same as the one used in the Pixel 6 models.

NEWS RELATED

Hati-hati Beli iPhone Ex Inter, Ramai yang Keluhkan Perangkat Mereka Saat Ini No Service

TRIBUNPEKANBARU.COM – Belakangan, sejumlah pengguna iPhone mengeluh ponsel yang mereka gunakan “No Service”, alias tidak dapat terhubung dengan jaringan operator seluler. iPhone yang mendadak hilang sinyal itu adalah iPhone ‘ex-inter’ atau iPhone bekas dari luar negeri yang masuk ke Indonesia. Penyebab iPhone’ex-inter’  itu hilang sinyal diduga karena nomor International Mobile ...

View more: Hati-hati Beli iPhone Ex Inter, Ramai yang Keluhkan Perangkat Mereka Saat Ini No Service

¿Cómo encontrar el baño público más cercano usando tu celular Android o iPhone?

їCГіmo encontrar el baГ±o pГєblico mГЎs cercano usando tu celular Android o iPhone? Encontrar un baño público, sobre todo si te encuentras en lugares que no conoces, puede ser toda una odisea. Por fortuna, existe un método que te permite hallar los sanitarios más cercanos a tu ubicación. Solo ...

View more: ¿Cómo encontrar el baño público más cercano usando tu celular Android o iPhone?

Apple Shares Slip on Report iPhone Production Taking a Big Hit From Unrest at China Factory

Apple could see a production shortfall of almost 6 million iPhones Pro models, Bloomberg reports, citing a source. The slowdown comes amidst restrictive Covid-19 restrictions at Apple’s contract manufacturer Foxconn’s China factory. Last week, delivery dates for the iPhone 14 Pro and Pro Max were 37 days, their highest ...

View more: Apple Shares Slip on Report iPhone Production Taking a Big Hit From Unrest at China Factory

iPhone 14 Pro availability improves despite assembler riots

A Foxconn facility AppleInsider may earn an affiliate commission on purchases made through links on our site. Lead times for the iPhone 14 Pro orders have moderated slightly outside of China, but the ongoing COVID-related labor problems at the main iPhone factory are still a problem. Week 12 of the ...

View more: iPhone 14 Pro availability improves despite assembler riots

China Covid protests could lead to iPhone production hit of up to 10%, Wedbush says

Apple could deal with a major iPhone shortage of up to 10% this holiday season because of Covid protests in China, according to Wedbush's Dan Ives. “We estimate that Apple now has significant iPhone shortages that could take off roughly at least 5% of units in the quarter and potentially ...

View more: China Covid protests could lead to iPhone production hit of up to 10%, Wedbush says

Foxconn protests expected to cut iPhone 14 Pro production by 6 million units

After COVID-19 lockdowns, protests at Foxconn’s largest iPhone factory in China, and a stampede of workers, a report says Apple will produce six million fewer iPhone 14 Pro models than expected. With that, the manufacturer is planning to make up for this loss in 2023. According to Bloomberg, the ...

View more: Foxconn protests expected to cut iPhone 14 Pro production by 6 million units

iPhone 14 Pro Max charges faster via MagSafe than its predecessor

Two months after the iPhone 14 was released, there are a few tidbits we didn’t know about the new iPhones. For example, a test showed the iPhone 14 Pro Max charges faster via MagSafe than its predecessor, the iPhone 13 Pro Max. Here’s what you need to know. The ...

View more: iPhone 14 Pro Max charges faster via MagSafe than its predecessor

20.000 funcionários despedem-se da fábrica onde são produzidos os iPhones

Se está à espera do seu iPhone encomendado, temos más notícias para si. A fábrica da Foxconn, na cidade de Zhengzhou (China), que já tinha sido afectada pelo reaparecimento de novos casos de Covid-19, sofreu um novo revés com as notícias de greves entre os funcionários e os seguranças da ...

View more: 20.000 funcionários despedem-se da fábrica onde são produzidos os iPhones

China-Tumulte könnten iPhone-Produktion schmälern

What Is KaiOS, and Can It Replace iPhone and Android?

Instructions on how to broadcast wifi from iPhone phones simply and effectively

The iPhone 14 Pro will not be available before Christmas

Harga HP iPhone Terbaru di Akhir Bulan November 2022, iPhone 11 hingga iPhone 14 Pro Max

Apple production shortfalls at China plant expected to result in loss of 6 million iPhone Pros

Hmaee、iPhone SE(第2・第3世代)/8/7に対応した「salistyキャッシュレスケース slim」を発売

120+ best Apple Cyber Monday deals for Mac, iPhone, iPad fans

Apple to Lose 6 Million iPhone Pros From Tumult at China Plant

Bij de politierechter: 'Condooms en iPhones'

Kiszivárgott, milyen dizájnnal érkezik a következő iPhone

AndroidからiPhoneに移行する際に「すべきこと」と「できないこと」

OTHER NEWS

Breaking thailand news, thai news, thailand news Verified News Story Network