Google Photos AI tricks like Magic Eraser have just been opened up to all Google One subscribers, but now Google says it’s planning to bring them to the next frontier: your videos.
In the latest edition of the company’s Made by Google (opens in new tab) podcast, Senior Product Manager Zachary Senzer talks about how using AI to automatically edit videos, in a similar way to existing tools like Photo Unblur and Magic Eraser, is the next step for Google Photos. And that despite the challenges, there’s “lots of exciting stuff on the way” for those who shoot moving images as much as stills.
While Google isn’t ready to share any specifics yet, Senzer said that while the recent focus has been “on the the photo side, I’m personally really looking forward to doing more with videos”. Through Google Photos and YouTube, he added that Google has seen that “people are capturing and creating way more with videos than ever before” and that “there’s so much potential in the space to truly revolutionize what people can do with their videos”.
Exactly how Google plans to do this isn’t yet clear, but Google did just bring its HDR effect feature (below) to videos – and the likes of Photo Unblur and Magic Eraser give us a good guide. The latter would certainly be an incredible video feature, while automated cuts and convincing video bokeh (in a similar fashion to portrait modes) could both drastically reduce editing times and improve overall polish.
The reason why we haven’t seen those features is the huge amount of processing power required to apply local edits to videos, in comparison to photos. As the podcast host Rachid Finge remarks, “most videos have 30 pictures a second, so it must be at least 30 times harder to do that”. Zachary Senzer agrees that it’s “definitely harder”, but says that there are lots of “exciting’ video-related features en route.
Like Google’s photo-related AI features, it’s likely that these would initially be restricted to Pixel phones that have Google’s Tensor chip. Senzer says that for the Google Pixel 6 and Google Pixel 7 “we worked really closely with our AI researchers at Google to create machine learning models that run well on Tensor”.
Given the far greater demands of video editing, that would likely be the case again for future editing tricks – but the recent spread of Magic Eraser and Photo Unblur to all Google One devices shows that automated video editing in Google Photos could ultimately be available on non-Pixel phones, too.