Google's Robots Are Solving the Biggest Problem in Modern Photography

Google thinks, correctly, that the worst thing about modern photography is the part where you actually have to do something with all the pictures you take. Now, it's doing something for you with a new feature for Google+ Photos called Stories.
Image may contain Face Human Person Electronics Monitor Screen Display Head and Female

20140519-GOOGLE-STORIES-031editGoogle's new Stories automatically transforms bundles of photos into compelling narratives. Ariel Zambelich/WIRED

We have become a society of documenters, holding our phones up at every available moment, shooting at anything that moves, or anything that holds still. But what do we do with all these pictures? Often, the answer is nothing. The things we do share are often just snapshots. One picture. Maybe two. But not experiences. Our lives get lost in the ever-scrolling streams of social media. We are a society of documenters that produces surprisingly little documentary.

Google correctly recognizes that the worst part of modern photography is figuring out what to do with all the pictures we take. And now it’s doing something for you with a new feature for Google+ Photos called Stories.

"There are products that think of photos as files, and there are products that think of photos as photos," explains Google’s Ben Eidelson, a product manager for Google+ Photos. "But what we’re trying to do is think of photos as moments. This is a moment in your life that you want to do something with."

Stories is a new Google+ Photos feature that automates photo album creation. It collects your photos and videos into natural groupings–like a weekend trip you took to the mountains, or a child's soccer game–clustered around out-of-the ordinary moments. Then it builds a narrative for you around those clusters of photos, almost instantly and without any action on your part.

If you have Google+ auto-backup turned on on your iPhone or Android, it does all this automatically. You’ll wake up Monday morning and there’s an album of your pictures from the weekend waiting for you. And if you’ve backed up your photos from your computer to Google Drive, or to Google+ Photos, it will go in and backfill your old pictures too (as well as any new ones you continue to add). It is effortless, and more than a little amazing.

When it dove into mine, it was able to correctly recognize and label trips back to 2003–it sussed out that I was in Luang Praband, Laos in one example, and that I was in Singapore and Malaysia in another. It did all that without my having to give it any location data–I wasn’t using a smartphone at the time and hadn’t even labeled any of the pictures. But Google knew exactly where I was.

That’s because Google is looking at three sources for location. First, it’s just checking geotags embedded in the pictures you take. If you have location turned on for photos in iOS or Android, or are using an SD card that captures where you are, this is really easy. Flickr’s been automatically mapping photos for years based on that. The second is harder. It uses your phone’s Google location history (if you’re feeding that to something like Google Now, for example) and cross-references that with your pictures. And the third method is just banana town.

Often, Google knows what you’re taking pictures of. This is especially true of frequently photographed landmarks, which it can then use to place you on a map. Think of the way Google Image Search works, or how you can search your Google+ photos for bicycle and see every image you’ve taken of a bike–even if you’ve never labeled them. It applies that same technology to Stories to help generate albums.

Plucking photos taken more than a decade ago out of the past and telling you where they were taken is the kind of thing it's hard to imagine anyone other than Google doing. You can either view it as really cool or really creepy or a little bit of both. But I will say that it’s remarkably impressive.

Stories as viewed on a Nexus 7.
Ariel Zambelich/WIRED

In fact, Stories is one more example of why Google Photos is the best photo management software out there for the average smartphone owner. If you take a lot of pictures with an Android or iOS device, and aren’t using Google+ auto backup to organize them, you are missing out.

Google’s basic idea is that photography is far more than just capturing the picture. Yet everything that comes after hitting the button to suck up a moment in time onto a sensor is too hard. If you take a lot of pictures–and almost all of us do these days–sorting through them to find the best ones can be tedious and time consuming. And then there’s the presentation layer. Google thinks it’s been too hard to build anything immersive without putting a lot of work into it. And finally it believes photography is of the moment–you want to be able to share things immediately. Your pictures from this weekend are interesting now in a way they won’t be next month. And so with Google+ Photos, and Stories in particular, it’s trying to do all this for you.

Of course, there is a self-serving intent in all this–because it works best when you really feed the beast. Your Stories will be better when you give Google more data–when you let it know where you are, upload your pictures to it by the thousands, and help it learn who your friends and family are, and what their faces look like. And all that data helps it know you better. The better it knows you, the better it can serve you an ad for something you may actually want to click on and buy.

It’s easy to see how it’s getting a lot of contextual data from photographs just by looking at the albums it can build. One of the albums Google automatically generated for me was from a trip I took to Las Vegas. There’s a cover photo with a title I added, (initially, it was just listed as a trip to Las Vegas in January), which then jumps right into SFO, where we see my colleague Christina Bonnington eating breakfast at SFO. That was the first photo I took that day, and it really was the beginning of a trip. To Google, this is basically the first photo in a cluster, and the logical place to start. It also can tell–because it knows where my phone was at the time–that it was taken at the airport, and that I left on a trip.

There’s a time stamp, and a connective line that prompts me to scroll sideways. The next screen is a map link that animates a dotted red line, showing my flight to Las Vegas. Next up, we’re in the Las Vegas airport, at CES badge pickup, and then inside a car where I had a Garmin product demo. And then we see something pretty interesting–it’s a circular photo of the Encore, along with a place marker–tapping on it takes you to Google Maps, and a link to the Google knowledge card where you can see more information on the hotel. It automatically adds these to Stories, and they do a great job of putting your photos in context. They make you want to explore.

Likewise, the user interface is inviting. It feels alive, especially on tablets. As you scroll sideways, pictures bounce into view. It has an elastic quality to it that responds to the movements of your hands across the screen. If there are videos or animated GIFs–which Google Photos also automatically generates–these get embedded as well, giving the Story an even more animated quality.

winchester

You're not going to want to stick with all the defaults, like this Winchester card for example.
Screenshot: WIRED

There are some definite hiccups. You can really see these in the places it automatically includes. For example, a lot of the events that take place at CES are held at the Mandalay Convention Center, but Google tagged me at the Mandalay Spa. Instead of putting me at the LVH, another CES venue, it has me at the Las Vegas Country Club. It also thought I was at the Wynn Golf Club for some reason, which I never was (as far as I remember), and then there’s the place marker for Winchester. The default image for Winchester, Nevada is, apparently, a bunch of butts. Granted, these seem to be bronze butts, so it's art? But they remain butts nonetheless and I'm not sure many people want butts in their moments. Naturally, you can edit and delete any of the moments Stories drops in automatically, but to me the butts really illustrated the perils of allowing robots full control of your memories.

Still, even with the missteps (which are easily corrected), Stories are exquisite. This is Google doing what it does best: organizing all the world's information in a very literal sense. It's taking your past, putting it together into a narrative, and rescuing it from the tyranny of file folders.