The Channel logo


By | Cade Metz 12th June 2007 04:36

Microsoft demos mind-bending photo app

Puts Google to shame

If you haven't seen the demo, see it now. In March, at the annual Technology, Education, Design (TED) conference in Monterrey, California, Microsoft Live Labs took the wraps off a mind-bending digital photo app called Seadragon, and you can now stream a video of this not-to-be-missed demo from the TED website. Coupled with Photosynth, another project in the works at Live Labs, Seadragon could take Google's much-discussed StreetView idea to a whole new level.

With Seadragon, based on technology Microsoft acquired last year, you can dynamically browse gigabyte after gigabyte of online photos with the flick of a wrist. In the TED demo, Seadragon founder Blaise Aguera y Arcas loads hundreds of high-res pics onto a single display and, in an instant, zooms in for a close-up of any image he chooses. He even rotates this massive collection - yes, the entire collection - as if it were a single photograph.

"It's a technology that streams images and other data types over a narrow and broadband pipes in a very efficient way," says Adam Sheppard, the group product manager at Microsoft’s Live Labs. "At any given time, the only data streaming over the pipe is the data that's necessary for what you're looking at. That way, you an load thumbnails for, say, 1000 images and instantly zoom in on anyone you like."

A one point during his demo, Aguera y Arcas loads every page of Dickens's Bleak House onto his display, then zooms in on a single chapter. And a single paragraph. And a single word.

But the real trick comes when he shows how Seadragon dovetails with Photosynth. Developed in tandem with researchers at the University of Washington, Photosynth grabs multiple photos of given location and stitches them together in three-dimensional space. Several shots of Trafalgar Square become a 3D recreation of Trafalgar Square.

"Photosynth aims to take a collection of photos and transform them into an interactive three-dimensional experience," says Steve Seitz, a University of Washington professor who helped develop the technology. "It allows for virtual tourism, the ability to explore Notre Dame or The Louvre or the Great Wall of China in a very compelling way - remotely."

Combine this with Seadragon, and you've got the power to pan and zoom through a photographic landscape in much the same way you'd navigate a Second Life-style virtual world. Halfway through the TED video, Aguera y Arcas demonstrates with images of Notre Dame.

At the moment, both Seadragon and Photosynth are still in the research stage - only a simple "tech preview" of Photosynth is available to the web at large. But in the very near future, this could lead to a Microsoft Live application that extends Google StreetView to its logical conclusion.

With StreetView, you can view still photographs of real locations as you navigate a graphical map on the Google Maps service. With Seadragon and Photosynth, you could dynamically pan and zoom across such photos in 3D space. Let's say you're browsing Live Local for restaurants in downtown San Francisco. Microsoft's new technologies could give you the power to actually browse the interior of a restaurant before making your choice.

"We're moving towards a platform where the end user community can contribute the photographs," Sheppard says. "In particular, we're all interested in exploring integration with Microsoft Virtual Earth, not only enabling street-side views, but giving users the apply to, in a sense, walk around their own neighborhood." ®

comment icon Read 29 comments on this article alert Send corrections


Frank Jennings

What do you do? Use manual typwriters or live in a Scottish croft? Our man advises
A rusty petrol pump at an abandoned gas station. Pic by Silvia B. Jakiello via shutterstock

Trevor Pott

Among other things, Active Directory needs an overhaul
Baby looks taken aback/shocked/affronted. Photo by Shutterstock

Kat Hall

Plans for 2 million FTTP connections in next four years 'not enough'
Microsoft CEO Satya Nadella


Suit-and-tie-wearing man tries to meditate, take deep breaths in faux yoga pose. Photo by Shutterstock
Emotional intelligence, not tech skills, is the way to woo suits
League of gentlemen poster - Tubbs and Edward at the local shop. Copyright BBC
One reselling man tells his tale of woe