As reported on The Verge
By Tom Warren
When Microsoft first unveiled its IllumiRoom technology at CES, it did so in an unusual way. The software giant traditionally reveals its research projects in short scrappy videos accompanied by research papers and a lot of technical jargon. IllumiRoom was different. Microsoft’s Chief Technology Strategy Officer, Eric Rudder, joined the Samsung keynote to showcase a video of an augmented reality projection unit designed to extend gaming onto nearby walls. The demo showed off a concept that appeared finely tuned, with what felt like a marketing video.
“ILLUMIROOM ENVISIONS A NEXT-GENERATION GAMING CONSOLE…”
Microsoft described IllumiRoom as a “proof-of-concept system” and promised more information at a CHI 2013 event that starts this week. While the research team behind IllumiRoom will reveal the technical background on the project tomorrow, a fresh preview video (30 seconds long) and a new five minute demonstration (see below) have both provided some additional information. “IllumiRoom envisions a next-generation gaming console with a projector that sits on your coffee table and surrounds your television with projected light,” says the preview video of the technology.
“OH, MY TV GOT BIGGER.”
Microsoft has remained fairly quiet about its next-generation Xbox plans and IllumiRoom.The Verge spoke to Microsoft’s Eric Rudder at TechForum in early March about IllumiRoom. Rudder and the Xbox team were quick to stress it’s simply proof-of-concept, but they did share some basic information on how it works. “The LED is projecting for a frame and then turning it off and Kinect IR is reading those layovers,” said Rudder. “Then the Kinect turns off for a frame and then the projector goes on and then Kinect will go back and forth.” Rudder described the technology as “incredibly sophisticated,” but that the experience is “oh, my TV got bigger, and I can project on anything because the surface doesn’t need to be flat.”
The current prototype uses a Kinect for Windows camera alongside a projector to project content onto walls. Kinect captures the colors and geometry of the room and the projector displays all of the illusions around the TV. Microsoft says its IllumiRoom system is self calibrating and designed to work in any living room. There are a variety of ways that IllumiRoom can extend games, including extending the content, highlighting the edges of games or select game elements like weapon fire or explosions. Another method includes displaying markers for elements in games or other characters for multiplayer gaming.
ILLUMIROOM CAN MAKE OBJECTS APPEAR TO FALL OUT OF YOUR TV
IllumiRoom can also saturate room colors, make them appear black and white, or highlight the edges of a room. A radial wobble feature makes a room feel like it’s responding to a game by popping and moving as a game is played. Grid, starfield, and snow illusions react to the game and display on nearby walls. Microsoft is also working on lighting effects to provide motion from the game and display it within a living room. This augmented reality extends to game objects falling out of the screen and onto a living room floor.
Shortly after Microsoft’s first unveiling of IllumiRoom, we speculated it was connected to the company’s next-generation Xbox and could be similar to Project Natal — the original codename for Kinect. Microsoft originally unveiled Kinect at E3 2009 before shipping the accessory over a year later. Microsoft’s confirmation that IllumiRoom is linked to the company’s next-generation Xbox could mean we’ll see a lot more at the upcoming May 21st event or at E3 in early June.
Update: Microsoft has now released a full video demonstration of IllumiRoom and a PDF research paper. We have updated the article to include the new details