PRESENTERS
Ted Power – Google
Nicholas Jitkoff – Google
Matt Biddulph – Dopplr
Ben Averch – Microvision
Current smartphones are way more than mini computers. They are full of sensors and collect tons of data all the time.
Steve Mann - MIT/UofT is a pioneer in the field
4GB per hour x 24 hrs x 365 - 35TB of video/sound data....
In 10 year 35TB a year will cost approx $3. Collecting and saving all that data will cost basically nothing.
Phone enabled senses come along with a huge list of privacy questions. Important as society and people evolve.
Sound and Voice
Phones are great at holding data but there is a challenge with accessing it. Old school tiny keyboards are not answer
Google is currently working on farming out voice and sound analysis to "the cloud" so they can interpret more and more input
Hard part now is training people on what they can do and try. Humans are not yet accustom to talking to their computers
The machine needs to be constantly learning and adapting to human input
All about making things much more convenient. Just like one-click activation. Voice should work well with eyes closed and total lack of UI. Gestures help as a quick way to access the device
You don't want an interface that gets in front of you when you are using voice. Needs to be smart enough to understand input and just do the right thing.
With an effective voice app you can cut down a complex multi step interaction into a handful of very simple interactions. Voice commands while driving are way better than having to navigate a keyboard and touch interaction
Location Based Interactions....
Current geo apps are making amazing things happen with very minimal data - lat/long
Proximity...
Wiimotes and phones are not that different. Touch and physical feedback are driving haptic interactions across almost every device nowadays.
Haptics have been around forever and there is lots of really good research behind it.
Typing on screen, phone can buzz slightly and give the sense of friction on a frictionless surface.
Pixel addressable surfaces are around the corner for the mainstream
Touch works well as a secondary backup interaction for a traditional UI
Haptic feedback can increase typing accuracy by large amounts
Humans are starting to feed haptic information into their everyday lives. It's a way to augment human senses and giving people more senses. Human are really good at using secondary information. A quick pocket buzz is all you might need. (example of a device that buzzes when user turns to the north - made map and wayfinding skills much better very quickly)
Sensing digital information - eg Oyster Card
Sight
Pico projectors are finding their ways into phones and tiny devices. Lasers can now create displays with novel capabilities
Laser based displays were originally built for military purposes. Now filtering down to consumer products
Augmented reality - overlaying additional digital information over a camera image from a mobile phone camera. Lots of buzz right now
So far no one has come up with a valuable killer app for augmented reality
Currently a bit of a novelty
In the future AR is capable of providing everyone with a totally personalized, metadata enriched experience. Might or might not come from a traditional phone experience. Could be and might need to be built into glasses or some other form factor.
Having AR in glasses (or contact lenses?) is key to allowing constant AR overlay of location based metadata.
The first augmented reality tool may have been the Sony Walkman
Apps like Yelp and Foursquare are another example of augmented reality in that a user can be out and about and easily access metadata about that location (restaurant reviews, etc...). You don't need a crazy funky UI for AR.
Google doing a lot to move services like translate, image recognition, etc. into the cloud and allowing users to access their services through their phone. Take a photo of a menu, send photo to cloud, OCR, translate, send back to user. - Google Goggles.