Home Create Watch Help News Mobile Login

SXSW2009 - Designing for Gestural UI

  • Session starting... talking about initial design for Motorola phones and illiterate users.
    by Andre at 3/14/2009 8:36:10 PM
  • Physical location, functions plus spacial/visual memory are core
    by Andre at 3/14/2009 8:38:16 PM
  • Starts to get tricky when you have limited controls and need them to work in different contexts - eg. ATM with 6 buttons and 20 screens
    by Andre at 3/14/2009 8:39:05 PM
  • In many cases people will learn gestures and set them to memory
    by Andre at 3/14/2009 8:39:46 PM
  • Mobile technology is really pushing gesture based UI and interactions
    by Andre at 3/14/2009 8:41:03 PM
  • Many control schemes are extremely complicated - high function but limited ways to control - eg. Nokia N59 is a mini computer powered by keypad
    by Andre at 3/14/2009 8:41:55 PM
  • Radical simplification is one way to solve the problem but it cuts out a lot of goodness
    by Andre at 3/14/2009 8:42:31 PM
  • There is a desire to naturalize interactions - mimic the physical world
    by Andre at 3/14/2009 8:42:49 PM
  • It's all about sensors and sensor tech - they make gesture based tech possible
    by Andre at 3/14/2009 8:43:12 PM
  • Motion, sense, touch, etc.
    by Andre at 3/14/2009 8:43:19 PM
  • Wii, MS Surface, iPhone are all loaded with tons of sensors and work way beyond the simple button interface
    by Andre at 3/14/2009 8:43:48 PM
  • Language and Affordances
    by Andre at 3/14/2009 8:44:00 PM
  • Language - way we communicate with devices - PC point and click interface. What is the new language we are creating for gestural interfaces?
    by Andre at 3/14/2009 8:45:01 PM
  • Affordances - what are the affordances we are going to create in a gestural world in order to allow us to understand how we interact with something in a non physical world...
    by Andre at 3/14/2009 8:45:53 PM
  • We are used to the affordances of the PC world - we know what happens when we click a pulldown or push a button or checkbox
    by Andre at 3/14/2009 8:46:30 PM
  • Language of the PC - we have point and click mouse and a keyboard. These limited physical inputs as well as standard UI elements allow us to create rich interactions
    by Andre at 3/14/2009 8:47:50 PM
  • How do you translate that into a flick of a finger
    by Andre at 3/14/2009 8:48:12 PM
  • How do devices understand what we want to achieve when using a device
    by Andre at 3/14/2009 8:48:27 PM
  • declarative vs implicit
    by Andre at 3/14/2009 8:48:39 PM
  • Sensors help devices understand how they should react to our behaviours/motions/expectations naturally
    by Andre at 3/14/2009 8:49:21 PM
  • In designing for the traditional PC we have tried to copy fairly directly from the physical world - knobs, buttons, clicks, etc.
    by Andre at 3/14/2009 8:50:12 PM
  • Explicit declaration of how we want a device to behave
    by Andre at 3/14/2009 8:50:53 PM
  • Still using gestural interfaces as a means to control - eg. Wii games
    by Andre at 3/14/2009 8:51:16 PM
  • We are still telling the device what to do... just not using a keyboard
    by Andre at 3/14/2009 8:51:44 PM
  • Is there a way for a device to sense what we are doing and anticipate an action without a human telling it what to do
    by Andre at 3/14/2009 8:52:14 PM
  • By placing yourself in a car and having the car sense that you do not have the seatbelt on, the "device" becomes smarter and augments it's behaviour
    by Andre at 3/14/2009 8:54:42 PM
  • Having devices respond to your actions
    by Andre at 3/14/2009 8:54:59 PM
  • Lots of excitement regarding sensors and possibilities right now.
    by Andre at 3/14/2009 8:57:03 PM
  • The "shake shake" gesture is common place right now. Simple and easy to understand for people right now.
    by Andre at 3/14/2009 8:57:58 PM
  • iPhone developers are utilizing sensors... eg. Urban Spoon
    by Andre at 3/14/2009 8:58:23 PM
  • What is it about the UI that provides the affordance for interactions?
    by AdamSchwabe at 3/14/2009 9:01:21 PM
  • Lots of room to invent new gestures that are comprehendable by "normal people"
    by Andre at 3/14/2009 9:01:36 PM
  • Watching a video by g-speak right now
    by Andre at 3/14/2009 9:02:10 PM
  • Video is similar to "Minority Report" interface
    by Andre at 3/14/2009 9:02:32 PM
  • Showing off Oblong g-speak, Minority Report-like UI
    by AdamSchwabe at 3/14/2009 9:02:34 PM
  • Direct interaction with a room of screens controlled by hand and body movements
    by Andre at 3/14/2009 9:03:07 PM
  • [These kinds of interactions where your whole body is involved look exhausting]
    by AdamSchwabe at 3/14/2009 9:03:30 PM
  • Showing collaborate control of the device - 2 sets of hands on one large screen
    by Andre at 3/14/2009 9:03:33 PM
  • Would be interesting if you could control your TV/PVR/Digital home entertainment system with a system like this...
    by Andre at 3/14/2009 9:04:26 PM
  • No affordances at all in g-speak.
    by AdamSchwabe at 3/14/2009 9:05:36 PM
  • G-speak is a 3d gestural navigation system that allows for collaboration, 3d navigation, and an experience almost as cool as the power glove
    by garrettgonzales via twitter at 3/14/2009 9:05:57 PM
  • I'm fascinated by gestural interfaces but more often than not it looks like a technology in search of a purpose
    by andybudd via twitter at 3/14/2009 9:06:25 PM
  • Gestures in the video are not sustainable on a consumer level - too complicated and overly dramatic at the moment
    by Andre at 3/14/2009 9:06:25 PM
  • Showing Canesta, gesture-based television controls.
    by AdamSchwabe at 3/14/2009 9:07:42 PM
  • [How are these interactions easier than pushing a damn button? Play/pause]
    by AdamSchwabe at 3/14/2009 9:08:14 PM
Who's Blogging
  • AndreAndre
  • AdamSchwabeAdamSchwabe
Translate
Options
Comments

Turn viewer comments off and on.
Turn comments off

Share
Twitter
Tweet this event!
Social Bookmarks
Bookmark and Share
RSS
Subscribe to this live blog via RSS