Magic Finger: Always-Available Input through Finger Instrumentation — ACM UIST 2012


Touch interaction is typically limited to surfaces and devices that have been instrumented to sense user input We propose to instrument the finger instead and present magic finger a small device worn on the fingertip which supports always available input Magic finger is composed of a micro camera and an optical flow sensor This allows it to sense touch-events and the materials that it touches Such as a desk paper and skin Similar to a traditional touch input device magic finger can detect X/Y finger movements It can also read miniature 2D data matrix codes We’ve predefined a variety of actions which can be mapped to magic finger input with a simple authoring environment To demonstrate how magic finger can be used, we walk you through what a day could be like for a magic finger user Here our user is reading a magazine on his way to work He sees an advertisement of his dream car, he taps a data matrix button to retrieve the URL He then taps the logo of his T-shirt to store the URL for later He comes across another article of an interesting city, he taps the data matrix button to open a map application on his tablet He then pans the map by gesturing the magic finger on the back of the device The magic finger can also be used as an extension of the user’s eyes “Oh man what is up with this traffic?” “Let me check” “Ah it’s just a red light!” In a meeting Today our user has a meeting with his clients He can mute a Skype call by tapping his bag “I’m sorry it’s my tablet” It is now his turn to present his work He taps the data matrix on a slide print out to open the PowerPoint and taps the table to connect the laptop to a projector Finally he makes crossing gesture from the data matrix to the table and the PowerPoint window is moved from the laptop display to the projector He uses pinch gestures to advance the slides Listening to music After the meeting he decides to have a break He picks up a music control sticker before he sits down He can use the sticker to play the music He can also pause the music He uses a fast slider to adjust the volume The LED blinks when the volume is selected Back to work The user prints a set of input stickers as shortcuts to launch his favorite applications Chat with a colleague He can show his pictures to a colleague by tapping on his camera “Hello, how was your weekend trip?” “It was great!” “Do you want to see some pictures?” “Yes!” He can also use his magic finger to share data “Hey are you going on a vacation?” “Actually I am” “Oh wow, I read an article this morning about an interesting place” “Really, I would love to read it too” “Cool I might have that in storage” “Would you like to transfer it?” “Yes definitely!” Data passing is implemented at human readable speeds and in Morse code to allow users to verify the output Future implementations might instead use faster transmission protocols “Alright” “Thank you!” “Yes you’re welcome” “I might have a meeting to go to, let me check my schedule” “Alright I’ve got to go!” “Alright I’ll catch you later!” “Yes catch you later” “Bye” Before our user leaves work he taps the phone to send an SMS message to his wife “On my way home honey”




Comments
  1. Why don't you just use the touch screen on your tablet to pan the map, also why dont you just look up that city on your tablet?

  2. @ektaiig you are correct. i know you were also thought it might be a fake promise. And, i really ddnt expect that this site would send me a cheque of $240 for doing some surveys. i found it here -> bit.ly/R7DLoh?=klcyfg

  3. You've got the touch, you've got the POWEEEEEERRRR!!! Yeah!! *Imagines Hot Rod driving down cliff face.* Very fitting guys.

Leave a Reply

Your email address will not be published. Required fields are marked *