Bioelectric Control
Quicktime Movie of Bioelectric Controls
Click on the size best suited for your bandwidth.
452k
Supporting Documents to quicktime movie of Bioelectric Control
EHS gesture video play by play description
Fri Feb 9 11:35:32 PST 2001
Abstract:
EMG (Electro-Myo Graphic) data will be collected from the muscle movements of the subject's forearm as he makes typing gestures on the the numeric keypad. The data for these same gestures will be recognized as equivalent to typing on the keypad, even when there is no keypad being used.Film Clips:
Subject is typing on the actual 10 key numeric keypad. He has several electrodes placed on his wrist which will be used in the following film clips for passing EMG data to the gesture recognition software.
Subject lifts paper photocopy of keypad and types on paper copy of keypad. The typing gestures are recognized by the pattern recognition software as being equivalent to typing on the actual keypad. The gestures for each number are recognized and the numbers which are entered are displayed on the terminal window.
Subject now types the digits one through nine on his knee, and the gestures are also recognized as being equivalent to typing on the actual keypad. Numbers are displayed on the computer terminal as they are entered by appropriate gestures typed onto the subject's knee. The complex EMG signals are also displayed on the computer screen as dyanamic XY graphs.
The numbers which are typed appear in the terminal window and the nerve signals are displayed on the graphics window. Internal to the computer, the pattern recognition software interprets the complex signals and decodes each gesture, outputting symbolic information representing the keys as they are pressed on the imaginary keypad.
Title screens show historically important dates. First Space Shuttle flight, 1981. First Moon landing, 1969. First powered manned flight, 1903.
Subject is typing on the bare table top with neither keypad nor photocopy of keypad. Subject types in the 3 dates from history which appear in the terminal window. There is also a sofware representation of the 10 key numeric keypad on the computer screen. When the subject makes each gesture for pressing a key, the corresponding key on the graphic representation lights up as the actual number is displayed in the terminal window. This effectively allows meaningful typing and entering of information without any physical keypad or representation of a keypad at all.Neuro Electric Device Control Naration
Our purpose in this research is not to type on a physical keyboard but to use signals from the arm to type on any surface.
As a result we will start with a template of the actual keyboard which is only a photocopy on a piece of paper.
Notice that the data is now being input neuro-electrically. We will now go one step further. Observe that we no longer have those specific keyboard cues and, as the demonstration is showing, are typing the digits one through nine without any cue what so ever.
In the background you see the signals being recorded and on the screen the pattern recognizer is outputting the pattern names.
What we show next are some examples of historically important dates and our capability to do significant data entry.
Here for example are a couple of datrs you just saw and the corresponding use of hand entry without any additional cueing.
At the lower right hand corner of the screen you see the hand moving and on the top of the screen, the data we just looked at being entered.
Thus, in effect, we have removed the physical instrumentality of the keyboard all together.
- end -
text-only version of this release
To receive Ames news releases via e-mail, send an e-mail with the word "subscribe" in the subject line to ames-releases-request@lists.arc.nasa.gov. To unsubscribe, send an e-mail to the same address with "unsubscribe" in the subject line.