It's been a long day at school. You've got a heavy evening of homework ahead. You switch on your computer to work on an assignment. An animated kid on your computer screen smiles and says, "Hey, it's good to see you again. But you look tired. Are you doing OK?"
You reply that you're feeling pretty wiped out, but you've got a research project to do. You rub your eyes and yawn. "I know the feeling," your computer-kid replies, blinking and sighing. "But don't worry. We'll get through it together in no time."
A computer that senses your feelings might make a useful learning companion.
If a friendly, caring computer like this sounds far-fetched to you, think again.
Computer scientists and engineers are busy trying to design computers that can recognize how you're feeling. The computers would then offer help or just a little friendly company while you work or play.
But it may be years before you'll have a computer that can tell when you're bored and responds by telling you a joke. Or a computer that cheers you on and gives you hints when you're feeling frustrated with a math problem.
Keyboard or mouse
Think about how you interact with your computer now. You can type on a keyboard or click a mouse. Maybe you can also pound on a joypad, press on a touch screen, or even speak into a microphone.
The computer has no idea when you're frustrated with it. It can't tell whether you're bored or entertained. When it comes to how you're feeling, your computer hasn't got a clue.
This severely limits a computer's ability to help you, says Winslow Burleson. He's a student at the Massachusetts Institute of Technology (MIT).
Burleson is one of many computer scientists who predict that computers someday will recognize human emotions and respond to them.
This idea belongs to a field in computer science known as "sensitive computing" or "affective computing." The word "affective" refers to anything related to emotions.
For a computer to sense your feelings, it needs more input than just your stroke on a keyboard or your movement of a mouse. Ideally, an affective computer would hear, see, and even touch its users, says computer scientist Rosalind Picard.
Such a computer needs sensors, such as cameras and microphones. It must then interpret what it senses. What does a smile or frown mean? How does your tone of voice suggest whether you're excited, angry, or bored?
At MIT's Affective Computing Lab, Picard and her students are building several systems that can do some of these things. One is called the Learning Companion. It's a software buddy that can be added to educational programs, such as quizzes and lessons.
The Learning Companion generates an animated character—a kid—on the computer screen. The screen kid helps you out with whatever problem you're working on.
The Learning Companion asks which ring you would like to move in trying to solve a puzzle. The current version may look clunky, but as the Learning Companion becomes more advanced, its appearance will become more sophisticated—and more human.
Character system developed by Ken Perlin, New York University.
"Right now, the character can smile, look at you, wave hello and good-bye," Burleson says. "It can jump up and down in excitement or in a frustrated tantrum."
Burleson predicts that, eventually, this virtual kid will use input from sensors to tell whether you're paying attention. It'll also respond to your changing mood as you work at the computer. It'll know when to step in to help and when to stand by and let you keep working on your own.