[Music] a [Music] a [Music] when people talk to each other the majority of the information that's conveyed comes from the way we say things rather than the words we're actually saying eye contact Smiles voice modulation speaking rate pauses and emphasis on certain words often add an extra layer of information in our interactions many of us want to improve these interaction skills but don't have the resources to do so imagine if you could practice your interaction skills with an automated system in the privacy of your own living room a program designed at the MIT media lab
lets you do just that hi I am Mary I'm looking forward to doing your interview my automated conversation coach consists of a 3D character on a computer screen that can see hear and make its own decisions based on its interaction with a person and it works on a personal computer now let's get started using a webcam the system can analyze facial expressions for example it can measure where in the interaction you are smiling and can recognize your head gestures such as a nod or a shake the system also analyzes your voice it not only understands
what you say but how you say it using real-time speech recognition and pro analysis it can capture the non-verbal nuances of conversations and display it in an intuitive format when you're done it gives you a summary of the information when you smiled how fast you spoke and so on and it can show how these measures change over multiple sessions it even allows you to watch the video of your interactions with various measures of your behavior displayed alongside the video such as when you smile how the volume of your voice Rises and falls and what words
you emphasize it even shows when your attention wanders I can't find you there you are you were saying in a study with 90 MIT undergraduates the subjects went through simulated job interviews before and after receiving this training those who got the feedback from this automated system were rated as better candidates for the job than those who did not besides job interviews the researchers say the system could help with with public speaking dating learning languages or helping people who have difficulties in Social [Music] Communications