Software decodes emotions over the phone
The innovative program may also diagnose a range of medical conditions
Image: Man on cell phone
Unlike other similar software, Magnify analyzes a phone call in real time, and provides emotional feedback to the user.
View related photos
iStockphoto

Video
Tech Watch
The latest in technology and entertainment news.
  Most popular
• Most viewed • Top rated • Most e-mailed
  Students Kicked Off Campus for Wearing American Flag Tees
Cell phone use cited in crash that killed 11
Who should play Superman, Wonder Woman?
  Dow pulls back after dizzying 30-minute plunge
Lawrence Taylor charged with rape, solicitation
Most viewed on msnbc.com
Plasma rocket may shorten space voyages
Cops: Women stop attacker in campus stabbing
No limits for teen without limbs
Russian forces storm oil tanker, 1 pirate killed
Sea turtles killed in rush to fish?
Most viewed on msnbc.com
  Students Kicked Off Campus for Wearing American Flag Tees
Nearly 100 sick on cruise ship in Norway
Cancer risk from chemicals ‘underestimated’
  Dow pulls back after dizzying 30-minute plunge
  American Flag Clothing Sparks New Protest
Most viewed on msnbc.com
  RSS feeds on msnbc.com

Add these headlines to your news reader
Innovation
Learn more about RSS
By Eric Bland
updated 2:47 p.m. ET May 5, 2010

Less than two minutes into a cell phone conversation, a new computer program can predict a broken heart — literally and figuratively.

An Israeli company called eXaudios has developed a computer program, known as Magnify, that decodes the human voice to identify a person"s emotional state. Some companies in the United States already use the system in their call centers. eXaudios is even testing the software"s use in diagnosing medical conditions like autism, schizophrenia, heart disease and even prostate cancer.

“When agents talk with customers over the phone, they usually focus on content and not intonation, unless the customer is screaming,” said Yoram Levanon, President and CEO of eXaudios, which recently won a $1 million prize at the Demo 2010 conference. “If a customer is screaming, you don"t need the software. But if we can identify the other emotions of a customer, we can save customers and companies money.”
Story continues below ↓advertisement | your ad here

A number of companies sell software that analyzes conversations between a customer service agent and a customer after the conversation is over. Magnify monitors a phone call in real time. The program then lists the caller"s emotions on screen.

When Discovery News” technology correspondent"s voice was decoded using the Magnify software, the output read like a psychologist"s notebook: “Struggling to contain an inner excitement. Keeping emotions and/or creativity in check. Warm and fuzzy.”

In a call center, the Magnify system then suggests various tactics to a customer service representative, depending on the needs of the company.

  Discovery.com
Zombiesat Attack! Solar Storm Fries Satellite"s Brain
Robotic Subs Dive Deep to Cap Oil Leak
Milky Way Fell Together in Chunks
Plasma Rocket May Shorten Space Voyages
Oil Spill in the Gulf of Mexico 2010

If a person is interested in a company"s product or service, the software suggests various ways a customer service agent can pitch it. Magnify can also tell if a person is unlikely to buy and suggest the agent end the conversation before angering the client. The program can even predict when a customer will start yelling up to one minute before it happens, said Magnify"s SVP of Business Operations, Alon Klomek.

It"s taken eXaudios well over a decade to develop Magnify, said Levanon. Magnify works by teasing apart a person voice, separating the frequencies and measuring various qualities of those wavelengths, such as their intonation and intensity.

Magnify is not 100 percent accurate, however. Between 17 percent and 24 percent of the time Magnify fails to identify a caller"s correct emotions.

“We tried to find physical rules that explained why we were wrong,” said Levanon. “What we found was that there was a medical reason we were wrong.”

Certain diseases have an unmistakable impact on a person"s speech. Many autistic patients require speech therapy to communicate effectively. Nearly 90 percent of Parkinson"s disease patients eventually develop some form of soft, mumbled speech.

Yoram Bonneh, an autism researcher at the Weizman Institute of Science in Israel, used the Magnify software in his work with autistic five-year-old children. Out of 80 children — 40 previously diagnosed with autism and 40 non-autistic children — Magnify successfully identified 85 percent of the autistic kids.

These were children with very mild forms of autism, said Bonneh. “They can speak, and when you listen to them you cannot tell a difference (between the autistic and non-autistic children),” said Bonneh. “But when you analyze their voices, you find differences that are significant, which allows us to classify a child as autistic or not.”

In addition to Bonneh"s autism study, eXaudios cites other research in Parkinson"s disease, schizophrenia, heart disease and dyslexia. The company even has anecdotal evidence that they can diagnose prostate cancer by analyzing a person"s voice. According to Levanon, a person with prostate cancer has a “Grand Canyon” of missing tones that is “catastrophic to the voice.”

Click for related content
How multitasking works on a phone
An app that wins friends, influences people
Night vision coming to cell phones, eyeglasses

eXaudios is not the only group that has linked a person"s voice to a medical condition. Cogito Health, a Boston-based company, already uses software originally developed by Alex Pentland of the Massachusetts Institute of Technology to diagnose depression in patients, and more recently, for patient drug compliance and post traumatic stress syndrome.

Analyzing a person"s voice to gain clues about their health and emotional state is nothing new, said Pentland. Humans do it all the time. The computer is just doing a better job at voice analysis than most people because it largely ignores content and focuses on form.

Whether a computer or human is analyzing a conversation, however, “it"s not what you say,” said Pentland. “It"s how you say it.”
© 2010 Discovery Channel

http://www.msnbc.msn.com/id/36968115/ns/technology_and_science-innovation/

질병치료등에도 이용할수 있다고 합니다....