Microsoft News

Microsoft takes the Lumia 930 to the Cornbury music festival

Microsoft News

China's going after Microsoft, but what for?

Editorials

Analysis of Microsoft's Q4 2014 results

Editorials

Xbox Video and Music are getting 'streamlined' says Nadella

Surface

Video of Microsoft's secret labs offers a look into the world of Surface

Windows Phone News

5.8 million Lumia smartphones sold this last quarter

General News

Microsoft generates $23.38 billion in revenue for FY14 Q4

General News

Microsoft focuses on design to unify separate platforms

Xbox

Dance Central Spotlight makes the moves on the Xbox One September 2

General News

Microsoft to hold one big IT conference in May 2015 as they replace TechEd [Update]

Microsoft News

Microsoft 'betrayed' Finland, says Finnish finance minister of layoffs

Editorials

Putting the Microsoft job cuts into perspective

Microsoft News

Stephen Elop explains how recent job cuts will affect Microsoft's handset division

Microsoft News

Microsoft to cut 18,000 jobs in the next year

Microsoft News

Microsoft layoffs allegedly happening tomorrow, will be largest in company history

How To

Is your Kinect microphone listening to you while gaming?

Microsoft News

Microsoft's Cortana is becoming a seamless research tool for scholars early next year

Developers

Microsoft begins Kinect for Windows v2 shipments, SDK preview released

Microsoft News

Microsoft widens its renewable energy commitment with wind farm deal in Illinois

Microsoft News

'Microsoft needs to change', says CEO Satya Nadella

34

Microsoft Research works on interpreting sign language with Kinect

Xbox One Kinect

Microsoft is taking its Kinect technology to a whole new level. We've already looked at how the company is attempting to integrate its product into retail, but Microsoft Research is also tapping into sign language. Numerous videos have been released showing off how the Kinect Sign Language Translator is able to interpret sign language and translate it.

The technology works both ways (wouldn't be such a good conversation otherwise, right?), but this alone shows just how useful the Xbox Kinect is when not used to keep fit or play video games.

How does the technology work? Sign language is detected, captured and translated to text while speech is rendered as visual signs for the hard hearing to see on-screen. Being mastered in Asia, the technology currently supports 300 Chinese sign language words out of a total of 4,000.

Check out the video below to see an overview on the project and how the technology works:

Explaining the scope of the project, Guobin Wu, Research Program Manager, Microsoft Research Asia, wrote the following in a blog post on MSDN:

"The next milestone was to build a sign language recognition system. The team has published many papers that explain the technical details, but what I want to stress here is the collaborative nature of the project. Every month, we had a team meeting to review the progress and plan our next steps. Experts from a host of disciplines—language modeling, translation, computer vision, speech recognition, 3D modeling, and special education—contributed to the system design."

​This technology can prove useful in many situations and Wu plans to make the technology available outside the lab. According to the program manager, there are more than 20 million people in China who are hard of hearing, who join an estimated 360 million around the world. We look forward to seeing further progress made with the project.

Head on over to the Microsoft Research website for more details and be sure to check out the blog posts over on MSDN (part 1) (part 2). via: The Next Web

8
loading...
0
loading...
64
loading...
0
loading...

Comments

There are 34 comments. Sign in to comment

x I'm tc says:

Like the Red Sox!

Sorry, couldn't resist. But this is really great. How long before they can add ASL and then deaf people can sign cross-culturally -- this seems to be an ideal venue for real-time translation since the output (text) won't interfere with the input (gestures).

abel920 says:

So will it recognize when you're watching porn, and when you're doing it? I mean hey, they are a sign language of their own merit.

CommonBlob says:

Impressive, and dare I say it.. A potential life changing use of tech. Kudos!

adrian1338 says:

Like a keyboard! they could write the text there :)

wpguy says:

I wondered how long before tech would finally start catching up with signed languages. Very awesome.

Wait, what?
That's cool and all, but how about more language support for speech recognition... :/

Different research and development group. Don't worry, they're still working on it too.

sign language is a language its int its name, also i would think sign language would be one of the more useful ones for it can really help people communicate and learn, also help in many ways 

 

Oh god lets halt something very useful for people that if I'm correct never get to communicate with others online without a keyboard so you can have more speech recognition languages..

filipek992 says:

This might soon become a great advantage of Microsoft and XboxOne.

gsquared says:

Look one step further. Incorporate this technology into phones and tablets. The ability to perform this type of translation on the fly is its true potential.

Robert Grant says:

This is very cool. MS do come up with some cool stuff, and I wonder how long it will take for competitors to catch up with all the technical debt in all the different areas MS are exploring.

Great deal says:

I am going to spend the next few hours emailing as many deaf associations in as many countries as i can with a link - spread the word (or sign) this is worth more than all the games in the world!

cubanaso says:

I patiently wait for the day an article comes through titles Microsoft research looking to implement Kinect gestures into windows phone. If Sammy can do it why can't the creative minds that brought us the Kinect do it.

DaiaX says:

I think Microsoft need to shrink the size of kinect. Make it one of the feature on their wearable tech like Microsoft glass(es). I can see this can be very helpful.

John20212 says:

Finally a useful way to use Kinnect other than for gaming. I hope Microsoft makes this mainstream, it would help millions of people.

 

adrian1338 says:

You mean the ones that cant use a keyboard instead?

No... Like the ones who prefer multiple input methods like speech and touch in addition to keyboard and mouse.

gsquared says:

People have already done some amazing things with the original Kinect hardware. There is a guy out there who is a DJ and he controls his laser props during shows with a Kinect.

 

http://www.bing.com/search?q=other%20uses%20for%20kinect&FORM=BB07LB&PC=BB07&QS=n

BKsInBarre says:

I remember years ago when Microsoft purchased the Kinect Technology with the chips inside the original device it could ready sign language. Everything the Kinect does now has been replaced with software.

sym1a1a says:

Just my two cents, but those of you who keep referring to keyboards to me seem to completely miss the point of this advancement, a key board does not allow true interactive communication, it requires that both parties stare at a monitor rather than look at each other, communication is so much more than words, its facial expressions, body language, posture ECT, why do you think video chatting and video conferencing is so useful, its because it adds so much more to the conversation, it allows you to understand context, meaning, express emotion, things that written (typed) words just don't allow, typing restricts emotional context, this technology is truly amazing and I tip my hat to the people and organizations that are making it happen

ladydias says:

Someone who gets it. I know a fair number of people that sign who would love this technology.

Schikitar says:

Well said sir!

Is that Steve Ballmer in the background?

playergoodi says:

Awesome ill deff buy one to support the movement

RayWP7 says:

This is innovation! I've loved following Microsoft Research for a long time and its just neat to see some of it come to fruition.

Bloobed says:

If they can extend this to include all sign languages, then great.

KickAssLumia says:

I think that will be a goal too.

MrGoodSmith says:

Brilliant stuff, and proudly Microsoft

KickAssLumia says:

Bad Ass!! Thank you Microsoft.

wormy6 says:

This might be very ignorant, but they can see, so they can type or write what they want to say instead of sign it, right?  Seems like text to speech and speech to text is much more important than sign language.