Computer reads anyone’s lips in a variety of languages

By admin -
109
781

George Bush Snr may not have been as quotable as his son, but the now-famous soundbite, ‘Read my lips: no new taxes’, probably helped him win the presidency. He knew voters would get the message loud and clear if they used their eyes and ears together to work out what he was saying.


Now, Dr Richard Harvey of the University of East Anglia and colleagues are conceiving computers with similar skills — to read anyone’s lips in a variety of languages.

Camera links They have won a grant from the EPSRC for a three-year project to automate language- independent lip-reading by linking new algorithms to camera systems such as web cams and CCTV.

‘There’s no way we could do African click and whistle languages or Chinese and Japanese,’ admitted Harvey. ‘But we hope to do a selection of European languages and standard modern Arabic.’ These rank highly among the top 20 spoken globally.

There are numerous potential commercial applications for the technology. In-car speech recognition systems start failing as soon as the microphone picks up other sounds, from the stereo or through open windows. A lip-reading camera on the dashboard would help and has already been investigated by Siemens.

A similar camera built into a mobile phone handset could understand speech more accurately and so pre-process the audio to send a cleaner signal.

‘The grant has been awarded under the crime-fighting initiative and the Home Office Scientific Development Branch is giving us a lot of help and expertise,’ said Harvey. ‘Lip-reading from surveillance footage, for example, has been used to solve crimes. In some situations it may not be safe or feasible to place a microphone close enough to hear voices, but a long-range camera might still be able to see faces.’

Harvey and his team have carried out preliminary work and know some of the challenges they face. ‘We have to track the head accurately over a variety of poses then extract numbers, or features, that describe the lips and then learn what features correspond to what text,’ he said.

That is why he has teamed up with Dr Richard Bowden and colleagues at the Centre for Vision, Speech & Signal Processing at Surrey University. ‘One of the deficiencies of our previous system was that we had to track the head by hand,’ said Harvey. ‘Richard Bowden is an expert on tracking people and will work on knowing where the head is in the frame. Then we plan to find the lip region and extract the features.’ This would be a first in the development of computerised lip-reading technology.

Having programmed the computer to recognise lips whichever way the head is tilted and moving, more software will have to watch and recognise their fast and subtle movements. Two approaches, called ‘active shape model’ and ‘grey-scale sieving’, will be combined to track the changes in the shape of the lips.

‘We’re also going to do some work on language identification. It’s not been tackled before,’ said Harvey.

Unpredictable speech
But why go to all this trouble when humans can lip-read, as everybody who has ever held a conversation in a noisy bar or at a party can testify? ‘Almost everyone who claims they are an expert lip-reader actually has terrible performance,’ said Harvey. ‘Even so-called trained lip-readers can’t do speech that is unpredictable, even though it may be syntactically correct.

‘Having said that, there are a few star performers out there who are often used for forensic purposes. The man who did the lip-reading of the silent footage of Hitler was amazing. You needed to have a special background and do it with an enormous amount of care and concentration.’

Another reason is the fall in the number of people who have the skill. ‘The number of trained lip-readers is diminishing,’ said Harvey. ‘The really skilful people are the ones who learned very early on, who had learned to speak a language before they lost their hearing and had not been taught to sign but had been taught lip-reading intensively.’

This set of circumstances will become less common as signing grows in popularity.

It is not realistic to expect Harvey, Bowden and their colleagues to have perfected a system that can monitor the screens at any European airport and understand every passenger’s utterances by the end of the project.

‘We hope to have produced a system that will demonstrate the ability to lip-read in more general situations than we have done so far,’ said Harvey. ‘And we’ll get some definitions of the boundaries of performance.’ Max Glaskin

Websites :
– The Engineer : www.theengineer.co.uk/
– University of East Anglia : www1.uea.ac.uk
– EPSRC : www.epsrc.ac.uk
– HOSDB : www.scienceandresearch.homeoffice.gov.uk
– Surrey University : www.surrey.ac.uk

SHARE
Previous articleDIN
Next articleCalendar of events
admin

RELATED ARTICLESMORE FROM AUTHOR

109 COMMENTS

  2. … [Trackback]

    […] Here you can find 79622 additional Information to that Topic: news1.ahibo.com/2007/02/08/computer-reads-anyones-lips-in-a-variety-of-languages/ […]

  12. … [Trackback]

    […] Information on that Topic: news1.ahibo.com/2007/02/08/computer-reads-anyones-lips-in-a-variety-of-languages/ […]

  13. … [Trackback]

    […] There you will find 55734 more Information to that Topic: news1.ahibo.com/2007/02/08/computer-reads-anyones-lips-in-a-variety-of-languages/ […]

  20. … [Trackback]

    […] Find More on to that Topic: news1.ahibo.com/2007/02/08/computer-reads-anyones-lips-in-a-variety-of-languages/ […]

  25. A lot of thanks for all your efforts on this site. My mother really likes making time for internet research and it is easy to see why. We notice all of the dynamic way you present very helpful guides through this blog and increase contribution from visitors on the issue plus our favorite daughter has been studying a lot of things. Take advantage of the remaining portion of the new year. Your performing a superb job.

  28. This is the suitable weblog for anybody who needs to find out about this topic. You notice a lot its almost hard to argue with you (not that I truly would need匟aHa). You positively put a brand new spin on a topic thats been written about for years. Great stuff, simply great!

  31. I’m often to running a blog and i really appreciate your content. The article has actually peaks my interest. I am going to bookmark your website and keep checking for brand spanking new information.

  32. Youre so cool! I dont suppose Ive learn something like this before. So nice to seek out anyone with some authentic thoughts on this subject. realy thanks for starting this up. this web site is one thing that is needed on the net, someone with a bit of originality. useful job for bringing something new to the web!

  35. Thank you a lot for providing individuals with a very nice chance to check tips from this website. It really is so lovely plus full of a great time for me and my office acquaintances to search your website not less than three times in 7 days to read through the new guides you have got. And definitely, I’m certainly astounded with the eye-popping creative concepts served by you. Some 2 ideas in this article are undeniably the finest we’ve ever had.

  36. After study a couple of of the weblog posts on your website now, and I actually like your method of blogging. I bookmarked it to my bookmark website listing and might be checking back soon. Pls check out my website online as effectively and let me know what you think.

  38. Youre so cool! I dont suppose Ive read anything like this before. So nice to find somebody with some authentic ideas on this subject. realy thanks for starting this up. this website is one thing that is needed on the net, someone with just a little originality. helpful job for bringing something new to the web!

  40. I’m typically to running a blog and i actually recognize your content. The article has actually peaks my interest. I am going to bookmark your web site and preserve checking for brand spanking new information.

  41. I抦 impressed, I need to say. Actually not often do I encounter a blog that抯 each educative and entertaining, and let me let you know, you might have hit the nail on the head. Your idea is excellent; the issue is something that not sufficient individuals are speaking intelligently about. I’m very happy that I stumbled across this in my search for one thing regarding this.

  44. My husband and i have been now delighted that Raymond could do his investigation using the precious recommendations he grabbed while using the site. It’s not at all simplistic just to continually be releasing things which some other people have been selling. Therefore we fully understand we have the writer to give thanks to because of that. The most important illustrations you’ve made, the simple website menu, the friendships your site make it easier to promote – it is most amazing, and it’s really leading our son in addition to our family recognize that the concept is satisfying, which is highly essential. Thanks for all the pieces!

  45. Can I simply say what a aid to find someone who truly is aware of what theyre talking about on the internet. You undoubtedly know methods to deliver a problem to gentle and make it important. Extra individuals must learn this and perceive this facet of the story. I cant consider youre not more standard because you positively have the gift.

  46. An interesting discussion is value comment. I believe that you should write extra on this subject, it might not be a taboo subject however generally persons are not sufficient to talk on such topics. To the next. Cheers

  47. Spot on with this write-up, I truly assume this web site wants way more consideration. I抣l most likely be again to read rather more, thanks for that info.

  48. That is the proper blog for anyone who desires to search out out about this topic. You notice a lot its virtually onerous to argue with you (not that I truly would want匟aHa). You positively put a brand new spin on a subject thats been written about for years. Great stuff, just nice!

  49. Can I just say what a aid to find someone who actually is aware of what theyre talking about on the internet. You positively know easy methods to carry a problem to light and make it important. Extra people must read this and perceive this facet of the story. I cant believe youre not more fashionable because you definitely have the gift.

  50. You made some first rate points there. I seemed on the internet for the problem and located most people will associate with along with your website.

  51. When I originally commented I clicked the -Notify me when new comments are added- checkbox and now each time a remark is added I get 4 emails with the same comment. Is there any means you may take away me from that service? Thanks!

  52. I intended to send you a tiny note so as to thank you yet again considering the magnificent pointers you’ve contributed on this website. It was certainly unbelievably open-handed with people like you to supply unhampered precisely what a few people could have advertised for an e book to help with making some profit for their own end, mostly considering the fact that you might have done it if you desired. The smart ideas as well worked like a good way to recognize that other people have similar desire really like mine to figure out way more with respect to this issue. I’m certain there are thousands of more pleasurable moments up front for people who look over your website.

  54. After research a number of of the weblog posts on your website now, and I actually like your manner of blogging. I bookmarked it to my bookmark web site listing and can be checking back soon. Pls check out my website online as effectively and let me know what you think.

  55. The subsequent time I read a weblog, I hope that it doesnt disappoint me as a lot as this one. I mean, I do know it was my option to learn, but I actually thought youd have something attention-grabbing to say. All I hear is a bunch of whining about something that you would fix when you werent too busy on the lookout for attention.

  56. Once I originally commented I clicked the -Notify me when new feedback are added- checkbox and now every time a comment is added I get 4 emails with the same comment. Is there any manner you can remove me from that service? Thanks!

  57. Oh my goodness! an incredible article dude. Thanks Nonetheless I am experiencing challenge with ur rss . Don抰 know why Unable to subscribe to it. Is there anybody getting an identical rss downside? Anybody who knows kindly respond. Thnkx

  58. After study just a few of the weblog posts in your web site now, and I truly like your approach of blogging. I bookmarked it to my bookmark web site record and will likely be checking back soon. Pls take a look at my site as properly and let me know what you think.

  60. Oh my goodness! an incredible article dude. Thank you However I am experiencing problem with ur rss . Don抰 know why Unable to subscribe to it. Is there anyone getting similar rss downside? Anyone who knows kindly respond. Thnkx

  61. I actually wanted to write a small note in order to appreciate you for some of the lovely points you are placing at this website. My extended internet look up has at the end of the day been recognized with pleasant know-how to share with my friends and family. I ‘d point out that many of us site visitors actually are very endowed to exist in a remarkable network with many brilliant people with valuable suggestions. I feel extremely blessed to have come across your site and look forward to plenty of more fun times reading here. Thank you once more for a lot of things.

  62. This website is known as a stroll-by way of for all the information you wanted about this and didn抰 know who to ask. Glimpse right here, and you抣l definitely uncover it.

  63. Good post. I be taught something tougher on totally different blogs everyday. It’s going to at all times be stimulating to learn content from different writers and observe a little bit something from their store. I抎 desire to use some with the content material on my weblog whether or not you don抰 mind. Natually I抣l give you a link on your internet blog. Thanks for sharing.

  65. After I originally commented I clicked the -Notify me when new feedback are added- checkbox and now every time a remark is added I get 4 emails with the same comment. Is there any method you may take away me from that service? Thanks!

  66. I found your weblog web site on google and check a couple of of your early posts. Continue to keep up the very good operate. I simply extra up your RSS feed to my MSN Information Reader. Looking for ahead to studying more from you later on!?

  67. After I initially commented I clicked the -Notify me when new feedback are added- checkbox and now each time a remark is added I get 4 emails with the identical comment. Is there any approach you can take away me from that service? Thanks!

  68. Can I simply say what a relief to seek out someone who really is aware of what theyre speaking about on the internet. You undoubtedly know learn how to carry a difficulty to gentle and make it important. Extra people have to learn this and perceive this side of the story. I cant consider youre no more widespread since you definitely have the gift.

  69. Thanks so much for giving everyone an extremely nice chance to discover important secrets from here. It’s always so lovely and as well , jam-packed with fun for me personally and my office colleagues to search your web site nearly thrice weekly to read through the new guidance you have got. And of course, I’m at all times motivated considering the astounding secrets served by you. Certain 1 points on this page are really the finest we’ve had.

  70. There are some fascinating cut-off dates on this article but I don抰 know if I see all of them heart to heart. There’s some validity however I’ll take maintain opinion until I look into it further. Good article , thanks and we wish more! Added to FeedBurner as effectively

  72. Aw, this was a very nice post. In idea I want to put in writing like this additionally ?taking time and precise effort to make a very good article?however what can I say?I procrastinate alot and on no account seem to get one thing done.

  74. Youre so cool! I dont suppose Ive learn anything like this before. So good to find anyone with some original ideas on this subject. realy thank you for beginning this up. this website is one thing that is needed on the net, somebody with a bit of originality. useful job for bringing something new to the web!

  76. Spot on with this write-up, I really suppose this website needs rather more consideration. I抣l in all probability be again to read way more, thanks for that info.

  78. A powerful share, I just given this onto a colleague who was doing slightly analysis on this. And he the truth is bought me breakfast because I found it for him.. smile. So let me reword that: Thnx for the deal with! But yeah Thnkx for spending the time to debate this, I really feel strongly about it and love studying more on this topic. If potential, as you develop into experience, would you thoughts updating your blog with extra particulars? It’s extremely helpful for me. Huge thumb up for this blog submit!

  79. There are some attention-grabbing points in time in this article but I don抰 know if I see all of them middle to heart. There is some validity but I’ll take maintain opinion until I look into it further. Good article , thanks and we want extra! Added to FeedBurner as well

  81. Can I simply say what a reduction to find somebody who truly knows what theyre talking about on the internet. You definitely know tips on how to bring an issue to mild and make it important. Extra individuals have to read this and perceive this facet of the story. I cant believe youre not more popular since you definitely have the gift.

  83. This is the right blog for anybody who desires to seek out out about this topic. You understand so much its nearly exhausting to argue with you (not that I really would need匟aHa). You positively put a new spin on a subject thats been written about for years. Nice stuff, simply nice!

  86. I really wanted to construct a message to say thanks to you for the stunning ways you are posting at this site. My time consuming internet search has at the end been recognized with awesome facts and strategies to share with my great friends. I would admit that many of us site visitors are very much lucky to live in a fine site with so many marvellous people with helpful ideas. I feel extremely lucky to have discovered the website and look forward to tons of more thrilling times reading here. Thanks once again for all the details.

  92. I actually wanted to construct a simple word in order to say thanks to you for the great tactics you are showing here. My particularly long internet lookup has finally been honored with reasonable details to go over with my contacts. I would suppose that we site visitors are undoubtedly endowed to dwell in a remarkable site with very many wonderful professionals with useful secrets. I feel somewhat privileged to have encountered your entire webpage and look forward to plenty of more fun times reading here. Thanks a lot once more for all the details.

  93. I must show my thanks to this writer for rescuing me from this particular dilemma. As a result of checking throughout the search engines and finding techniques which are not productive, I figured my entire life was over. Existing without the presence of answers to the issues you have solved all through this website is a serious case, and the ones which could have adversely affected my career if I had not noticed the blog. Your primary competence and kindness in handling the whole thing was excellent. I’m not sure what I would have done if I hadn’t encountered such a point like this. I can at this time relish my future. Thank you so much for the reliable and sensible help. I will not hesitate to suggest the sites to any individual who would need recommendations on this subject.

  94. I as well as my friends happened to be analyzing the good thoughts found on the website then unexpectedly got a horrible feeling I never thanked the blog owner for those secrets. All the women ended up certainly excited to read through them and already have truly been making the most of them. Many thanks for being really accommodating as well as for going for this kind of notable topics millions of individuals are really needing to be informed on. Our sincere regret for not saying thanks to sooner.

  95. Thank you a lot for providing individuals with a very breathtaking opportunity to check tips from this website. It can be very good plus stuffed with a great time for me and my office peers to visit the blog minimum thrice in one week to find out the fresh guidance you have. Of course, I’m at all times astounded with your beautiful things you serve. Selected 2 areas in this posting are undoubtedly the most impressive we have all had.

  96. I and also my guys happened to be following the good solutions on your site and so quickly came up with a terrible suspicion I had not thanked the website owner for those secrets. Those men appeared to be certainly very interested to learn them and have now undoubtedly been using those things. I appreciate you for actually being really considerate and then for going for this sort of superior issues millions of individuals are really desperate to learn about. My honest regret for not saying thanks to you sooner.

  97. I simply wanted to construct a brief remark to be able to thank you for these stunning tips and hints you are posting on this site. My time-consuming internet investigation has at the end of the day been honored with wonderful facts to talk about with my neighbours. I ‘d express that many of us website visitors actually are definitely fortunate to live in a fantastic place with so many special people with interesting tactics. I feel quite blessed to have discovered the web pages and look forward to really more exciting minutes reading here. Thanks a lot once again for a lot of things.

  98. I have to show some thanks to this writer just for bailing me out of such a challenge. After searching throughout the the web and meeting tricks that were not powerful, I was thinking my life was over. Being alive without the presence of answers to the problems you’ve sorted out as a result of your report is a crucial case, as well as those which could have in a wrong way damaged my entire career if I hadn’t discovered your website. Your skills and kindness in touching all the pieces was priceless. I don’t know what I would’ve done if I hadn’t discovered such a solution like this. I can now look forward to my future. Thanks very much for your impressive and effective help. I will not think twice to refer the website to any person who should receive recommendations about this issue.

  99. I just wanted to write a simple message in order to appreciate you for those awesome guidelines you are placing on this website. My considerable internet look up has at the end been recognized with good facts and strategies to go over with my contacts. I would suppose that we website visitors actually are very blessed to live in a good network with so many special people with interesting things. I feel rather grateful to have encountered the website and look forward to plenty of more awesome minutes reading here. Thank you again for everything.

  100. I have to express my thanks to you for bailing me out of this type of condition. Just after surfing through the world-wide-web and coming across ways that were not beneficial, I figured my entire life was over. Existing minus the approaches to the difficulties you have resolved all through your good guide is a serious case, as well as those which could have adversely damaged my career if I hadn’t encountered your web page. Your competence and kindness in taking care of a lot of things was important. I don’t know what I would have done if I had not discovered such a subject like this. I am able to at this point look forward to my future. Thank you so much for the reliable and effective help. I won’t be reluctant to propose your site to any individual who should have tips on this issue.

  101. I precisely wished to say thanks once more. I’m not certain the things that I would have implemented without the thoughts shown by you on such theme. It was before the distressing condition in my opinion, but viewing a new skilled mode you processed that forced me to cry over fulfillment. Extremely thankful for the advice and as well , hope you know what an amazing job your are undertaking teaching the rest through your web site. Probably you have never encountered all of us.

  102. Thank you for your entire efforts on this site. My mum takes pleasure in engaging in investigation and it is easy to see why. My partner and i notice all about the lively form you convey informative guidance via this website and therefore cause response from people on that subject matter and our simple princess has always been being taught a whole lot. Take advantage of the rest of the year. You have been performing a superb job.

  103. I want to show my thanks to you just for bailing me out of this particular condition. Just after looking out throughout the search engines and finding strategies which were not powerful, I was thinking my entire life was well over. Being alive without the presence of solutions to the difficulties you’ve sorted out by way of your entire article is a crucial case, and those that would have badly damaged my career if I hadn’t noticed your website. Your personal ability and kindness in taking care of everything was invaluable. I’m not sure what I would have done if I had not come upon such a point like this. It’s possible to now look ahead to my future. Thanks very much for your professional and effective help. I will not think twice to propose the sites to any person who should receive assistance about this issue.

  104. Thanks a lot for providing individuals with remarkably terrific possiblity to read critical reviews from this site. It’s usually so terrific plus stuffed with a great time for me and my office colleagues to visit the blog more than 3 times every week to read the fresh stuff you have. And lastly, I am certainly amazed considering the powerful pointers served by you. Certain 2 facts in this posting are easily the most beneficial we have had.

  105. I needed to write you this little word so as to give thanks yet again relating to the gorgeous principles you’ve contributed on this page. It was simply pretty open-handed of people like you to grant freely what exactly a lot of folks could possibly have offered for an electronic book to help with making some profit on their own, certainly now that you could have done it in the event you wanted. Those ideas in addition acted to become easy way to know that other people have similar desire really like my own to know the truth way more in terms of this problem. I’m certain there are thousands of more enjoyable sessions up front for folks who see your blog.

  106. I simply desired to thank you very much once again. I am not sure the things I would have undertaken without the actual ideas discussed by you on such problem. Previously it was the difficult difficulty in my position, but taking a look at a new well-written tactic you resolved it forced me to jump for gladness. I’m just happier for your service as well as wish you realize what an amazing job you are always getting into educating people by way of your blog. I am sure you have never met all of us.

  107. I definitely wanted to post a brief note to express gratitude to you for all the unique secrets you are showing at this website. My prolonged internet lookup has now been compensated with beneficial points to go over with my colleagues. I ‘d declare that many of us visitors actually are unquestionably fortunate to dwell in a good network with so many perfect people with insightful guidelines. I feel truly fortunate to have discovered your entire webpages and look forward to tons of more awesome minutes reading here. Thanks once more for everything.

  108. I not to mention my pals happened to be following the good tips and tricks located on the website and all of the sudden I had a horrible feeling I had not expressed respect to the web site owner for those strategies. The people were definitely consequently passionate to see all of them and have now surely been using these things. I appreciate you for simply being quite helpful as well as for choosing certain high-quality subject matter most people are really wanting to know about. My honest apologies for not saying thanks to sooner.

LEAVE A REPLY