{"id":3196,"date":"2019-03-17T16:23:45","date_gmt":"2019-03-17T16:23:45","guid":{"rendered":"https:\/\/media-and-learning.eu\/?p=3196"},"modified":"2019-11-22T14:56:26","modified_gmt":"2019-11-22T14:56:26","slug":"enhancing-learning-through-accessible-lecture-recordings","status":"publish","type":"post","link":"https:\/\/media-and-learning.eu\/type\/featured-articles\/enhancing-learning-through-accessible-lecture-recordings\/","title":{"rendered":"Enhancing learning through accessible lecture recordings"},"content":{"rendered":"\n<p>People with a hearing impairment can benefit from captioning of speech and sounds in videos and people with a visual impairment can benefit from audio description of images and actions in videos. Captioning and audio description can also be useful for anyone unable to hear or see a video for environmental reasons (e.g. sound to quiet or too much background noise or vision is obscured). This article discusses how speech recognition captioning with collaborative editing can provide affordable transcription\/captioning of lecture recordings and educational videos and discusses the potential of Artificial Intelligence for audio description and sign language translation.<\/p>\n\n\n\n<p> Many countries have had long standing regulations about captioning or audio description of broadcasted television programs but these don\u2019t normally apply to online video. The UK\u2019s Equality Act 2010 requires universities to make anticipatory reasonable adjustments and so universities should caption all their lecture recordings rather than only caption a lecture recording if requested by a deaf student.Paying captioning companies commercial rates for captioning lecture recordings is not affordable by universities but automatic speech recognition captioning is affordable.<\/p>\n\n\n\n<p>One of the arguments that some of the captioning companies use to persuade customers to use their manual captioning service is to say that speech recognition automatic captioning although much cheaper, produces inaccurate captions. Although background noise and music and poorly positioned microphones can reduce the accuracy of automatic speech recognition, it can be as accurate as human transcribers, especially if students are used to collaboratively correct caption errors.  <\/p>\n\n\n\n<p>Unfortunately\nno lecture capture company\u2019s technology currently enables collaborative\nediting.<\/p>\n\n\n\n<p><a rel=\"noreferrer noopener\" aria-label=\"Synote  (opens in a new tab)\" href=\"http:\/\/synote.com\" target=\"_blank\">Synote <\/a>was developed to enhance learning from lecture recordings through collaborative editing of speech recognition transcription with additional features including synchronised notes, clip playlists and a print friendly audio only version as shown in the following screen captures.<\/p>\n\n\n\n<p>It\nis important for teachers to make a good quality recording and this can be\nachieved by wearing a wireless microphone and adjusting the recording level to\nprovide a good signal to noise ratio. If a teacher uses a fixed lectern\nmicrophone and turns or moves away from the microphone to write on the board or\nwalk around the room then the recorded speech level and signal to noise ratio\nwill decrease. If the lecturer repeats any questions or comments or answers\nfrom the students then the speech of the students does not need to be\ntranscribed. It is also possible to record and transcribe the speech of the\nstudents using a wireless microphone, either handheld or passed around or using\nan app on a mobile phone.<\/p>\n\n\n\n<p>As\nthe quality of the recording worsens then speech recognition may struggle more\nthan human transcribers and a solution to this problem of improving the\naccuracy of speech recognition transcription is to use students to collaboratively\ncorrect errors. Students correcting errors engage more strongly with the\nlecture content to improve their learning and so justifying the awarding of\nacademic credit for correcting errors. Universities and students could choose\nappropriate rewards.<\/p>\n\n\n\n<p>Students correcting errors in their own lectures involves little extra effort while they listen, watch, and read the recording and captions as it is difficult not to notice errors. They also generally know the subject better than a professional captioner as captioning companies do not guarantee to provide a specialist in that subject. Images and slides can be automatically synchronised with the transcript to enable printing out of all of the information from a lecture.<\/p>\n\n\n\n<p>Artificial intelligence machine learning using Deep Neural Networks has proved very powerful for improving the accuracy of speech recognition and recognising images. AI can also be used for enhancing speech recognition through automatic lipreading and can also recognise some sounds on videos for captioning (e.g. Applause, music and laughter). AI can also modify lip patterns and faces on videos to make them easier to lipread.<\/p>\n\n\n\n<p>AI\ncannot however currently provide automatic audio description of videos as this\nrequires reasoning and understanding subtle meanings and context to identify\nwhat visual information is important. For example in a video if a person leaves\nthe room then while it might be possible for the AI system to identify this had\nhappened this might only be important information to provide in an audio\ndescription if it was necessary for the viewer to know that the person leaving\nthe room could not have heard what was being discussed in the room after they had\nleft the room. <\/p>\n\n\n\n<p>AI\ncan also provide automatic sign language translation of the captions using\navatars although the quality of translation for a visual language is not as\ngood as translations between written languages which have vast amounts of data\navailable for training the AI systems.<\/p>\n\n\n\n<p>Mike is one of the keynote speakers at the Media &amp; Learning Conference on Video in High Education and will be speaking on the topic of accessibility on 6 June in Leuven.<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"250\" height=\"300\" src=\"https:\/\/media-and-learning.eu\/files\/2019\/03\/Mike_wald_keynote.jpg\" alt=\"\" class=\"wp-image-3199\"\/><\/figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-large-font-size\">Author<br><\/p>\n\n\n\n<p>Prof. Mike Wald, University of Southampton, UK<\/p>\n\n\n\n<p>Mike&#8217;s <a rel=\"noreferrer noopener\" aria-label=\"background (opens in a new tab)\" href=\"https:\/\/www.ecs.soton.ac.uk\/people\/mw3\" target=\"_blank\">background<\/a><\/p>\n\n\n\n<p class=\"has-small-font-size\">More about Mike&#8217;s <a rel=\"noreferrer noopener\" aria-label=\"research  (opens in a new tab)\" href=\"https:\/\/www.turing.ac.uk\/people\/researchers\/mike-wald\" target=\"_blank\">research <\/a>activities. Mike will give a keynote presentation at the Media &amp; Learning Video in Higher Education Conference on 5-6 June 2019  <\/p>\n\n\n\n<p> <\/p>\n<\/div><\/div>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>People with a hearing impairment can benefit from captioning of speech and sounds in videos and people with a visual impairment can benefit from audio description of images and actions in videos. Captioning and audio description can also be useful for anyone unable to hear or see a video for environmental reasons (e.g. sound to [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":3206,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mo_disable_npp":"","footnotes":""},"categories":[270,4],"tags":[125,124],"class_list":["post-3196","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-av-technologies","category-featured-articles","tag-access","tag-speech-recognition"],"featured_image_src":"https:\/\/media-and-learning.eu\/files\/2019\/03\/bigstock-Head-On-The-Side-With-Speech-R-229686001.jpg","author_info":{"display_name":"Sally Reynolds","author_link":"https:\/\/media-and-learning.eu\/author\/sally-reynolds\/"},"_links":{"self":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/3196","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/comments?post=3196"}],"version-history":[{"count":18,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/3196\/revisions"}],"predecessor-version":[{"id":5092,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/3196\/revisions\/5092"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media\/3206"}],"wp:attachment":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media?parent=3196"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/categories?post=3196"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/tags?post=3196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}