{"id":23359,"date":"2023-03-03T16:48:29","date_gmt":"2023-03-03T15:48:29","guid":{"rendered":"https:\/\/media-and-learning.eu\/?p=23359"},"modified":"2023-03-03T16:48:31","modified_gmt":"2023-03-03T15:48:31","slug":"ofcoms-toolkit-for-evaluating-media-literacy-interventions","status":"publish","type":"post","link":"https:\/\/media-and-learning.eu\/type\/featured-articles\/ofcoms-toolkit-for-evaluating-media-literacy-interventions\/","title":{"rendered":"Ofcom&#8217;s Toolkit for Evaluating Media Literacy Interventions"},"content":{"rendered":"\n<p>by <strong>Kate Morris<\/strong>, Ofcom, UK. <\/p>\n\n\n\n<p><strong>What is evaluation, and why should charities and other organisations running projects focused on media literacy, care about it?<\/strong><\/p>\n\n\n\n<p>This question lies at the heart of the<a href=\"https:\/\/www.ofcom.org.uk\/research-and-data\/media-literacy-research\/approach\/evaluate\/toolkit\" target=\"_blank\" rel=\"noreferrer noopener\"> Evaluation Toolkit<\/a>, the latest publication from the <a href=\"https:\/\/www.ofcom.org.uk\/research-and-data\/media-literacy-research\/approach\/evaluate\/toolkit\" target=\"_blank\" rel=\"noreferrer noopener\">Making Sense of Media<\/a> (MSOM) team at the UK\u2019s communications regulator, Ofcom.<\/p>\n\n\n\n<p>The toolkit \u2013 a series of how-to guides for planning and carrying out an evaluation of a media literacy intervention &#8211; is an important element of Ofcom\u2019s programme of work supporting the media literacy sector in the UK to do the work they know best &#8211; helping people lead safer and savvier lives online.<\/p>\n\n\n\n<p>Alongside practical, straightforward tips the guide makes the case for an evaluation process that is baked into a project from the start. It explains that evaluation proves (that an initiative has achieved its desired outcomes) and improves (it provides learnings for an organisation to take on board to deliver their intervention in a better way next time).<\/p>\n\n\n\n<p>Crucially, it details the importance of demonstrating impact &#8211; change at an individual or societal level that can be attributed to a project &#8211; and takes organisations through steps to help them evidence it.<\/p>\n\n\n\n<p>The toolkit also encourages those who have delivered projects to share lessons learned from their evaluations \u2013 for example, whether the plans they put in place to gather data from workshop participants were successful, or whether they needed a rethink. Sharing what worked, and what didn\u2019t, allows the sector to learn faster and be more effective.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-1024x722.png\" alt=\"\" class=\"wp-image-23368\" width=\"460\" height=\"324\" srcset=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-1024x722.png 1024w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-300x212.png 300w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-768x542.png 768w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-1536x1083.png 1536w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-2048x1444.png 2048w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-370x261.png 370w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-270x190.png 270w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-570x402.png 570w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-DOING-740x522.png 740w\" sizes=\"auto, (max-width: 460px) 100vw, 460px\" \/><\/figure>\n<\/div>\n\n\n<p>The toolkit can be downloaded from Ofcom\u2019s website in sections, or as <a href=\"https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0020\/252542\/evaluation-toolkit.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">one file<\/a>. The <a href=\"https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0023\/252545\/overview.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">overview<\/a> makes the case for why impact evaluation matters, and is followed by three documents, named to represent stages in the evaluation process:<\/p>\n\n\n\n<p><a rel=\"noreferrer noopener\" href=\"https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0024\/252546\/preparing.pdf\" target=\"_blank\">Preparing<\/a> (1); <a rel=\"noreferrer noopener\" href=\"https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0019\/252541\/doing.pdf\" target=\"_blank\">Doing<\/a> (2); and <a rel=\"noreferrer noopener\" href=\"https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0025\/252547\/sharing.pdf\" target=\"_blank\">Sharing<\/a> (3).<\/p>\n\n\n\n<p>The preparing section sets out how to write a theory of change and how to create an evaluation framework, the doing section has information about research methods and two supplementary \u201ctop tips\u201d documents with model questions, while the sharing section suggests how organisations could structure an evaluation report. There is a separate evaluation framework template, and a glossary detailing more complex terminology (although key words are also highlighted and defined, with pull-out definition boxes in situ). Two searchable libraries sit alongside the toolkit guidance \u2013 one for media literacy research and one for media literacy initiatives. The libraries will support our networks in their delivery work and ultimately play a part in full mapping of media literacy activity in the UK.<\/p>\n\n\n\n<p>The toolkit, published in February 2023, represents the culmination of several years\u2019 work including the input of expert contributors, Ofcom research into challenges and barriers to evaluation amongst media literacy organisations in the UK, and soundings from a range of stakeholders.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-1024x768.jpg\" alt=\"\" class=\"wp-image-23369\" width=\"439\" height=\"329\" srcset=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-1024x768.jpg 1024w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-300x225.jpg 300w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-768x576.jpg 768w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-1536x1152.jpg 1536w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-2048x1536.jpg 2048w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-370x278.jpg 370w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-270x203.jpg 270w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-570x428.jpg 570w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-740x555.jpg 740w, https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-OVERVIEW-80x60.jpg 80w\" sizes=\"auto, (max-width: 439px) 100vw, 439px\" \/><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\"><strong>Next steps<\/strong><\/h3>\n\n\n\n<p>Ofcom\u2019s work on evaluation in the media literacy sector is by no means complete. Publication is only the beginning. Throughout the Spring and Summer, Ofcom\u2019s Making Sense of Media (MSOM) team will lead a series of themed workshops to drive interest in and adoption of the toolkit with the first one on March 30. For more information about the workshop please contact the MSOM team on the email address below. The toolkit will be refined, and expanded, over time in response to user feedback.<\/p>\n\n\n\n<p>We also know from research we commissioned last year that one of the reasons why evaluation is not used by default by the media literacy sector in the is often down to how they are funded (by trusts, foundations, corporations and government).<\/p>\n\n\n\n<p>We are already considering the next challenge: <strong>getting funders to understand the importance of impact evaluation.<\/strong><\/p>\n\n\n\n<p>We are keen to get feedback from European practitioners and will promote the work through the EPRA MIL Taskforce (EMIL).<\/p>\n\n\n\n<p>For more details about the toolkit, and the associated workshops, contact Kate Morris at <a href=\"mailto:Kate.Morris@ofcom.org.uk\" target=\"_blank\" rel=\"noreferrer noopener\">Kate.Morris@ofcom.org.uk<\/a><\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:20% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"681\" height=\"1024\" src=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-681x1024.jpg\" alt=\"\" class=\"wp-image-23363 size-full\" srcset=\"https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-681x1024.jpg 681w, https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-200x300.jpg 200w, https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-370x556.jpg 370w, https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-270x406.jpg 270w, https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2-570x857.jpg 570w, https:\/\/media-and-learning.eu\/files\/2023\/03\/kate_morris_22-2.jpg 694w\" sizes=\"auto, (max-width: 681px) 100vw, 681px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<h4 class=\"wp-block-heading\">Author<\/h4>\n\n\n\n<p>Kate Morris, Senior Associate, Evaluation, Ofcom, UK<\/p>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>by Kate Morris, Ofcom, UK. What is evaluation, and why should charities and other organisations running projects focused on media literacy, care about it? This question lies at the heart of the Evaluation Toolkit, the latest publication from the Making Sense of Media (MSOM) team at the UK\u2019s communications regulator, Ofcom. The toolkit \u2013 a [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":23362,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mo_disable_npp":"","footnotes":""},"categories":[4,272],"tags":[],"class_list":["post-23359","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-featured-articles","category-media-literacy"],"featured_image_src":"https:\/\/media-and-learning.eu\/files\/2023\/03\/cover-MAIN.png","author_info":{"display_name":"Chlo\u00eb P\u00e9t\u00e9","author_link":"https:\/\/media-and-learning.eu\/author\/chloe-pete\/"},"_links":{"self":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/23359","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/comments?post=23359"}],"version-history":[{"count":12,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/23359\/revisions"}],"predecessor-version":[{"id":23393,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/23359\/revisions\/23393"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media\/23362"}],"wp:attachment":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media?parent=23359"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/categories?post=23359"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/tags?post=23359"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}