{"id":25523,"date":"2023-06-30T16:38:56","date_gmt":"2023-06-30T14:38:56","guid":{"rendered":"https:\/\/media-and-learning.eu\/?p=25523"},"modified":"2023-06-30T16:38:58","modified_gmt":"2023-06-30T14:38:58","slug":"lessons-learned-from-large-scale-implementations-of-learning-design-and-learning-analytics","status":"publish","type":"post","link":"https:\/\/media-and-learning.eu\/type\/featured-articles\/lessons-learned-from-large-scale-implementations-of-learning-design-and-learning-analytics\/","title":{"rendered":"Lessons learned from large scale implementations of learning design and learning analytics"},"content":{"rendered":"\n<p>by <strong>Bart Rienties<\/strong>, The Open University, UK.<\/p>\n\n\n\n<p>The Open University UK has been designing, implementing, and evaluating how to effectively provide meaningful learning opportunities for hundreds and thousands of learners across the globe. Since 2015 a range of learning analytics studies and practical intervention studies have shown that these learning design decisions made by educators substantially influence what, how and when learners are learning.<\/p>\n\n\n\n<p>However, applying and translating learning design and learning analytics in other institutions, countries and contexts is <a rel=\"noreferrer noopener\" href=\"http:\/\/oro.open.ac.uk\/85521\/\" target=\"_blank\">not a mere copy-paste job<\/a>. In this contribution to the Media &amp; Learning newsletter I will reflect on some of the lessons learned of how you might start to think about implementing learning analytics and learning design in your own context, if you have not already started to do so already.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Open University Learning Design Initiative<\/strong><\/h2>\n\n\n\n<p>Of course the COVID-19 pandemic has <a rel=\"noreferrer noopener\" href=\"http:\/\/oro.open.ac.uk\/81530\/\" target=\"_blank\">accelerated the use of digital technologies<\/a> in education, including how educators design, instruct, assess and use data. One prominent learning design approach that originated from work dating back to 2004 is the Open University Learning Design Initiative (OULDI). <a rel=\"noreferrer noopener\" href=\"http:\/\/oro.open.ac.uk\/45016\/\" target=\"_blank\">OULDI is focused on \u2018what learners do\u2019 <\/a>as part of their learning, rather than on \u2018what educators do\u2019 or on what will be taught. As explained at the Media &amp; Learning Conference 2023, a wealth of studies (for example, <a href=\"http:\/\/oro.open.ac.uk\/48988\/\" target=\"_blank\" rel=\"noreferrer noopener\">Nguyen et al., 2017;<\/a> <a href=\"http:\/\/oro.open.ac.uk\/84219\/\" target=\"_blank\" rel=\"noreferrer noopener\">Rizvi et al., 2022<\/a>) have shown that these learning design decisions fundamentally drive and predict how learners are learning. If you want to have a number, several studies show that around two-thirds of all learning behaviour is influenced directly by how we as educators design our daily\/weekly activities.<\/p>\n\n\n\n<p>This is perhaps a striking number, as I often speak to educators who primarily seem to \u201cblame\u201d learners for not being more successful in the \u201cmarvellous\u201d learning designs they have created. However, if most learners follow more or less exactly the pathways that educators have developed, surely some of the responsibility of some learners dropping out, or some learners being less happy with a particular learning activity perhaps should also be linked back to the educator?<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>How to help educators make better learning design decisions?<\/strong><\/h2>\n\n\n\n<p>One obvious way to help educators making better learning design decisions is to improve the way in which we can illustrate their decisions back to educators. In part this could for example be done by providing learning analytics data of actual learner behaviour back to educators, and help them to reflect on whether or not their learning design <a rel=\"noreferrer noopener\" href=\"https:\/\/jime.open.ac.uk\/articles\/10.5334\/jime.394\" target=\"_blank\">activities match with what learners have actually been doing<\/a>. However, this is often only feasible after a particular learning activity has been designed, implemented, and evaluated by the most important critics of our learning activities, our learners.<\/p>\n\n\n\n<p>Therefore, another potential option could be to provide the initial learning design decisions in a meaningful manner back to educators. This is where the power of visualisations comes into play, in particular learning analytics dashboards. Our free to use <a rel=\"noreferrer noopener\" href=\"https:\/\/learning-design.eu\/en\/index\" target=\"_blank\">Balanced Design Planning<\/a> tool might be useful for educators who want to receive immediate feedback on their initial learning design decisions. The tool provides automatic insight into how educators\u2019 learning outcomes and learning design decisions are aligned, and how to ensure that learning activities are well aligned. Have a look at it yourself if you want to see how it works!<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"941\" height=\"463\" src=\"https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21.png\" alt=\"\" class=\"wp-image-25526\" srcset=\"https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21.png 941w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-300x148.png 300w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-768x378.png 768w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-370x182.png 370w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-270x133.png 270w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-570x280.png 570w, https:\/\/media-and-learning.eu\/files\/2023\/06\/image-21-740x364.png 740w\" sizes=\"auto, (max-width: 941px) 100vw, 941px\" \/><\/figure>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:30% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"681\" src=\"https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-1024x681.jpeg\" alt=\"\" class=\"wp-image-25525 size-full\" srcset=\"https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-1024x681.jpeg 1024w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-300x200.jpeg 300w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-768x511.jpeg 768w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-1536x1022.jpeg 1536w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-2048x1363.jpeg 2048w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-370x246.jpeg 370w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-270x180.jpeg 270w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-570x379.jpeg 570w, https:\/\/media-and-learning.eu\/files\/2023\/06\/Bart-PQZ4-iNQ-1-740x492.jpeg 740w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p class=\"has-large-font-size\">Author<\/p>\n\n\n\n<p><strong>Bart Rienties<\/strong>, The Open University, UK<\/p>\n<\/div><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Acknowledgement<\/h2>\n\n\n\n<p>We are grateful for all the educators, learning designers, and others who have provided input and suggestions to the BDP tool and concept. This study was conducted within the project \u201cInnovating Learning Design in Higher Education (iLED)\u201d, financed from the Erasmus+ Programme of the European Union, within approved by the Erasmus+ programme &#8211; KA2 &#8211; Cooperation partnerships in higher education<\/p>\n\n\n\n<p>References can be downloaded <a href=\"https:\/\/media-and-learning.eu\/files\/2023\/06\/Lessons-learned-from-large-scale-implementations-of-learning-design-and-learning-analytics_references.docx\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>by Bart Rienties, The Open University, UK. The Open University UK has been designing, implementing, and evaluating how to effectively provide meaningful learning opportunities for hundreds and thousands of learners across the globe. Since 2015 a range of learning analytics studies and practical intervention studies have shown that these learning design decisions made by educators [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":25534,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mo_disable_npp":"","footnotes":""},"categories":[270,4,275],"tags":[],"class_list":["post-25523","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-av-technologies","category-featured-articles","category-higher-education"],"featured_image_src":"https:\/\/media-and-learning.eu\/files\/2023\/06\/bigstock-Analyst-Working-With-Computer-471014161.jpg","author_info":{"display_name":"Dovile Dudenaite","author_link":"https:\/\/media-and-learning.eu\/author\/dovile-dudenaite\/"},"_links":{"self":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/25523","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/comments?post=25523"}],"version-history":[{"count":9,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/25523\/revisions"}],"predecessor-version":[{"id":25547,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/25523\/revisions\/25547"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media\/25534"}],"wp:attachment":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media?parent=25523"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/categories?post=25523"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/tags?post=25523"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}