{"id":24880,"date":"2023-06-01T20:31:59","date_gmt":"2023-06-01T18:31:59","guid":{"rendered":"https:\/\/media-and-learning.eu\/?p=24880"},"modified":"2023-06-02T10:54:49","modified_gmt":"2023-06-02T08:54:49","slug":"what-does-it-mean-to-teach-to-assess-and-to-learn-in-the-age-of-ai","status":"publish","type":"post","link":"https:\/\/media-and-learning.eu\/type\/featured-articles\/what-does-it-mean-to-teach-to-assess-and-to-learn-in-the-age-of-ai\/","title":{"rendered":"What does it mean to teach, to assess and to learn in the age of AI?"},"content":{"rendered":"\n

 by Zac Woolfitt<\/strong>, Inholland University, The Netherlands.<\/p>\n\n\n\n

On 24th May, seven experts from higher education presented during the Media and Learning webinar AI in Higher Education: opportunities and threats<\/a><\/strong>. From Sweden there were speakers from Lund University and Lulea University of Technology, and from the Netherlands, the University of Amsterdam, and Inholland University of Applied Sciences. I was excited to be the moderator of this session and to be part of the discussion.<\/p>\n\n\n\n

Artificial Intelligence is the hottest ticket in town<\/a> since the cat has been let out of the bag<\/a>, and things are developing quickly. It is difficult to grasp exactly what is happening and at what speed. AI is set to continue to develop exponentially over a year, 5 years, 10 years. AI absorbs vast amounts of data to improve itself while smoothing the rough edges by being \u2018trained\u2019 with input from humans. That combination results in a learning curve steeper than anything humans have in their comprehension.<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n

Where would you place us on this curve?<\/em><\/p>\n\n\n\n

Truthfulness is a side effect.<\/strong><\/p>\n\n\n\n

Jelle Zuidema<\/strong><\/strong><\/strong><\/a><\/strong><\/strong>,\u00a0Julia Dawitz<\/a><\/strong><\/strong>\u00a0and Emma Wiersma<\/a><\/strong><\/strong>\u00a0from the University of Amsterdam presented first. As\u00a0associate professor in Natural Language Processing, Explainable AI, and Cognitive Modelling Jelle was perfectly placed to introduce the subject.<\/p>\n\n\n\n

Jelle explained the rapid growth of Large Language Models (LLMs) that lead to ChatGPT as a disruptive technology. We need to have a basic understanding of the technology if we are to estimate what it might lead to. 1) The four key innovations that make it possible: next word prediction and scale, the \u2018transformer architecture,\u2019 in-context learning and Reinforcement Learning from Human Feedback (RLHF<\/a>). 2) Why guaranteeing truthfulness is so difficult and the \u2018hallucination problem\u2019. 3) Why reliable detection of the truth is so difficult. The tools are based on truly gigantic data sets of hundreds of billions of words. The answers are \u2018optimised to be plausible and pleasing.\u2019 By their very nature, the answers appear friendly and reasonable. Detecting falsehood is more difficult when a machine presents falsehood in a way that humans perceive as being truthful.<\/p>\n\n\n\n

Our responsibility to train students and colleagues to use LLMs properly.<\/strong><\/h2>\n\n\n\n

His colleagues Julia and Emma shared some practical examples of how to implement Generative AI in your teaching. They have developed a workshop<\/a>, for lecturers<\/a> on ways of using AI in their classes. They explained LLM applications can be used to aid lecturers to generate new questions, or to check student learning. And students can also use it to improve their learning to generate learning aids such as flash cards. As educational organisations, we are responsible for training students and staff in how to use these models correctly.<\/p>\n\n\n\n

Is AI a blessing in disguise?<\/strong><\/h2>\n\n\n\n

Elin Bommenel<\/strong><\/strong><\/strong><\/strong><\/a><\/strong><\/strong><\/strong> is an associate professor of Service Studies at Lund university and is running a project to prevent cheating at her university. She presented the historical context. For the last four hundred years, faculty have been going about their own business, and management have been trying to \u2018herd cats\u2019. However, after the recent arrival of ChatGPT, the 8,000 faculty suddenly turned to their vice chancellors for guidance. You realise that something is going on. There is no \u2018tacit knowledge\u2019 embedded in the walls of the university so this will require an innovative approach. Elin referred to the cognitive bias of the Dunning-Kruger effect (in which people wrongly overestimate their knowledge or ability in a specific area). And suggested that with LLMs, students are particularly vulnerable to overestimate their understanding of the tools, particularly since answers appear convincing and friendly, and use is so easy.<\/p>\n\n\n\n

Finally, there is the question about how well-equipped higher education teachers are to help grown-ups learn. We have to teach students to \u2018look out for answers that they can\u2019t trust\u2019. The only way to do this is to ensure that students have a university education, to develop the skills, critical thinking and awareness of when something is true or not. We have to develop academic literacy by focusing on 1) academic skills, 2) socialization and 3) developing the epistemological position.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

How should we interpret why students use ChatGPT from a pedagogical perspective? (screenshot from E. Bommenel)<\/em><\/p>\n\n\n\n

It is a student\u2019s lack of understanding of the tools that leads to misuse of the tools as a \u2018substitute for their own effort, e.g. cheating\u2019. There is a greater than ever need to ensure each university has a pedagogical unit that can support faculty and students through this process.<\/p>\n\n\n\n

Becoming better prompt engineers to ask questions about our own organisations<\/strong><\/h2>\n\n\n\n

My colleague Peter Hollants<\/strong><\/strong><\/strong><\/strong><\/strong><\/a><\/strong><\/strong><\/strong><\/strong> from Inholland University presented his personal views<\/a> on what is happening in this \u2018paradigm shift\u2019. He asked how we should manage the possible threats. How will the curriculum change and with it our way of teaching and assessing? How should teachers be facilitated by the school organisation with resources and instructions to use ChatGPT-like tools? And are we AI-ready? He focused on the importance of \u2018prompt engineering\u2019. Learning how to formulate the right questions. There are many different parties involved within each educational organization, and the challenge is how to facilitate the interactions. How will we govern these issues?<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n

How can higher education facilitate multiple stakeholder interactions with AI? (screenshot from P. Hollants)<\/em><\/p>\n\n\n\n

Tools are being developed to give us guidance on these questions ways to develop responsible practice in our interactions with Synthetic Media<\/a>.<\/p>\n\n\n\n

\u2018It takes some time, but AI always outperforms humans\u2019<\/strong><\/h2>\n\n\n\n

Peter Parnes<\/strong><\/strong><\/strong><\/strong><\/a><\/strong><\/strong><\/strong> (parnes.com<\/a>) is a Professor in Pervasive and Mobile Computing at Lule\u00e5 University of Technology. Peter looked to the future, to what might be happening next. ChatGPT broke all internet records, reaching 1 million active users in 4 days. And things have only moved quicker since then. Generative AI has the chance to transform education by personalizing it and creating adaptive learning experiences. At one point we will be able to augment models such as ChatGPT with our own data, or by supplementing them with new data browsed from the internet. There will be \u2018real-time\u2019 interactions with live information being interpreted and applied.<\/p>\n\n\n\n

Another example he presented was \u2018Be my eyes<\/a>\u2019 where AI interprets images into text for people with restricted vision. AI assistants will enhance individual learning through tailored support. And it has the opportunity to revolutionize teaching and learning. He is involved in a project<\/a> with other Swedish Universities developing their own AI technologies.<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n

\u2018It takes some time, but AI always outperforms humans\u2019 (screenshot from P. Parnes)<\/em><\/p>\n\n\n\n

AI is currently not so good at understanding feelings or moods. The future holds improvements in emotional intelligence, personalization, increased memory size and mixing media. Khan academy has integrated ChatGPT into its interactive platform to create a Socratic set of interactions with students.<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n

AI will improve on answering these types of questions (Screenshot from P. Parnes)<\/em><\/p>\n\n\n\n

Peter finished on a positive note by saying that AI can free up the teacher for the deeper discussions which is where the real learning happens.<\/p>\n\n\n\n

More questions than answers<\/strong><\/h2>\n\n\n\n

After the four presentations, there was an active discussion between the seven panelists and the webinar audience. We only touched on some of the ethical and moral issues of bias, access, safety and security. Some of the questions discussed are shown here.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The webinar audience asked more questions than we could answer<\/em><\/p>\n\n\n\n

There are questions about what skills we need to teach and learn in an age of AI. This article<\/a>  explores the \u2018capabilities\u2019 that may be needed. A member of the audience mentioned Bloom<\/a> LLM as a possible alternative for universities.<\/p>\n\n\n\n

Reflection and next steps<\/strong><\/h2>\n\n\n\n

These are exciting, and also worrying, times. There are very real reasons for concern, as addressed here in \u2018The AI Dilemma<\/a>\u2019. The challenge is how we can benefit and control at the same time. The GDPR has had some recent success limiting some aspects of big tech (e.g., Google\u2019s Bard not being available in Europe, or fines to Meta for transferring data to the U.S.). But the speed of change means we need to stay moving quickly.<\/p>\n\n\n\n

What does it mean to be human?<\/strong><\/h2>\n\n\n\n

The rise of AI shines an extra attention on what it is to be human, and our own humanness. A few years ago, I got to experience \u2018being a hologram<\/a>\u2019, and to interact with other life-sized holograms. When I came back to reality and started to talk to real humans, my first reflection was \u2018Wow, now I can see how \u2018human\u2019 humans are\u2019. The UNESCO report on AI and ChatGPT draws attention to this fact too:<\/p>\n\n\n\n

\u2018Our shared humanity has also become a key focal point within higher education, as faculty and leaders continue to wrestle with understanding and meeting the diverse needs of students and to find ways of cultivating institutional communities that support student well-being and belonging. (UNESCO<\/a>)<\/em><\/p>\n\n\n\n

And it may seem counterintuitive, but the more AI that is introduced, the more we need to put humans in control and charge of what is going on:<\/p>\n\n\n\n

Seemingly polar ideas: the supplanting of human activity with powerful new technological capabilities, and the need for more humanity at the center of everything we do. (UNESCO<\/a>)<\/em><\/p>\n\n\n\n

Humans have a biological history rooted in the real world which determines our organic living existence. Working in partnership with AI is the only positive way forward.<\/p>\n\n\n\n

The versatility of human intelligence (HI) compared to AI is related to its biological evolutionary history, adaptability, creativity, the ability of emotional intelligence, and the ability to understand complex abstract concepts. However, HI-AI cooperation can be beneficial if an accurate and reliable output of AI is ensured<\/a>.<\/em><\/p>\n\n\n\n

So what does it mean to teach, to assess and to learn in the age of AI? This is a rhetorical question that I continue to ask my colleagues and students. I don’t have the answers yet but it is going to be a very interesting discussion. The futurist Bryan Alexander will hold a talk later this year at OEB on \u2018Instructors after AI\u2019<\/a> and I wonder where the discussion will be a few months from now.<\/p>\n\n\n\n

Thank you.<\/strong><\/p>\n\n\n\n

Thank you for reading this far. Comments, suggestions or corrections, please contact me at zac.woolfitt@inholland.nl<\/a>. To stay up to date with the ongoing discussions you can join the Media and Learning special interest group on AI<\/a><\/p>\n\n\n\n

\"\"<\/figure>
\n

Author<\/p>\n\n\n\n

Zac Woolfitt<\/a>, <\/strong>lecturer and researcher, Inholland University in the Netherlands<\/p>\n<\/div><\/div>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

 by Zac Woolfitt, Inholland University, The Netherlands. On 24th May, seven experts from higher education presented during the Media and Learning webinar AI in Higher Education: opportunities and threats. From Sweden there were speakers from Lund University and Lulea University of Technology, and from the Netherlands, the University of Amsterdam, and Inholland University of Applied Sciences. […]<\/p>\n","protected":false},"author":4,"featured_media":13237,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mo_disable_npp":"","footnotes":""},"categories":[362,4,275],"tags":[],"class_list":["post-24880","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-featured-articles","category-higher-education"],"featured_image_src":"https:\/\/media-and-learning.eu\/files\/2021\/07\/bigstock-d-Render-Humanoid-Robot-Show-415829398.jpg","author_info":{"display_name":"Dovile Dudenaite","author_link":"https:\/\/media-and-learning.eu\/author\/dovile-dudenaite\/"},"_links":{"self":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/24880","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/comments?post=24880"}],"version-history":[{"count":8,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/24880\/revisions"}],"predecessor-version":[{"id":24958,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/posts\/24880\/revisions\/24958"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media\/13237"}],"wp:attachment":[{"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/media?parent=24880"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/categories?post=24880"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/media-and-learning.eu\/api-json\/wp\/v2\/tags?post=24880"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}