{"id":4952,"date":"2024-04-22T09:44:23","date_gmt":"2024-04-22T07:44:23","guid":{"rendered":"https:\/\/dbis.rwth-aachen.de\/dbis\/?p=4952"},"modified":"2024-04-22T13:10:15","modified_gmt":"2024-04-22T11:10:15","slug":"applicability-of-large-language-models-for-evaluating-digital-exercises-in-higher-education","status":"publish","type":"post","link":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/2024\/applicability-of-large-language-models-for-evaluating-digital-exercises-in-higher-education\/","title":{"rendered":"Applicability of Large Language Models for Evaluating Digital Exercises in Higher Education"},"content":{"rendered":"\n<p>As universities strive to enhance the effectiveness of their lecture exercises, there arises a need for diverse and realistic test user scenarios to evaluate the understandability and usefulness of educational materials. However, in creating such scenarios a number of challenges arise: Real world students can rarely be used for testing, they are likely inexperienced or experienced but have little incentive to refresh their knowledge to test tasks for lectures. In addition, leaking tasks to students can lead to skewed learning results during the actual course. On the other hand, simple unit tests can neglect the importance of a task being understandable to a human and do not offer much insight into task difficulty.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As universities strive to enhance the effectiveness of their lecture exercises, there arises a need for diverse and realistic test user scenarios to evaluate the understandability and usefulness of educational materials. However, in creating such scenarios a number of challenges arise: Real world students can rarely be used for testing, they are likely inexperienced or [&hellip;]<\/p>\n","protected":false},"author":26,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[21],"tags":[46,58,57],"class_list":["post-4952","post","type-post","status-publish","format-standard","hentry","category-thesis","tag-llm","tag-tel","tag-testing"],"acf":[],"_links":{"self":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4952","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/users\/26"}],"replies":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/comments?post=4952"}],"version-history":[{"count":3,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4952\/revisions"}],"predecessor-version":[{"id":4960,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4952\/revisions\/4960"}],"wp:attachment":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/media?parent=4952"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/categories?post=4952"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/tags?post=4952"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}