{"id":5500,"date":"2024-10-17T13:35:51","date_gmt":"2024-10-17T11:35:51","guid":{"rendered":"https:\/\/dbis.rwth-aachen.de\/dbis\/?p=5500"},"modified":"2024-10-17T13:35:52","modified_gmt":"2024-10-17T11:35:52","slug":"on-the-analysis-and-mitigation-of-hallucination-in-vision-language-models","status":"publish","type":"post","link":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/2024\/on-the-analysis-and-mitigation-of-hallucination-in-vision-language-models\/","title":{"rendered":"On the Analysis and Mitigation of Hallucination in Vision-Language Models"},"content":{"rendered":"\n<p>This research investigates hallucination in vision-language models, focusing on the role of the attention mechanism in contributing to and potentially mitigating hallucinations. The work explores how attention layers influence the integration of visual and textual information and identifies techniques for reducing the generation of inaccurate or irrelevant outputs. A critical research question is understanding how attention mechanisms can be adjusted or improved to decrease hallucination in vision-language models, thus enhancing reliability in applications like image captioning and visual question answering.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This research investigates hallucination in vision-language models, focusing on the role of the attention mechanism in contributing to and potentially mitigating hallucinations. The work explores how attention layers influence the integration of visual and textual information and identifies techniques for reducing the generation of inaccurate or irrelevant outputs. A critical research question is understanding how [&hellip;]<\/p>\n","protected":false},"author":19,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[21],"tags":[],"class_list":["post-5500","post","type-post","status-publish","format-standard","hentry","category-thesis"],"acf":[],"_links":{"self":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/5500","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/comments?post=5500"}],"version-history":[{"count":1,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/5500\/revisions"}],"predecessor-version":[{"id":5502,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/5500\/revisions\/5502"}],"wp:attachment":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/media?parent=5500"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/categories?post=5500"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/tags?post=5500"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}