{"id":4514,"date":"2023-11-20T17:46:23","date_gmt":"2023-11-20T16:46:23","guid":{"rendered":"https:\/\/dbis.rwth-aachen.de\/dbis\/?p=4514"},"modified":"2025-04-03T08:58:18","modified_gmt":"2025-04-03T06:58:18","slug":"an-empirical-study-of-open-source-large-language-models-osllms","status":"publish","type":"post","link":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/2023\/an-empirical-study-of-open-source-large-language-models-osllms\/","title":{"rendered":"An Empirical Study of Open Source Large Language Models (OSLLMs)"},"content":{"rendered":"\n<p>Open Source Software (OSS) revolutionised the computing world about three decades ago. One of the principles of OSS guarantees software developers, companies, researchers, and students the freedom to change and improve the software. Characterised by active community involvement (bazaar-style software development), OSS development has produced category-killer Operating Systems (e.g., Debian, Ubuntu) and applications (e.g., the Apache HTTP Server, Firefox).&nbsp;<\/p>\n\n\n\n<p>The computer science community is now riding another revolution called the Large Language Models (LLMs) revolution. Various variants of LLMs (Commercial and Open Source) come with billions of parameters that developers can fine-tune to control how the system generates text (tokens). Commercial LLMs (e.g., ChatGPT) come with a copyright and are expensive to deploy and use. They have also been criticised for their hallucination, lack of transparency, and the potential for monopolisation by big corporations.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"513\" src=\"https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology-1024x513.png\" alt=\"\" class=\"wp-image-4930\" srcset=\"https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology-1024x513.png 1024w, https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology-300x150.png 300w, https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology-768x385.png 768w, https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology-1536x769.png 1536w, https:\/\/dbis.rwth-aachen.de\/dbis\/wp-content\/uploads\/2024\/04\/methodology.png 1885w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Research methodology<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Open Source Software (OSS) revolutionised the computing world about three decades ago. One of the principles of OSS guarantees software developers, companies, researchers, and students the freedom to change and improve the software. Characterised by active community involvement (bazaar-style software development), OSS development has produced category-killer Operating Systems (e.g., Debian, Ubuntu) and applications (e.g., the [&hellip;]<\/p>\n","protected":false},"author":19,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[21],"tags":[],"class_list":["post-4514","post","type-post","status-publish","format-standard","hentry","category-thesis"],"acf":[],"_links":{"self":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4514","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/comments?post=4514"}],"version-history":[{"count":21,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4514\/revisions"}],"predecessor-version":[{"id":6054,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/posts\/4514\/revisions\/6054"}],"wp:attachment":[{"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/media?parent=4514"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/categories?post=4514"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dbis.rwth-aachen.de\/dbis\/index.php\/wp-json\/wp\/v2\/tags?post=4514"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}