Openness in artificial intelligence (AI) can be exploited for malicious purposes, according to a study that used a dataset of 200 questions and answers about criminal activities based on Korean precedents. The researchers found that an open-source Large Language Model (LLM), which initially refuses to answer unethical questions, can be manipulated to provide unethical and informative answers about criminal activities. The study highlights the potential risks of unrestricted access to open-source AI technologies, particularly in the legal domain. It also underscores the need for governance frameworks to mitigate potential misuse and the development of datasets to identify or mitigate offensiveness in LLMs.
↧