References & Citations
Computer Science > Computation and Language
Title: OffLanDat: A Community Based Implicit Offensive Language Dataset Generated by Large Language Model Through Prompt Engineering
(Submitted on 4 Mar 2024 (v1), last revised 28 Mar 2024 (this version, v5))
Abstract: The widespread presence of hateful languages on social media has resulted in adverse effects on societal well-being. As a result, it has become very important to address this issue with high priority. Hate speech or offensive languages exist in both explicit and implicit forms, with the latter being more challenging to detect. Current research in this domain encounters several challenges. Firstly, the existing datasets primarily rely on the collection of texts containing explicit offensive keywords, making it challenging to capture implicitly offensive contents that are devoid of these keywords. Secondly, usual methodologies tend to focus solely on textual analysis, neglecting the valuable insights that community information can provide. In this research paper, we introduce a novel dataset OffLanDat, a community based implicit offensive language dataset generated by ChatGPT containing data for 38 different target groups. Despite limitations in generating offensive texts using ChatGPT due to ethical constraints, we present a prompt-based approach that effectively generates implicit offensive languages. To ensure data quality, we evaluate our data with human. Additionally, we employ a prompt-based Zero-Shot method with ChatGPT and compare the detection results between human annotation and ChatGPT annotation. We utilize existing state-of-the-art models to see how effective they are in detecting such languages. We will make our code and dataset public for other researchers.
Submission history
From: Amit Das [view email][v1] Mon, 4 Mar 2024 20:34:58 GMT (300kb,D)
[v2] Wed, 6 Mar 2024 02:34:05 GMT (300kb,D)
[v3] Thu, 7 Mar 2024 02:18:35 GMT (300kb,D)
[v4] Mon, 25 Mar 2024 23:09:58 GMT (300kb,D)
[v5] Thu, 28 Mar 2024 14:44:48 GMT (300kb,D)
Link back to: arXiv, form interface, contact.