References & Citations
Computer Science > Computation and Language
Title: CARE: Extracting Experimental Findings From Clinical Literature
(Submitted on 16 Nov 2023 (v1), last revised 24 Apr 2024 (this version, v2))
Abstract: Extracting fine-grained experimental findings from literature can provide dramatic utility for scientific applications. Prior work has developed annotation schemas and datasets for limited aspects of this problem, failing to capture the real-world complexity and nuance required. Focusing on biomedicine, this work presents CARE -- a new IE dataset for the task of extracting clinical findings. We develop a new annotation schema capturing fine-grained findings as n-ary relations between entities and attributes, which unifies phenomena challenging for current IE systems such as discontinuous entity spans, nested relations, variable arity n-ary relations and numeric results in a single schema. We collect extensive annotations for 700 abstracts from two sources: clinical trials and case reports. We also demonstrate the generalizability of our schema to the computer science and materials science domains. We benchmark state-of-the-art IE systems on CARE, showing that even models such as GPT4 struggle. We release our resources to advance research on extracting and aggregating literature findings.
Submission history
From: Aakanksha Naik [view email][v1] Thu, 16 Nov 2023 10:06:19 GMT (303kb,D)
[v2] Wed, 24 Apr 2024 18:15:36 GMT (527kb,D)
Link back to: arXiv, form interface, contact.