TY - GEN
T1 - NCUEE-NLP at SemEval-2023 Task 7
T2 - 17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023
AU - Chen, Chao Yi
AU - Tien, Kao Yuan
AU - Cheng, Yuan Hao
AU - Lee, Lung Hao
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - This study describes the model design of the NCUEE-NLP system for the SemEval-2023 NLI4CT task that focuses on multi-evidence natural language inference for clinical trial data. We use the LinkBERT transformer in the biomedical domain (denoted as BioLinkBERT) as our main system architecture. First, a set of sentences in clinical trial reports is extracted as evidence for premise-statement inference. This identified evidence is then used to determine the inference relation (i.e., entailment or contradiction). Finally, a soft voting ensemble mechanism is applied to enhance the system performance. For Subtask 1 on textual entailment, our best submission had an F1-score of 0.7091, ranking sixth among all 30 participating teams. For Subtask 2 on evidence retrieval, our best result obtained an F1-score of 0.7940, ranking ninth of 19 submissions.
AB - This study describes the model design of the NCUEE-NLP system for the SemEval-2023 NLI4CT task that focuses on multi-evidence natural language inference for clinical trial data. We use the LinkBERT transformer in the biomedical domain (denoted as BioLinkBERT) as our main system architecture. First, a set of sentences in clinical trial reports is extracted as evidence for premise-statement inference. This identified evidence is then used to determine the inference relation (i.e., entailment or contradiction). Finally, a soft voting ensemble mechanism is applied to enhance the system performance. For Subtask 1 on textual entailment, our best submission had an F1-score of 0.7091, ranking sixth among all 30 participating teams. For Subtask 2 on evidence retrieval, our best result obtained an F1-score of 0.7940, ranking ninth of 19 submissions.
UR - http://www.scopus.com/inward/record.url?scp=85161349819&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85161349819
T3 - 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop
SP - 776
EP - 781
BT - 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop
A2 - Ojha, Atul Kr.
A2 - Dogruoz, A. Seza
A2 - Da San Martino, Giovanni
A2 - Madabushi, Harish Tayyar
A2 - Kumar, Ritesh
A2 - Sartori, Elisa
PB - Association for Computational Linguistics
Y2 - 13 July 2023 through 14 July 2023
ER -