Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee; Man Chen Hung; Chien Huan Lu; Chang Hao Chen; Po Lei Lee; Kuo Kai Shyu

doi:10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee, Man Chen Hung, Chien Huan Lu, Chang Hao Chen, Po Lei Lee, Kuo Kai Shyu

智能系統研究所

研究成果: Conference contribution › 同行評審

4 引文斯高帕斯（Scopus）

摘要

This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

原文	English
主出版物標題	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks
編輯	Arjun Magge, Ari Z. Klein, Antonio Miranda-Escalada, Mohammed Ali Al-garadi, Ilseyar Alimova, Zulfat Miftahutdinov, Eulalia Farre-Maduell, Salvador Lima Lopez, Ivan Flores, Karen O'Connor, Davy Weissenbacher, Elena Tutubalina, Abeed Sarker, Juan M Banda, Martin Krallinger, Graciela Gonzalez-Hernandez
發行者	Association for Computational Linguistics (ACL)
頁面	98-101
頁數	4
ISBN（電子）	9781954085312
DOIs	https://doi.org/10.18653/v1/2021.smm4h-1.18
出版狀態	Published - 2021
事件	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 - Mexico City, 墨西哥持續時間: 10 6月 2021 → …

出版系列

名字	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

Conference

Conference	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021
國家/地區	墨西哥
城市	Mexico City
期間	10/06/21 → …

存取文件

10.18653/v1/2021.smm4h-1.18

其它文件與鏈接

Link to publication in Scopus

引用此

Lee, L. H., Hung, M. C., Lu, C. H., Chen, C. H., Lee, P. L., & Shyu, K. K. (2021). Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 A. Magge, A. Z. Klein, A. Miranda-Escalada, M. A. Al-garadi, I. Alimova, Z. Miftahutdinov, E. Farre-Maduell, S. L. Lopez, I. Flores, K. O'Connor, D. Weissenbacher, E. Tutubalina, A. Sarker, J. M. Banda, M. Krallinger, & G. Gonzalez-Hernandez (編輯), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks (頁 98-101). (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2021.smm4h-1.18

Lee, Lung Hao ; Hung, Man Chen ; Lu, Chien Huan 等. / Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. 編輯 / Arjun Magge ; Ari Z. Klein ; Antonio Miranda-Escalada ; Mohammed Ali Al-garadi ; Ilseyar Alimova ; Zulfat Miftahutdinov ; Eulalia Farre-Maduell ; Salvador Lima Lopez ; Ivan Flores ; Karen O'Connor ; Davy Weissenbacher ; Elena Tutubalina ; Abeed Sarker ; Juan M Banda ; Martin Krallinger ; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. 頁 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

@inproceedings{52860ceade8f45c2b2aafcae34c49e76,

title = "Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers",

abstract = "This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.",

author = "Lee, {Lung Hao} and Hung, {Man Chen} and Lu, {Chien Huan} and Chen, {Chang Hao} and Lee, {Po Lei} and Shyu, {Kuo Kai}",

note = "Publisher Copyright: {\textcopyright} 2021 Association for Computational Linguistics.; 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 ; Conference date: 10-06-2021",

year = "2021",

doi = "10.18653/v1/2021.smm4h-1.18",

language = "English",

series = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

publisher = "Association for Computational Linguistics (ACL)",

pages = "98--101",

editor = "Arjun Magge and Klein, {Ari Z.} and Antonio Miranda-Escalada and Al-garadi, {Mohammed Ali} and Ilseyar Alimova and Zulfat Miftahutdinov and Eulalia Farre-Maduell and Lopez, {Salvador Lima} and Ivan Flores and Karen O'Connor and Davy Weissenbacher and Elena Tutubalina and Abeed Sarker and Banda, {Juan M} and Martin Krallinger and Graciela Gonzalez-Hernandez",

booktitle = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

address = "美國",

}

Lee, LH, Hung, MC, Lu, CH, Chen, CH, Lee, PL & Shyu, KK 2021, Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 A Magge, AZ Klein, A Miranda-Escalada, MA Al-garadi, I Alimova, Z Miftahutdinov, E Farre-Maduell, SL Lopez, I Flores, K O'Connor, D Weissenbacher, E Tutubalina, A Sarker, JM Banda, M Krallinger & G Gonzalez-Hernandez (編輯), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks, Association for Computational Linguistics (ACL), 頁 98-101, 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021, Mexico City, 墨西哥, 10/06/21. https://doi.org/10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. / Lee, Lung Hao; Hung, Man Chen; Lu, Chien Huan 等.
Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. 編輯 / Arjun Magge; Ari Z. Klein; Antonio Miranda-Escalada; Mohammed Ali Al-garadi; Ilseyar Alimova; Zulfat Miftahutdinov; Eulalia Farre-Maduell; Salvador Lima Lopez; Ivan Flores; Karen O'Connor; Davy Weissenbacher; Elena Tutubalina; Abeed Sarker; Juan M Banda; Martin Krallinger; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. p. 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

研究成果: Conference contribution › 同行評審

TY - GEN

T1 - Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

AU - Lee, Lung Hao

AU - Hung, Man Chen

AU - Lu, Chien Huan

AU - Chen, Chang Hao

AU - Lee, Po Lei

AU - Shyu, Kuo Kai

PY - 2021

Y1 - 2021

N2 - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

AB - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

UR - http://www.scopus.com/inward/record.url?scp=85138252374&partnerID=8YFLogxK

U2 - 10.18653/v1/2021.smm4h-1.18

DO - 10.18653/v1/2021.smm4h-1.18

M3 - Conference contribution

AN - SCOPUS:85138252374

T3 - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

SP - 98

EP - 101

BT - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

A2 - Magge, Arjun

A2 - Klein, Ari Z.

A2 - Miranda-Escalada, Antonio

A2 - Al-garadi, Mohammed Ali

A2 - Alimova, Ilseyar

A2 - Miftahutdinov, Zulfat

A2 - Farre-Maduell, Eulalia

A2 - Lopez, Salvador Lima

A2 - Flores, Ivan

A2 - O'Connor, Karen

A2 - Weissenbacher, Davy

A2 - Tutubalina, Elena

A2 - Sarker, Abeed

A2 - Banda, Juan M

A2 - Krallinger, Martin

A2 - Gonzalez-Hernandez, Graciela

PB - Association for Computational Linguistics (ACL)

T2 - 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021

Y2 - 10 June 2021

ER -

Lee LH, Hung MC, Lu CH, Chen CH, Lee PL, Shyu KK. Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 Magge A, Klein AZ, Miranda-Escalada A, Al-garadi MA, Alimova I, Miftahutdinov Z, Farre-Maduell E, Lopez SL, Flores I, O'Connor K, Weissenbacher D, Tutubalina E, Sarker A, Banda JM, Krallinger M, Gonzalez-Hernandez G, 編輯, Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Association for Computational Linguistics (ACL). 2021. p. 98-101. (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). doi: 10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

摘要

出版系列

Conference

存取文件

其它文件與鏈接

指紋

引用此