Event Causality Identification - Shared Task 3, CASE 2023

Fiona Anting Tan; Hansi Hettiarachchi; Ali Hürriyetoğlu; Nelleke Oostdijk; Onur Uca; Surendrabikram Thapa; Farhana Ferdousi Liza

doi:10.26615/978-954-452-089-2_019

Event Causality Identification - Shared Task 3, CASE 2023

Fiona Anting Tan, Hansi Hettiarachchi, Ali Hürriyetoğlu, Nelleke Oostdijk, Onur Uca, Surendrabikram Thapa, Farhana Ferdousi Liza

School of Computing Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

The Event Causality Identification Shared Task of CASE 2023 is the second iteration of a shared task centered around the Causal News Corpus. Two subtasks were involved: In Subtask 1, participants were challenged to predict if a sentence contains a causal relation or not. In Subtask 2, participants were challenged to identify the Cause, Effect, and Signal spans given an input causal sentence. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper includes an overview of the work of the ten teams that submitted their results to our competition and the six system description papers that were received. The highest F1 scores achieved for Subtask 1 and 2 were 84.66% and 72.79%, respectively.

Original language	English
Title of host publication	CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023
Editors	Ali Hurriyetoglu, Hristo Tanev, Vanni Zavarella, Reyyan Yeniterzi, Erdem Yoruk, Milena Slavcheva
Publisher	Incoma Ltd
Pages	144-150
Number of pages	7
Volume	1
ISBN (Electronic)	9789544520892
DOIs	https://doi.org/10.26615/978-954-452-089-2_019
Publication status	Published - 2023
Event	6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2023 - Varna, Bulgaria Duration: 7 Sep 2023 → …

Conference

Conference	6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2023
Country/Territory	Bulgaria
City	Varna
Period	7/09/23 → …

Keywords

Causal event classification
Causal News Corpus
Cause-Effect-Signal span detection

Access to Document

10.26615/978-954-452-089-2_019

Cite this

Tan, F. A., Hettiarachchi, H., Hürriyetoğlu, A., Oostdijk, N., Uca, O., Thapa, S., & Liza, F. F. (2023). Event Causality Identification - Shared Task 3, CASE 2023. In A. Hurriyetoglu, H. Tanev, V. Zavarella, R. Yeniterzi, E. Yoruk, & M. Slavcheva (Eds.), CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023 (Vol. 1, pp. 144-150). Incoma Ltd. https://doi.org/10.26615/978-954-452-089-2_019

Tan, Fiona Anting ; Hettiarachchi, Hansi ; Hürriyetoğlu, Ali et al. / Event Causality Identification - Shared Task 3, CASE 2023. CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023. editor / Ali Hurriyetoglu ; Hristo Tanev ; Vanni Zavarella ; Reyyan Yeniterzi ; Erdem Yoruk ; Milena Slavcheva. Vol. 1 Incoma Ltd, 2023. pp. 144-150

@inproceedings{1ad0dac9fe224f31bb65c8af9b7b1a39,

title = "Event Causality Identification - Shared Task 3, CASE 2023",

abstract = "The Event Causality Identification Shared Task of CASE 2023 is the second iteration of a shared task centered around the Causal News Corpus. Two subtasks were involved: In Subtask 1, participants were challenged to predict if a sentence contains a causal relation or not. In Subtask 2, participants were challenged to identify the Cause, Effect, and Signal spans given an input causal sentence. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper includes an overview of the work of the ten teams that submitted their results to our competition and the six system description papers that were received. The highest F1 scores achieved for Subtask 1 and 2 were 84.66% and 72.79%, respectively.",

keywords = "Causal event classification, Causal News Corpus, Cause-Effect-Signal span detection",

author = "Tan, {Fiona Anting} and Hansi Hettiarachchi and Ali H{\"u}rriyetoğlu and Nelleke Oostdijk and Onur Uca and Surendrabikram Thapa and Liza, {Farhana Ferdousi}",

note = "Publisher Copyright: {\textcopyright} CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023.; 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2023 ; Conference date: 07-09-2023",

year = "2023",

doi = "10.26615/978-954-452-089-2_019",

language = "English",

volume = "1",

pages = "144--150",

editor = "Ali Hurriyetoglu and Hristo Tanev and Vanni Zavarella and Reyyan Yeniterzi and Erdem Yoruk and Milena Slavcheva",

booktitle = "CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023",

publisher = "Incoma Ltd",

}

Tan, FA, Hettiarachchi, H, Hürriyetoğlu, A, Oostdijk, N, Uca, O, Thapa, S & Liza, FF 2023, Event Causality Identification - Shared Task 3, CASE 2023. in A Hurriyetoglu, H Tanev, V Zavarella, R Yeniterzi, E Yoruk & M Slavcheva (eds), CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023. vol. 1, Incoma Ltd, pp. 144-150, 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2023, Varna, Bulgaria, 7/09/23. https://doi.org/10.26615/978-954-452-089-2_019

Event Causality Identification - Shared Task 3, CASE 2023. / Tan, Fiona Anting; Hettiarachchi, Hansi; Hürriyetoğlu, Ali et al.

CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023. ed. / Ali Hurriyetoglu; Hristo Tanev; Vanni Zavarella; Reyyan Yeniterzi; Erdem Yoruk; Milena Slavcheva. Vol. 1 Incoma Ltd, 2023. p. 144-150.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Event Causality Identification - Shared Task 3, CASE 2023

AU - Tan, Fiona Anting

AU - Hettiarachchi, Hansi

AU - Hürriyetoğlu, Ali

AU - Oostdijk, Nelleke

AU - Uca, Onur

AU - Thapa, Surendrabikram

AU - Liza, Farhana Ferdousi

N1 - Publisher Copyright: © CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023.

PY - 2023

Y1 - 2023

N2 - The Event Causality Identification Shared Task of CASE 2023 is the second iteration of a shared task centered around the Causal News Corpus. Two subtasks were involved: In Subtask 1, participants were challenged to predict if a sentence contains a causal relation or not. In Subtask 2, participants were challenged to identify the Cause, Effect, and Signal spans given an input causal sentence. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper includes an overview of the work of the ten teams that submitted their results to our competition and the six system description papers that were received. The highest F1 scores achieved for Subtask 1 and 2 were 84.66% and 72.79%, respectively.

AB - The Event Causality Identification Shared Task of CASE 2023 is the second iteration of a shared task centered around the Causal News Corpus. Two subtasks were involved: In Subtask 1, participants were challenged to predict if a sentence contains a causal relation or not. In Subtask 2, participants were challenged to identify the Cause, Effect, and Signal spans given an input causal sentence. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper includes an overview of the work of the ten teams that submitted their results to our competition and the six system description papers that were received. The highest F1 scores achieved for Subtask 1 and 2 were 84.66% and 72.79%, respectively.

KW - Causal event classification

KW - Causal News Corpus

KW - Cause-Effect-Signal span detection

UR - http://www.scopus.com/inward/record.url?scp=85180392704&partnerID=8YFLogxK

U2 - 10.26615/978-954-452-089-2_019

DO - 10.26615/978-954-452-089-2_019

M3 - Conference contribution

AN - SCOPUS:85180392704

VL - 1

SP - 144

EP - 150

BT - CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023

A2 - Hurriyetoglu, Ali

A2 - Tanev, Hristo

A2 - Zavarella, Vanni

A2 - Yeniterzi, Reyyan

A2 - Yoruk, Erdem

A2 - Slavcheva, Milena

PB - Incoma Ltd

T2 - 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, CASE 2023

Y2 - 7 September 2023

ER -

Tan FA, Hettiarachchi H, Hürriyetoğlu A, Oostdijk N, Uca O, Thapa S et al. Event Causality Identification - Shared Task 3, CASE 2023. In Hurriyetoglu A, Tanev H, Zavarella V, Yeniterzi R, Yoruk E, Slavcheva M, editors, CASE 2023 - Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-Political Events from Text, associated with 14th International Conference on Recent Advances in Natural Language Processing, RANLP 2023. Vol. 1. Incoma Ltd. 2023. p. 144-150 doi: 10.26615/978-954-452-089-2_019

Event Causality Identification - Shared Task 3, CASE 2023

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this