Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Nicola Ferro; Norbert Fuhr; Maria Maistro; Tetsuya Sakai; Ian Soboroff

doi:10.1007/978-3-030-28577-7_24

Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Nicola Ferro^*, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff

^*Corresponding author for this work

School of Fundamental Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Citations (Scopus)

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

Original language	English
Title of host publication	Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings
Editors	Fabio Crestani, Martin Braschler, Jacques Savoy, Andreas Rauber, Henning Müller, David E. Losada, Gundula Heinatz Bürki, Linda Cappellato, Nicola Ferro
Publisher	Springer-Verlag
Pages	287-300
Number of pages	14
ISBN (Print)	9783030285760
DOIs	https://doi.org/10.1007/978-3-030-28577-7_24
Publication status	Published - 2019 Jan 1
Event	10th International Conference of the CLEF Association, CLEF 2019 - Lugano, Switzerland Duration: 2019 Sept 9 → 2019 Sept 12

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11696 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	10th International Conference of the CLEF Association, CLEF 2019
Country/Territory	Switzerland
City	Lugano
Period	19/9/9 → 19/9/12

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-28577-7_24

Cite this

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., & Soboroff, I. (2019). Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In F. Crestani, M. Braschler, J. Savoy, A. Rauber, H. Müller, D. E. Losada, G. Heinatz Bürki, L. Cappellato, & N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings (pp. 287-300). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11696 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-28577-7_24

Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. / Ferro, Nicola; Fuhr, Norbert; Maistro, Maria et al.

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. ed. / Fabio Crestani; Martin Braschler; Jacques Savoy; Andreas Rauber; Henning Müller; David E. Losada; Gundula Heinatz Bürki; Linda Cappellato; Nicola Ferro. Springer-Verlag, 2019. p. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11696 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ferro, N, Fuhr, N, Maistro, M, Sakai, T & Soboroff, I 2019, Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. in F Crestani, M Braschler, J Savoy, A Rauber, H Müller, DE Losada, G Heinatz Bürki, L Cappellato & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11696 LNCS, Springer-Verlag, pp. 287-300, 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, 19/9/9. https://doi.org/10.1007/978-3-030-28577-7_24

Ferro N, Fuhr N, Maistro M, Sakai T, Soboroff I. Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In Crestani F, Braschler M, Savoy J, Rauber A, Müller H, Losada DE, Heinatz Bürki G, Cappellato L, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. Springer-Verlag. 2019. p. 287-300. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-28577-7_24

Ferro, Nicola ; Fuhr, Norbert ; Maistro, Maria et al. / Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. editor / Fabio Crestani ; Martin Braschler ; Jacques Savoy ; Andreas Rauber ; Henning Müller ; David E. Losada ; Gundula Heinatz Bürki ; Linda Cappellato ; Nicola Ferro. Springer-Verlag, 2019. pp. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{c363fa5dd0114acdad88b9feac029887,

title = "Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm",

abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.",

author = "Nicola Ferro and Norbert Fuhr and Maria Maistro and Tetsuya Sakai and Ian Soboroff",

year = "2019",

month = jan,

day = "1",

doi = "10.1007/978-3-030-28577-7_24",

language = "English",

isbn = "9783030285760",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-Verlag",

pages = "287--300",

editor = "Fabio Crestani and Martin Braschler and Jacques Savoy and Andreas Rauber and Henning M{\"u}ller and Losada, {David E.} and {Heinatz B{\"u}rki}, Gundula and Linda Cappellato and Nicola Ferro",

booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings",

note = "10th International Conference of the CLEF Association, CLEF 2019 ; Conference date: 09-09-2019 Through 12-09-2019",

}

TY - GEN

T1 - Overview of CENTRE@CLEF 2019

T2 - 10th International Conference of the CLEF Association, CLEF 2019

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

UR - http://www.scopus.com/inward/record.url?scp=85070722624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070722624&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-28577-7_24

DO - 10.1007/978-3-030-28577-7_24

M3 - Conference contribution

AN - SCOPUS:85070722624

SN - 9783030285760

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 287

EP - 300

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings

A2 - Crestani, Fabio

A2 - Braschler, Martin

A2 - Savoy, Jacques

A2 - Rauber, Andreas

A2 - Müller, Henning

A2 - Losada, David E.

A2 - Heinatz Bürki, Gundula

A2 - Cappellato, Linda

A2 - Ferro, Nicola

PB - Springer-Verlag

Y2 - 9 September 2019 through 12 September 2019

ER -