Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

Original languageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings
EditorsFabio Crestani, Martin Braschler, Jacques Savoy, Andreas Rauber, Henning Müller, David E. Losada, Gundula Heinatz Bürki, Linda Cappellato, Nicola Ferro
PublisherSpringer-Verlag
Pages287-300
Number of pages14
ISBN (Print)9783030285760
DOIs
Publication statusPublished - 2019 Jan 1
Event10th International Conference of the CLEF Association, CLEF 2019 - Lugano, Switzerland
Duration: 2019 Sep 92019 Sep 12

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11696 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Conference of the CLEF Association, CLEF 2019
CountrySwitzerland
CityLugano
Period19/9/919/9/12

Fingerprint

Reproducibility
Exception
Evaluation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., & Soboroff, I. (2019). Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In F. Crestani, M. Braschler, J. Savoy, A. Rauber, H. Müller, D. E. Losada, G. Heinatz Bürki, L. Cappellato, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings (pp. 287-300). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11696 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-28577-7_24

Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. / Ferro, Nicola; Fuhr, Norbert; Maistro, Maria; Sakai, Tetsuya; Soboroff, Ian.

Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. ed. / Fabio Crestani; Martin Braschler; Jacques Savoy; Andreas Rauber; Henning Müller; David E. Losada; Gundula Heinatz Bürki; Linda Cappellato; Nicola Ferro. Springer-Verlag, 2019. p. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11696 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ferro, N, Fuhr, N, Maistro, M, Sakai, T & Soboroff, I 2019, Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. in F Crestani, M Braschler, J Savoy, A Rauber, H Müller, DE Losada, G Heinatz Bürki, L Cappellato & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11696 LNCS, Springer-Verlag, pp. 287-300, 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, 19/9/9. https://doi.org/10.1007/978-3-030-28577-7_24
Ferro N, Fuhr N, Maistro M, Sakai T, Soboroff I. Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In Crestani F, Braschler M, Savoy J, Rauber A, Müller H, Losada DE, Heinatz Bürki G, Cappellato L, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. Springer-Verlag. 2019. p. 287-300. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-28577-7_24
Ferro, Nicola ; Fuhr, Norbert ; Maistro, Maria ; Sakai, Tetsuya ; Soboroff, Ian. / Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings. editor / Fabio Crestani ; Martin Braschler ; Jacques Savoy ; Andreas Rauber ; Henning Müller ; David E. Losada ; Gundula Heinatz Bürki ; Linda Cappellato ; Nicola Ferro. Springer-Verlag, 2019. pp. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{c363fa5dd0114acdad88b9feac029887,
title = "Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm",
abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.",
author = "Nicola Ferro and Norbert Fuhr and Maria Maistro and Tetsuya Sakai and Ian Soboroff",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-28577-7_24",
language = "English",
isbn = "9783030285760",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer-Verlag",
pages = "287--300",
editor = "Fabio Crestani and Martin Braschler and Jacques Savoy and Andreas Rauber and Henning M{\"u}ller and Losada, {David E.} and {Heinatz B{\"u}rki}, Gundula and Linda Cappellato and Nicola Ferro",
booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings",

}

TY - GEN

T1 - Overview of CENTRE@CLEF 2019

T2 - Sequel in the Systematic Reproducibility Realm

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

UR - http://www.scopus.com/inward/record.url?scp=85070722624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070722624&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-28577-7_24

DO - 10.1007/978-3-030-28577-7_24

M3 - Conference contribution

AN - SCOPUS:85070722624

SN - 9783030285760

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 287

EP - 300

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction - 10th International Conference of the CLEF Association, CLEF 2019, Proceedings

A2 - Crestani, Fabio

A2 - Braschler, Martin

A2 - Savoy, Jacques

A2 - Rauber, Andreas

A2 - Müller, Henning

A2 - Losada, David E.

A2 - Heinatz Bürki, Gundula

A2 - Cappellato, Linda

A2 - Ferro, Nicola

PB - Springer-Verlag

ER -