Overview of CENTRE@CLEF 2018

A first tale in the systematic reproducibility realm

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    Original languageEnglish
    Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings
    EditorsEric SanJuan, Fionn Murtagh, Jian Yun Nie, Laure Soulier, Linda Cappellato, Patrice Bellot, Josiane Mothe, Chiraz Trabelsi, Nicola Ferro
    PublisherSpringer-Verlag
    Pages239-246
    Number of pages8
    ISBN (Print)9783319989310
    DOIs
    Publication statusPublished - 2018 Jan 1
    Event9th International Conference of the CLEF Association, CLEF 2018 - Avignon, France
    Duration: 2018 Sep 102018 Sep 14

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume11018 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Other

    Other9th International Conference of the CLEF Association, CLEF 2018
    CountryFrance
    CityAvignon
    Period18/9/1018/9/14

    Fingerprint

    Reproducibility
    Exception
    Narrative
    Evaluation

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Computer Science(all)

    Cite this

    Ferro, N., Maistro, M., Sakai, T., & Soboroff, I. (2018). Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm. In E. SanJuan, F. Murtagh, J. Y. Nie, L. Soulier, L. Cappellato, P. Bellot, J. Mothe, C. Trabelsi, ... N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings (pp. 239-246). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11018 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-319-98932-7_23

    Overview of CENTRE@CLEF 2018 : A first tale in the systematic reproducibility realm. / Ferro, Nicola; Maistro, Maria; Sakai, Tetsuya; Soboroff, Ian.

    Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings. ed. / Eric SanJuan; Fionn Murtagh; Jian Yun Nie; Laure Soulier; Linda Cappellato; Patrice Bellot; Josiane Mothe; Chiraz Trabelsi; Nicola Ferro. Springer-Verlag, 2018. p. 239-246 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11018 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Ferro, N, Maistro, M, Sakai, T & Soboroff, I 2018, Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm. in E SanJuan, F Murtagh, JY Nie, L Soulier, L Cappellato, P Bellot, J Mothe, C Trabelsi & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11018 LNCS, Springer-Verlag, pp. 239-246, 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, 18/9/10. https://doi.org/10.1007/978-3-319-98932-7_23
    Ferro N, Maistro M, Sakai T, Soboroff I. Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm. In SanJuan E, Murtagh F, Nie JY, Soulier L, Cappellato L, Bellot P, Mothe J, Trabelsi C, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings. Springer-Verlag. 2018. p. 239-246. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-98932-7_23
    Ferro, Nicola ; Maistro, Maria ; Sakai, Tetsuya ; Soboroff, Ian. / Overview of CENTRE@CLEF 2018 : A first tale in the systematic reproducibility realm. Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings. editor / Eric SanJuan ; Fionn Murtagh ; Jian Yun Nie ; Laure Soulier ; Linda Cappellato ; Patrice Bellot ; Josiane Mothe ; Chiraz Trabelsi ; Nicola Ferro. Springer-Verlag, 2018. pp. 239-246 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{44716aa9f2b34891a2999be4d784a09d,
    title = "Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm",
    abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.",
    author = "Nicola Ferro and Maria Maistro and Tetsuya Sakai and Ian Soboroff",
    year = "2018",
    month = "1",
    day = "1",
    doi = "10.1007/978-3-319-98932-7_23",
    language = "English",
    isbn = "9783319989310",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer-Verlag",
    pages = "239--246",
    editor = "Eric SanJuan and Fionn Murtagh and Nie, {Jian Yun} and Laure Soulier and Linda Cappellato and Patrice Bellot and Josiane Mothe and Chiraz Trabelsi and Nicola Ferro",
    booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings",

    }

    TY - GEN

    T1 - Overview of CENTRE@CLEF 2018

    T2 - A first tale in the systematic reproducibility realm

    AU - Ferro, Nicola

    AU - Maistro, Maria

    AU - Sakai, Tetsuya

    AU - Soboroff, Ian

    PY - 2018/1/1

    Y1 - 2018/1/1

    N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    UR - http://www.scopus.com/inward/record.url?scp=85052824382&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85052824382&partnerID=8YFLogxK

    U2 - 10.1007/978-3-319-98932-7_23

    DO - 10.1007/978-3-319-98932-7_23

    M3 - Conference contribution

    SN - 9783319989310

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 239

    EP - 246

    BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings

    A2 - SanJuan, Eric

    A2 - Murtagh, Fionn

    A2 - Nie, Jian Yun

    A2 - Soulier, Laure

    A2 - Cappellato, Linda

    A2 - Bellot, Patrice

    A2 - Mothe, Josiane

    A2 - Trabelsi, Chiraz

    A2 - Ferro, Nicola

    PB - Springer-Verlag

    ER -