Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    10 Citations (Scopus)

    Abstract

    Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    Original languageEnglish
    Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings
    EditorsEric SanJuan, Fionn Murtagh, Jian Yun Nie, Laure Soulier, Linda Cappellato, Patrice Bellot, Josiane Mothe, Chiraz Trabelsi, Nicola Ferro
    PublisherSpringer-Verlag
    Pages239-246
    Number of pages8
    ISBN (Print)9783319989310
    DOIs
    Publication statusPublished - 2018 Jan 1
    Event9th International Conference of the CLEF Association, CLEF 2018 - Avignon, France
    Duration: 2018 Sep 102018 Sep 14

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume11018 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Other

    Other9th International Conference of the CLEF Association, CLEF 2018
    CountryFrance
    CityAvignon
    Period18/9/1018/9/14

      Fingerprint

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Computer Science(all)

    Cite this

    Ferro, N., Maistro, M., Sakai, T., & Soboroff, I. (2018). Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm. In E. SanJuan, F. Murtagh, J. Y. Nie, L. Soulier, L. Cappellato, P. Bellot, J. Mothe, C. Trabelsi, & N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings (pp. 239-246). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11018 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-319-98932-7_23