CENTRE@CLEF2018

Overview of the replicability task

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

    Research output: Contribution to journalConference article

    Abstract

    Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    Original languageEnglish
    JournalCEUR Workshop Proceedings
    Volume2125
    Publication statusPublished - 2018 Jan 1
    Event19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, France
    Duration: 2018 Sep 102018 Sep 14

    ASJC Scopus subject areas

    • Computer Science(all)

    Cite this

    CENTRE@CLEF2018 : Overview of the replicability task. / Ferro, Nicola; Maistro, Maria; Sakai, Tetsuya; Soboroff, Ian.

    In: CEUR Workshop Proceedings, Vol. 2125, 01.01.2018.

    Research output: Contribution to journalConference article

    Ferro, Nicola ; Maistro, Maria ; Sakai, Tetsuya ; Soboroff, Ian. / CENTRE@CLEF2018 : Overview of the replicability task. In: CEUR Workshop Proceedings. 2018 ; Vol. 2125.
    @article{5886b6d1139748f6aba2c4af1c4a05f3,
    title = "CENTRE@CLEF2018: Overview of the replicability task",
    abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.",
    author = "Nicola Ferro and Maria Maistro and Tetsuya Sakai and Ian Soboroff",
    year = "2018",
    month = "1",
    day = "1",
    language = "English",
    volume = "2125",
    journal = "CEUR Workshop Proceedings",
    issn = "1613-0073",
    publisher = "CEUR-WS",

    }

    TY - JOUR

    T1 - CENTRE@CLEF2018

    T2 - Overview of the replicability task

    AU - Ferro, Nicola

    AU - Maistro, Maria

    AU - Sakai, Tetsuya

    AU - Soboroff, Ian

    PY - 2018/1/1

    Y1 - 2018/1/1

    N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    UR - http://www.scopus.com/inward/record.url?scp=85051055402&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85051055402&partnerID=8YFLogxK

    M3 - Conference article

    VL - 2125

    JO - CEUR Workshop Proceedings

    JF - CEUR Workshop Proceedings

    SN - 1613-0073

    ER -