Centre@clef2019: Overview of the replicability and reproducibility tasks

Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff

Research output: Contribution to journalConference article

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

Original languageEnglish
JournalCEUR Workshop Proceedings
Volume2380
Publication statusPublished - 2019 Jan 1
Event20th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2019 - Lugano, Switzerland
Duration: 2019 Sep 92019 Sep 12

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Centre@clef2019 : Overview of the replicability and reproducibility tasks. / Ferro, Nicola; Fuhr, Norbert; Maistro, Maria; Sakai, Tetsuya; Soboroff, Ian.

In: CEUR Workshop Proceedings, Vol. 2380, 01.01.2019.

Research output: Contribution to journalConference article

Ferro, Nicola ; Fuhr, Norbert ; Maistro, Maria ; Sakai, Tetsuya ; Soboroff, Ian. / Centre@clef2019 : Overview of the replicability and reproducibility tasks. In: CEUR Workshop Proceedings. 2019 ; Vol. 2380.
@article{db00b73b733549eaaa84925b5429750a,
title = "Centre@clef2019: Overview of the replicability and reproducibility tasks",
abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.",
author = "Nicola Ferro and Norbert Fuhr and Maria Maistro and Tetsuya Sakai and Ian Soboroff",
year = "2019",
month = "1",
day = "1",
language = "English",
volume = "2380",
journal = "CEUR Workshop Proceedings",
issn = "1613-0073",
publisher = "CEUR-WS",

}

TY - JOUR

T1 - Centre@clef2019

T2 - Overview of the replicability and reproducibility tasks

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

UR - http://www.scopus.com/inward/record.url?scp=85070529496&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070529496&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85070529496

VL - 2380

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

SN - 1613-0073

ER -