Conducting laboratory experiments properly with statistical tools: An easy hands-on tutorial

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    This hands-on half-day tutorial consists of two sessions. Part I covers the following topics: Preliminaries; Paired and two-sample t-tests, confidence intervals; One-way ANOVA and two-way ANOVA without replication; Familiwise error rate. Part II covers the following topics: Tukey's HSD test, simultaneous confidence intervals; Randomisation test and randomised Tukey HSD test; What's wrong with statistical significance tests?; Effect sizes, statistical power; Topic set size design and power analysis; Summary: how to report your results. Participants should have some prior knowledge about the very basics of statistical significance testing and are strongly encouraged to bring a laptop with R already installed. They will learn how to design and conduct statistical significance tests for comparing the mean effectiveness scores of two or more systems appropriately, and to report on the test results in an informative manner.

    Original languageEnglish
    Title of host publicationWSDM 2019 - Proceedings of the 12th ACM International Conference on Web Search and Data Mining
    PublisherAssociation for Computing Machinery, Inc
    Pages830-831
    Number of pages2
    ISBN (Electronic)9781450359405
    DOIs
    Publication statusPublished - 2019 Jan 30
    Event12th ACM International Conference on Web Search and Data Mining, WSDM 2019 - Melbourne, Australia
    Duration: 2019 Feb 112019 Feb 15

    Publication series

    NameWSDM 2019 - Proceedings of the 12th ACM International Conference on Web Search and Data Mining

    Conference

    Conference12th ACM International Conference on Web Search and Data Mining, WSDM 2019
    CountryAustralia
    CityMelbourne
    Period19/2/1119/2/15

    Keywords

    • Confidence intervals
    • Effect sizes
    • Multiple comparison procedures
    • Randomisation test
    • Sample sizes
    • Statistical power
    • Statistical significance
    • T-test
    • Tukey's honestly significant difference test

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Software
    • Computer Science Applications

    Fingerprint Dive into the research topics of 'Conducting laboratory experiments properly with statistical tools: An easy hands-on tutorial'. Together they form a unique fingerprint.

  • Cite this

    Sakai, T. (2019). Conducting laboratory experiments properly with statistical tools: An easy hands-on tutorial. In WSDM 2019 - Proceedings of the 12th ACM International Conference on Web Search and Data Mining (pp. 830-831). (WSDM 2019 - Proceedings of the 12th ACM International Conference on Web Search and Data Mining). Association for Computing Machinery, Inc. https://doi.org/10.1145/3289600.3291378