Does document relevance affect the searcher's perception of time?

Cheng Luo, Yiqun Liu, Tetsuya Sakai, Ke Zhou, Fan Zhang, Xue Li, Shaoping Ma

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Citations (Scopus)

    Abstract

    Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies.

    Original languageEnglish
    Title of host publicationWSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining
    PublisherAssociation for Computing Machinery, Inc
    Pages141-150
    Number of pages10
    ISBN (Electronic)9781450346757
    DOIs
    Publication statusPublished - 2017 Feb 2
    Event10th ACM International Conference on Web Search and Data Mining, WSDM 2017 - Cambridge, United Kingdom
    Duration: 2017 Feb 62017 Feb 10

    Other

    Other10th ACM International Conference on Web Search and Data Mining, WSDM 2017
    CountryUnited Kingdom
    CityCambridge
    Period17/2/617/2/10

    Fingerprint

    Timing devices
    Time and motion study
    Information retrieval
    Feedback
    Experiments

    Keywords

    • Interactive information retrieval
    • Time perception
    • User behavior

    ASJC Scopus subject areas

    • Computer Science Applications
    • Information Systems
    • Computer Networks and Communications
    • Software

    Cite this

    Luo, C., Liu, Y., Sakai, T., Zhou, K., Zhang, F., Li, X., & Ma, S. (2017). Does document relevance affect the searcher's perception of time? In WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining (pp. 141-150). Association for Computing Machinery, Inc. https://doi.org/10.1145/3018661.3018694

    Does document relevance affect the searcher's perception of time? / Luo, Cheng; Liu, Yiqun; Sakai, Tetsuya; Zhou, Ke; Zhang, Fan; Li, Xue; Ma, Shaoping.

    WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, Inc, 2017. p. 141-150.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Luo, C, Liu, Y, Sakai, T, Zhou, K, Zhang, F, Li, X & Ma, S 2017, Does document relevance affect the searcher's perception of time? in WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, Inc, pp. 141-150, 10th ACM International Conference on Web Search and Data Mining, WSDM 2017, Cambridge, United Kingdom, 17/2/6. https://doi.org/10.1145/3018661.3018694
    Luo C, Liu Y, Sakai T, Zhou K, Zhang F, Li X et al. Does document relevance affect the searcher's perception of time? In WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, Inc. 2017. p. 141-150 https://doi.org/10.1145/3018661.3018694
    Luo, Cheng ; Liu, Yiqun ; Sakai, Tetsuya ; Zhou, Ke ; Zhang, Fan ; Li, Xue ; Ma, Shaoping. / Does document relevance affect the searcher's perception of time?. WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, Inc, 2017. pp. 141-150
    @inproceedings{3a695370f07f48bab0868875dd4442a3,
    title = "Does document relevance affect the searcher's perception of time?",
    abstract = "Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies.",
    keywords = "Interactive information retrieval, Time perception, User behavior",
    author = "Cheng Luo and Yiqun Liu and Tetsuya Sakai and Ke Zhou and Fan Zhang and Xue Li and Shaoping Ma",
    year = "2017",
    month = "2",
    day = "2",
    doi = "10.1145/3018661.3018694",
    language = "English",
    pages = "141--150",
    booktitle = "WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining",
    publisher = "Association for Computing Machinery, Inc",

    }

    TY - GEN

    T1 - Does document relevance affect the searcher's perception of time?

    AU - Luo, Cheng

    AU - Liu, Yiqun

    AU - Sakai, Tetsuya

    AU - Zhou, Ke

    AU - Zhang, Fan

    AU - Li, Xue

    AU - Ma, Shaoping

    PY - 2017/2/2

    Y1 - 2017/2/2

    N2 - Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies.

    AB - Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies.

    KW - Interactive information retrieval

    KW - Time perception

    KW - User behavior

    UR - http://www.scopus.com/inward/record.url?scp=85015345395&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85015345395&partnerID=8YFLogxK

    U2 - 10.1145/3018661.3018694

    DO - 10.1145/3018661.3018694

    M3 - Conference contribution

    SP - 141

    EP - 150

    BT - WSDM 2017 - Proceedings of the 10th ACM International Conference on Web Search and Data Mining

    PB - Association for Computing Machinery, Inc

    ER -