A paired comparison test model using structural equation modeling resistant to response bias

Hideki Toyoda, Ikko Kawahashi, Tohru Watanabe, Mieko Hidaka

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

As an extension of the model of Toyoda, Kawahashi, and Matsushita (2005), the present authors added to the model the parameter f0, which represents individual differences in social desirability. In addition, we removed the assumption of tau-equivalent measurement for items. A paired-comparison test was constructed using competency scales developed in a pretest. The test was split into half, and the two halves standardized. The data from 400 participants indicated that split-half validity and reliability was confirmed. In a validity study, in order to examine the robustness of the standardized test to response biases, 199 participants took the paired-comparison test and a Likert test. Participants were instructed to assume that they were in a 2-selection evaluation scene. The results indicated that the new method is more robust to response biases than the Likert method, irrespective of differences in the evaluation scene.

Original languageEnglish
Pages (from-to)325-334
Number of pages10
JournalJapanese Journal of Educational Psychology
Volume55
Issue number3
Publication statusPublished - 2007 Sep

Fingerprint

Matched-Pair Analysis
Structural Models
structural model
Social Desirability
trend
Reproducibility of Results
Individuality
social desirability
evaluation

Keywords

  • Paired comparison competency test
  • Response biases
  • Social desirability
  • Structural equation modeling

ASJC Scopus subject areas

  • Psychology(all)
  • Developmental and Educational Psychology

Cite this

A paired comparison test model using structural equation modeling resistant to response bias. / Toyoda, Hideki; Kawahashi, Ikko; Watanabe, Tohru; Hidaka, Mieko.

In: Japanese Journal of Educational Psychology, Vol. 55, No. 3, 09.2007, p. 325-334.

Research output: Contribution to journalArticle

Toyoda, Hideki ; Kawahashi, Ikko ; Watanabe, Tohru ; Hidaka, Mieko. / A paired comparison test model using structural equation modeling resistant to response bias. In: Japanese Journal of Educational Psychology. 2007 ; Vol. 55, No. 3. pp. 325-334.
@article{8e308a3f47794428a18beafbe39b5353,
title = "A paired comparison test model using structural equation modeling resistant to response bias",
abstract = "As an extension of the model of Toyoda, Kawahashi, and Matsushita (2005), the present authors added to the model the parameter f0, which represents individual differences in social desirability. In addition, we removed the assumption of tau-equivalent measurement for items. A paired-comparison test was constructed using competency scales developed in a pretest. The test was split into half, and the two halves standardized. The data from 400 participants indicated that split-half validity and reliability was confirmed. In a validity study, in order to examine the robustness of the standardized test to response biases, 199 participants took the paired-comparison test and a Likert test. Participants were instructed to assume that they were in a 2-selection evaluation scene. The results indicated that the new method is more robust to response biases than the Likert method, irrespective of differences in the evaluation scene.",
keywords = "Paired comparison competency test, Response biases, Social desirability, Structural equation modeling",
author = "Hideki Toyoda and Ikko Kawahashi and Tohru Watanabe and Mieko Hidaka",
year = "2007",
month = "9",
language = "English",
volume = "55",
pages = "325--334",
journal = "Japanese Journal of Educational Psychology",
issn = "0021-5015",
publisher = "Japanese Association of Educational Psychology",
number = "3",

}

TY - JOUR

T1 - A paired comparison test model using structural equation modeling resistant to response bias

AU - Toyoda, Hideki

AU - Kawahashi, Ikko

AU - Watanabe, Tohru

AU - Hidaka, Mieko

PY - 2007/9

Y1 - 2007/9

N2 - As an extension of the model of Toyoda, Kawahashi, and Matsushita (2005), the present authors added to the model the parameter f0, which represents individual differences in social desirability. In addition, we removed the assumption of tau-equivalent measurement for items. A paired-comparison test was constructed using competency scales developed in a pretest. The test was split into half, and the two halves standardized. The data from 400 participants indicated that split-half validity and reliability was confirmed. In a validity study, in order to examine the robustness of the standardized test to response biases, 199 participants took the paired-comparison test and a Likert test. Participants were instructed to assume that they were in a 2-selection evaluation scene. The results indicated that the new method is more robust to response biases than the Likert method, irrespective of differences in the evaluation scene.

AB - As an extension of the model of Toyoda, Kawahashi, and Matsushita (2005), the present authors added to the model the parameter f0, which represents individual differences in social desirability. In addition, we removed the assumption of tau-equivalent measurement for items. A paired-comparison test was constructed using competency scales developed in a pretest. The test was split into half, and the two halves standardized. The data from 400 participants indicated that split-half validity and reliability was confirmed. In a validity study, in order to examine the robustness of the standardized test to response biases, 199 participants took the paired-comparison test and a Likert test. Participants were instructed to assume that they were in a 2-selection evaluation scene. The results indicated that the new method is more robust to response biases than the Likert method, irrespective of differences in the evaluation scene.

KW - Paired comparison competency test

KW - Response biases

KW - Social desirability

KW - Structural equation modeling

UR - http://www.scopus.com/inward/record.url?scp=38149032813&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38149032813&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:38149032813

VL - 55

SP - 325

EP - 334

JO - Japanese Journal of Educational Psychology

JF - Japanese Journal of Educational Psychology

SN - 0021-5015

IS - 3

ER -