Do students in Japan learn how to use mathematics in real-life situations? An analysis of items in the 2003 Programme for International Student Assessment (PISA 2003)

Yumi Suzukawa, Hideki Toyoda, Ikko Kawahashi

Research output: Contribution to journalArticle

Abstract

It has been said that Japanese students lack the ability to apply their knowledge and skills to real-life situations. The Programme for International Student Assessment (PISA), conducted by the Organisation for Economic Cooperation and Development (OECD), is a test that measures that ability. However, using the test's results to make cross-country comparisons of students' "skills for life" is not possible because of differences among countries in educational level. The purpose of the present study was to examine differences in item difficulty across countries, using multiple group item response theory (IRT), in order to detect any differential item functioning (DIF) in "mathematical literacy." Participants were 99,175 examinees in 13 countries and areas (Australia, Canada, Finland, France, Germany, Hong Kong, Ireland, Italy, Japan, Korea, Netherlands, New Zealand, and the United States) who took the Programme for International Student Assessment in 2003 (PISA 2003). Analysis revealed that Japan has a most unusual pattern of item difficulties. Especially, the Japanese participants were not good at solving questions in real-life situation.

Original languageEnglish
Pages (from-to)206-217
Number of pages12
JournalJapanese Journal of Educational Psychology
Volume56
Issue number2
Publication statusPublished - 2008 Jun

Fingerprint

PISA study
Mathematics
life situation
Japan
mathematics
Students
Aptitude
ability
OECD
Finland
Korea
Ireland
Hong Kong
New Zealand
Italy
Netherlands
student
literacy
France
Canada

Keywords

  • Cross-national comparison
  • Differential item functioning (DIF)
  • Multiple group item response theory (IRT)
  • Programme for International Student Assessment (PISA)

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Education

Cite this

@article{980c5354f0c74b9cbc9ece23c118c318,
title = "Do students in Japan learn how to use mathematics in real-life situations? An analysis of items in the 2003 Programme for International Student Assessment (PISA 2003)",
abstract = "It has been said that Japanese students lack the ability to apply their knowledge and skills to real-life situations. The Programme for International Student Assessment (PISA), conducted by the Organisation for Economic Cooperation and Development (OECD), is a test that measures that ability. However, using the test's results to make cross-country comparisons of students' {"}skills for life{"} is not possible because of differences among countries in educational level. The purpose of the present study was to examine differences in item difficulty across countries, using multiple group item response theory (IRT), in order to detect any differential item functioning (DIF) in {"}mathematical literacy.{"} Participants were 99,175 examinees in 13 countries and areas (Australia, Canada, Finland, France, Germany, Hong Kong, Ireland, Italy, Japan, Korea, Netherlands, New Zealand, and the United States) who took the Programme for International Student Assessment in 2003 (PISA 2003). Analysis revealed that Japan has a most unusual pattern of item difficulties. Especially, the Japanese participants were not good at solving questions in real-life situation.",
keywords = "Cross-national comparison, Differential item functioning (DIF), Multiple group item response theory (IRT), Programme for International Student Assessment (PISA)",
author = "Yumi Suzukawa and Hideki Toyoda and Ikko Kawahashi",
year = "2008",
month = "6",
language = "English",
volume = "56",
pages = "206--217",
journal = "Japanese Journal of Educational Psychology",
issn = "0021-5015",
publisher = "Japanese Association of Educational Psychology",
number = "2",

}

TY - JOUR

T1 - Do students in Japan learn how to use mathematics in real-life situations? An analysis of items in the 2003 Programme for International Student Assessment (PISA 2003)

AU - Suzukawa, Yumi

AU - Toyoda, Hideki

AU - Kawahashi, Ikko

PY - 2008/6

Y1 - 2008/6

N2 - It has been said that Japanese students lack the ability to apply their knowledge and skills to real-life situations. The Programme for International Student Assessment (PISA), conducted by the Organisation for Economic Cooperation and Development (OECD), is a test that measures that ability. However, using the test's results to make cross-country comparisons of students' "skills for life" is not possible because of differences among countries in educational level. The purpose of the present study was to examine differences in item difficulty across countries, using multiple group item response theory (IRT), in order to detect any differential item functioning (DIF) in "mathematical literacy." Participants were 99,175 examinees in 13 countries and areas (Australia, Canada, Finland, France, Germany, Hong Kong, Ireland, Italy, Japan, Korea, Netherlands, New Zealand, and the United States) who took the Programme for International Student Assessment in 2003 (PISA 2003). Analysis revealed that Japan has a most unusual pattern of item difficulties. Especially, the Japanese participants were not good at solving questions in real-life situation.

AB - It has been said that Japanese students lack the ability to apply their knowledge and skills to real-life situations. The Programme for International Student Assessment (PISA), conducted by the Organisation for Economic Cooperation and Development (OECD), is a test that measures that ability. However, using the test's results to make cross-country comparisons of students' "skills for life" is not possible because of differences among countries in educational level. The purpose of the present study was to examine differences in item difficulty across countries, using multiple group item response theory (IRT), in order to detect any differential item functioning (DIF) in "mathematical literacy." Participants were 99,175 examinees in 13 countries and areas (Australia, Canada, Finland, France, Germany, Hong Kong, Ireland, Italy, Japan, Korea, Netherlands, New Zealand, and the United States) who took the Programme for International Student Assessment in 2003 (PISA 2003). Analysis revealed that Japan has a most unusual pattern of item difficulties. Especially, the Japanese participants were not good at solving questions in real-life situation.

KW - Cross-national comparison

KW - Differential item functioning (DIF)

KW - Multiple group item response theory (IRT)

KW - Programme for International Student Assessment (PISA)

UR - http://www.scopus.com/inward/record.url?scp=54149098198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=54149098198&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:54149098198

VL - 56

SP - 206

EP - 217

JO - Japanese Journal of Educational Psychology

JF - Japanese Journal of Educational Psychology

SN - 0021-5015

IS - 2

ER -