Calibration and statistical techniques for building an interactive screen for learning of alphabets by children

Riby Abraham Boby, Ravi Prakash, Subir Kumar Saha, Takafumi Matsumaru, Pratyusha Sharma, Siddhartha Jaitly

Research output: Contribution to journalArticle

Abstract

This article focuses on the implementation details of a portable interactive device called Image-projective Desktop Varnamala Trainer. The device uses a projector to produce a virtual display on a flat surface. For enabling interaction, the information about a user’s hand movement is obtained from a single two-dimensional scanning laser range finder in contrast with a camera sensor used in many earlier applications. A generalized calibration process to obtain exact transformation from projected screen coordinate system to sensor coordinate system is proposed in this article and implemented for enabling interaction. This permits production of large interactive displays with minimal cost. Additionally, it makes the entire system portable, that is, display can be produced on any planar surface like floor, tabletop, and so on. The calibration and its performance have been evaluated by varying screen sizes and the number of points used for calibration. The device was successfully calibrated for different screens. A novel learning-based methodology for predicting a user’s behaviour was then realized to improve the system’s performance. This has been experimentally evaluated, and the overall accuracy of prediction was about 96%. An application was then designed for this set-up to improve the learning of alphabets by the children through an interactive audiovisual feedback system. It uses a game-based methodology to help students learn in a fun way. Currently, it has bilingual (Hindi and English) user interface to enable learning of alphabets and elementary mathematics. A user survey was conducted after demonstrating it to school children. The survey results are very encouraging. Additionally, a study to ascertain the improvement in the learning outcome of the children was done. The results clearly indicate an improvement in the learning outcome of the children who used the device over those who did not.

Original languageEnglish
JournalInternational Journal of Advanced Robotic Systems
Volume14
Issue number3
DOIs
Publication statusPublished - 2017

Fingerprint

Display devices
Calibration
Interactive devices
Range finders
Sensors
User interfaces
Cameras
Students
Scanning
Feedback
Lasers
Costs

Keywords

  • Calibration
  • Education
  • Image-projective desktop
  • Interactive display
  • Statistical learning

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Artificial Intelligence

Cite this

Calibration and statistical techniques for building an interactive screen for learning of alphabets by children. / Boby, Riby Abraham; Prakash, Ravi; Saha, Subir Kumar; Matsumaru, Takafumi; Sharma, Pratyusha; Jaitly, Siddhartha.

In: International Journal of Advanced Robotic Systems, Vol. 14, No. 3, 2017.

Research output: Contribution to journalArticle

Boby, Riby Abraham ; Prakash, Ravi ; Saha, Subir Kumar ; Matsumaru, Takafumi ; Sharma, Pratyusha ; Jaitly, Siddhartha. / Calibration and statistical techniques for building an interactive screen for learning of alphabets by children. In: International Journal of Advanced Robotic Systems. 2017 ; Vol. 14, No. 3.
@article{fd99f5e671ce4f8bbb7c4e99e21d6550,
title = "Calibration and statistical techniques for building an interactive screen for learning of alphabets by children",
abstract = "This article focuses on the implementation details of a portable interactive device called Image-projective Desktop Varnamala Trainer. The device uses a projector to produce a virtual display on a flat surface. For enabling interaction, the information about a user’s hand movement is obtained from a single two-dimensional scanning laser range finder in contrast with a camera sensor used in many earlier applications. A generalized calibration process to obtain exact transformation from projected screen coordinate system to sensor coordinate system is proposed in this article and implemented for enabling interaction. This permits production of large interactive displays with minimal cost. Additionally, it makes the entire system portable, that is, display can be produced on any planar surface like floor, tabletop, and so on. The calibration and its performance have been evaluated by varying screen sizes and the number of points used for calibration. The device was successfully calibrated for different screens. A novel learning-based methodology for predicting a user’s behaviour was then realized to improve the system’s performance. This has been experimentally evaluated, and the overall accuracy of prediction was about 96{\%}. An application was then designed for this set-up to improve the learning of alphabets by the children through an interactive audiovisual feedback system. It uses a game-based methodology to help students learn in a fun way. Currently, it has bilingual (Hindi and English) user interface to enable learning of alphabets and elementary mathematics. A user survey was conducted after demonstrating it to school children. The survey results are very encouraging. Additionally, a study to ascertain the improvement in the learning outcome of the children was done. The results clearly indicate an improvement in the learning outcome of the children who used the device over those who did not.",
keywords = "Calibration, Education, Image-projective desktop, Interactive display, Statistical learning",
author = "Boby, {Riby Abraham} and Ravi Prakash and Saha, {Subir Kumar} and Takafumi Matsumaru and Pratyusha Sharma and Siddhartha Jaitly",
year = "2017",
doi = "10.1177/1729881417703939",
language = "English",
volume = "14",
journal = "International Journal of Advanced Robotic Systems",
issn = "1729-8806",
publisher = "Vienna University of Technology",
number = "3",

}

TY - JOUR

T1 - Calibration and statistical techniques for building an interactive screen for learning of alphabets by children

AU - Boby, Riby Abraham

AU - Prakash, Ravi

AU - Saha, Subir Kumar

AU - Matsumaru, Takafumi

AU - Sharma, Pratyusha

AU - Jaitly, Siddhartha

PY - 2017

Y1 - 2017

N2 - This article focuses on the implementation details of a portable interactive device called Image-projective Desktop Varnamala Trainer. The device uses a projector to produce a virtual display on a flat surface. For enabling interaction, the information about a user’s hand movement is obtained from a single two-dimensional scanning laser range finder in contrast with a camera sensor used in many earlier applications. A generalized calibration process to obtain exact transformation from projected screen coordinate system to sensor coordinate system is proposed in this article and implemented for enabling interaction. This permits production of large interactive displays with minimal cost. Additionally, it makes the entire system portable, that is, display can be produced on any planar surface like floor, tabletop, and so on. The calibration and its performance have been evaluated by varying screen sizes and the number of points used for calibration. The device was successfully calibrated for different screens. A novel learning-based methodology for predicting a user’s behaviour was then realized to improve the system’s performance. This has been experimentally evaluated, and the overall accuracy of prediction was about 96%. An application was then designed for this set-up to improve the learning of alphabets by the children through an interactive audiovisual feedback system. It uses a game-based methodology to help students learn in a fun way. Currently, it has bilingual (Hindi and English) user interface to enable learning of alphabets and elementary mathematics. A user survey was conducted after demonstrating it to school children. The survey results are very encouraging. Additionally, a study to ascertain the improvement in the learning outcome of the children was done. The results clearly indicate an improvement in the learning outcome of the children who used the device over those who did not.

AB - This article focuses on the implementation details of a portable interactive device called Image-projective Desktop Varnamala Trainer. The device uses a projector to produce a virtual display on a flat surface. For enabling interaction, the information about a user’s hand movement is obtained from a single two-dimensional scanning laser range finder in contrast with a camera sensor used in many earlier applications. A generalized calibration process to obtain exact transformation from projected screen coordinate system to sensor coordinate system is proposed in this article and implemented for enabling interaction. This permits production of large interactive displays with minimal cost. Additionally, it makes the entire system portable, that is, display can be produced on any planar surface like floor, tabletop, and so on. The calibration and its performance have been evaluated by varying screen sizes and the number of points used for calibration. The device was successfully calibrated for different screens. A novel learning-based methodology for predicting a user’s behaviour was then realized to improve the system’s performance. This has been experimentally evaluated, and the overall accuracy of prediction was about 96%. An application was then designed for this set-up to improve the learning of alphabets by the children through an interactive audiovisual feedback system. It uses a game-based methodology to help students learn in a fun way. Currently, it has bilingual (Hindi and English) user interface to enable learning of alphabets and elementary mathematics. A user survey was conducted after demonstrating it to school children. The survey results are very encouraging. Additionally, a study to ascertain the improvement in the learning outcome of the children was done. The results clearly indicate an improvement in the learning outcome of the children who used the device over those who did not.

KW - Calibration

KW - Education

KW - Image-projective desktop

KW - Interactive display

KW - Statistical learning

UR - http://www.scopus.com/inward/record.url?scp=85020006977&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85020006977&partnerID=8YFLogxK

U2 - 10.1177/1729881417703939

DO - 10.1177/1729881417703939

M3 - Article

AN - SCOPUS:85020006977

VL - 14

JO - International Journal of Advanced Robotic Systems

JF - International Journal of Advanced Robotic Systems

SN - 1729-8806

IS - 3

ER -