Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch

P. Sharma, R. P. Joshi, R. A. Boby, S. K. Saha, Takafumi Matsumaru

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

An Image-projective Desktop Varnamala Trainer (IDVT) called SAKSHAR has been designed to improve the learning by children through an interactive audio visual feedback system. This device uses a projector to render a virtual display, which permits production of large interactive displays with minimal cost. The user's hand is recognized with the help of a Microsoft Kinect Version 2. The entire system is portable, i.e., it can be projected on any planar surface. Since the Kinect does not give precise 3D coordinates of points for detecting a touch, a model of recognition of a touch purely based on the contact of the user's hand with the surface would not yield accurate results. We have instead modeled the touch action by using multiple points along the trajectory of the tracked point of the user's hand while hand makes contact with the surface. Fitting a curve through these points and analyzing the errors is used to make the detection of touch accurate.

Original languageEnglish
Title of host publication2015 IEEE/SICE International Symposium on System Integration, SII 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages795-800
Number of pages6
ISBN (Print)9781467372428
DOIs
Publication statusPublished - 2016 Feb 10
Event8th Annual IEEE/SICE International Symposium on System Integration, SII 2015 - Nagoya, Japan
Duration: 2015 Dec 112015 Dec 13

Other

Other8th Annual IEEE/SICE International Symposium on System Integration, SII 2015
CountryJapan
CityNagoya
Period15/12/1115/12/13

Fingerprint

Display devices
Trajectories
Feedback
Costs

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Sharma, P., Joshi, R. P., Boby, R. A., Saha, S. K., & Matsumaru, T. (2016). Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch. In 2015 IEEE/SICE International Symposium on System Integration, SII 2015 (pp. 795-800). [7405081] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SII.2015.7405081

Projectable interactive surface using microsoft kinect V2 : Recovering information from coarse data to detect touch. / Sharma, P.; Joshi, R. P.; Boby, R. A.; Saha, S. K.; Matsumaru, Takafumi.

2015 IEEE/SICE International Symposium on System Integration, SII 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 795-800 7405081.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sharma, P, Joshi, RP, Boby, RA, Saha, SK & Matsumaru, T 2016, Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch. in 2015 IEEE/SICE International Symposium on System Integration, SII 2015., 7405081, Institute of Electrical and Electronics Engineers Inc., pp. 795-800, 8th Annual IEEE/SICE International Symposium on System Integration, SII 2015, Nagoya, Japan, 15/12/11. https://doi.org/10.1109/SII.2015.7405081
Sharma P, Joshi RP, Boby RA, Saha SK, Matsumaru T. Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch. In 2015 IEEE/SICE International Symposium on System Integration, SII 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 795-800. 7405081 https://doi.org/10.1109/SII.2015.7405081
Sharma, P. ; Joshi, R. P. ; Boby, R. A. ; Saha, S. K. ; Matsumaru, Takafumi. / Projectable interactive surface using microsoft kinect V2 : Recovering information from coarse data to detect touch. 2015 IEEE/SICE International Symposium on System Integration, SII 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 795-800
@inproceedings{fddf7d7a528144878287512b18bd01ac,
title = "Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch",
abstract = "An Image-projective Desktop Varnamala Trainer (IDVT) called SAKSHAR has been designed to improve the learning by children through an interactive audio visual feedback system. This device uses a projector to render a virtual display, which permits production of large interactive displays with minimal cost. The user's hand is recognized with the help of a Microsoft Kinect Version 2. The entire system is portable, i.e., it can be projected on any planar surface. Since the Kinect does not give precise 3D coordinates of points for detecting a touch, a model of recognition of a touch purely based on the contact of the user's hand with the surface would not yield accurate results. We have instead modeled the touch action by using multiple points along the trajectory of the tracked point of the user's hand while hand makes contact with the surface. Fitting a curve through these points and analyzing the errors is used to make the detection of touch accurate.",
author = "P. Sharma and Joshi, {R. P.} and Boby, {R. A.} and Saha, {S. K.} and Takafumi Matsumaru",
year = "2016",
month = "2",
day = "10",
doi = "10.1109/SII.2015.7405081",
language = "English",
isbn = "9781467372428",
pages = "795--800",
booktitle = "2015 IEEE/SICE International Symposium on System Integration, SII 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Projectable interactive surface using microsoft kinect V2

T2 - Recovering information from coarse data to detect touch

AU - Sharma, P.

AU - Joshi, R. P.

AU - Boby, R. A.

AU - Saha, S. K.

AU - Matsumaru, Takafumi

PY - 2016/2/10

Y1 - 2016/2/10

N2 - An Image-projective Desktop Varnamala Trainer (IDVT) called SAKSHAR has been designed to improve the learning by children through an interactive audio visual feedback system. This device uses a projector to render a virtual display, which permits production of large interactive displays with minimal cost. The user's hand is recognized with the help of a Microsoft Kinect Version 2. The entire system is portable, i.e., it can be projected on any planar surface. Since the Kinect does not give precise 3D coordinates of points for detecting a touch, a model of recognition of a touch purely based on the contact of the user's hand with the surface would not yield accurate results. We have instead modeled the touch action by using multiple points along the trajectory of the tracked point of the user's hand while hand makes contact with the surface. Fitting a curve through these points and analyzing the errors is used to make the detection of touch accurate.

AB - An Image-projective Desktop Varnamala Trainer (IDVT) called SAKSHAR has been designed to improve the learning by children through an interactive audio visual feedback system. This device uses a projector to render a virtual display, which permits production of large interactive displays with minimal cost. The user's hand is recognized with the help of a Microsoft Kinect Version 2. The entire system is portable, i.e., it can be projected on any planar surface. Since the Kinect does not give precise 3D coordinates of points for detecting a touch, a model of recognition of a touch purely based on the contact of the user's hand with the surface would not yield accurate results. We have instead modeled the touch action by using multiple points along the trajectory of the tracked point of the user's hand while hand makes contact with the surface. Fitting a curve through these points and analyzing the errors is used to make the detection of touch accurate.

UR - http://www.scopus.com/inward/record.url?scp=84963782288&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84963782288&partnerID=8YFLogxK

U2 - 10.1109/SII.2015.7405081

DO - 10.1109/SII.2015.7405081

M3 - Conference contribution

AN - SCOPUS:84963782288

SN - 9781467372428

SP - 795

EP - 800

BT - 2015 IEEE/SICE International Symposium on System Integration, SII 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -