Realistic image synthesis of a deformable living thing based on motion understanding

Chil Woo Lee, Osamu Hasegawa, Wiwat Wongwarawipat, Hiroshi Dohi, Mitsuru Ishizuka

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This paper describes a system that can synthesize realistic sequential images of moving goldfish based on the image understanding result of real goldfish. To analyze and synthesize images in real-time, we have constructed a hardware system that consists of 32 paralell transputers with a high-speed visual-data interface called VIT (Visual Interface for Transpputer Network). The system is very flexible and powerful for various types of image processing because it can be extended according to the required computational cost. In the understanding process, we assume that the target object, a goldfish in this case, deforms its shape pliably in 3-D space and moves only in a two-dimensional direction. A modeling, called the Bone-Structured Solid Modeler, which is suitable for representing deformable objects such as living things, plays an important role in the understanding and synthesis processes of the deformable object. Three types of constraints for motion, namely, static, dynamic, and object, are utilized to verify the estimated pose and orientation of the object. In the motion synthesis process, realistic moving images are synthesized by controlling the model employing the motion understanding result. Simulation results are presented to show the effectiveness of the system. The technology discussed in this paper is expected to play a key role in the realization of future visual human interfaces.

Original languageEnglish
Pages (from-to)345-354
Number of pages10
JournalJournal of Visual Communication and Image Representation
Volume2
Issue number4
DOIs
Publication statusPublished - 1991
Externally publishedYes

Fingerprint

Image understanding
Transputers
Bone
Image processing
Hardware
Costs

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Electrical and Electronic Engineering

Cite this

Realistic image synthesis of a deformable living thing based on motion understanding. / Lee, Chil Woo; Hasegawa, Osamu; Wongwarawipat, Wiwat; Dohi, Hiroshi; Ishizuka, Mitsuru.

In: Journal of Visual Communication and Image Representation, Vol. 2, No. 4, 1991, p. 345-354.

Research output: Contribution to journalArticle

Lee, Chil Woo ; Hasegawa, Osamu ; Wongwarawipat, Wiwat ; Dohi, Hiroshi ; Ishizuka, Mitsuru. / Realistic image synthesis of a deformable living thing based on motion understanding. In: Journal of Visual Communication and Image Representation. 1991 ; Vol. 2, No. 4. pp. 345-354.
@article{5515701f69ae4459879e286097a6c7c7,
title = "Realistic image synthesis of a deformable living thing based on motion understanding",
abstract = "This paper describes a system that can synthesize realistic sequential images of moving goldfish based on the image understanding result of real goldfish. To analyze and synthesize images in real-time, we have constructed a hardware system that consists of 32 paralell transputers with a high-speed visual-data interface called VIT (Visual Interface for Transpputer Network). The system is very flexible and powerful for various types of image processing because it can be extended according to the required computational cost. In the understanding process, we assume that the target object, a goldfish in this case, deforms its shape pliably in 3-D space and moves only in a two-dimensional direction. A modeling, called the Bone-Structured Solid Modeler, which is suitable for representing deformable objects such as living things, plays an important role in the understanding and synthesis processes of the deformable object. Three types of constraints for motion, namely, static, dynamic, and object, are utilized to verify the estimated pose and orientation of the object. In the motion synthesis process, realistic moving images are synthesized by controlling the model employing the motion understanding result. Simulation results are presented to show the effectiveness of the system. The technology discussed in this paper is expected to play a key role in the realization of future visual human interfaces.",
author = "Lee, {Chil Woo} and Osamu Hasegawa and Wiwat Wongwarawipat and Hiroshi Dohi and Mitsuru Ishizuka",
year = "1991",
doi = "10.1016/1047-3203(91)90015-8",
language = "English",
volume = "2",
pages = "345--354",
journal = "Journal of Visual Communication and Image Representation",
issn = "1047-3203",
publisher = "Academic Press Inc.",
number = "4",

}

TY - JOUR

T1 - Realistic image synthesis of a deformable living thing based on motion understanding

AU - Lee, Chil Woo

AU - Hasegawa, Osamu

AU - Wongwarawipat, Wiwat

AU - Dohi, Hiroshi

AU - Ishizuka, Mitsuru

PY - 1991

Y1 - 1991

N2 - This paper describes a system that can synthesize realistic sequential images of moving goldfish based on the image understanding result of real goldfish. To analyze and synthesize images in real-time, we have constructed a hardware system that consists of 32 paralell transputers with a high-speed visual-data interface called VIT (Visual Interface for Transpputer Network). The system is very flexible and powerful for various types of image processing because it can be extended according to the required computational cost. In the understanding process, we assume that the target object, a goldfish in this case, deforms its shape pliably in 3-D space and moves only in a two-dimensional direction. A modeling, called the Bone-Structured Solid Modeler, which is suitable for representing deformable objects such as living things, plays an important role in the understanding and synthesis processes of the deformable object. Three types of constraints for motion, namely, static, dynamic, and object, are utilized to verify the estimated pose and orientation of the object. In the motion synthesis process, realistic moving images are synthesized by controlling the model employing the motion understanding result. Simulation results are presented to show the effectiveness of the system. The technology discussed in this paper is expected to play a key role in the realization of future visual human interfaces.

AB - This paper describes a system that can synthesize realistic sequential images of moving goldfish based on the image understanding result of real goldfish. To analyze and synthesize images in real-time, we have constructed a hardware system that consists of 32 paralell transputers with a high-speed visual-data interface called VIT (Visual Interface for Transpputer Network). The system is very flexible and powerful for various types of image processing because it can be extended according to the required computational cost. In the understanding process, we assume that the target object, a goldfish in this case, deforms its shape pliably in 3-D space and moves only in a two-dimensional direction. A modeling, called the Bone-Structured Solid Modeler, which is suitable for representing deformable objects such as living things, plays an important role in the understanding and synthesis processes of the deformable object. Three types of constraints for motion, namely, static, dynamic, and object, are utilized to verify the estimated pose and orientation of the object. In the motion synthesis process, realistic moving images are synthesized by controlling the model employing the motion understanding result. Simulation results are presented to show the effectiveness of the system. The technology discussed in this paper is expected to play a key role in the realization of future visual human interfaces.

UR - http://www.scopus.com/inward/record.url?scp=44949270370&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44949270370&partnerID=8YFLogxK

U2 - 10.1016/1047-3203(91)90015-8

DO - 10.1016/1047-3203(91)90015-8

M3 - Article

AN - SCOPUS:44949270370

VL - 2

SP - 345

EP - 354

JO - Journal of Visual Communication and Image Representation

JF - Journal of Visual Communication and Image Representation

SN - 1047-3203

IS - 4

ER -