"Dive into the movie" audience-driven immersive experience in the story

    Research output: Contribution to journalArticle

    4 Citations (Scopus)

    Abstract

    "Dive into theMovie (DIM)" is a name of project to aim to realize a world innovative entertainment system which can provide an immersion experience into the story by giving a chance to audience to share an impression with his family or friends by watching a movie in which all audience can participate in the story as movie casts. To realize this system, several techniques to model and capture the personal characteristics instantly in face, body, gesture, hair and voice by combining computer graphics, computer vision and speech signal processing technique. Anyway, all of the modeling, casting, character synthesis, rendering and compositing processes have to be performed on real-time without any operator. In this paper, first a novel entertainment system, Future Cast System (FCS), is introduced which can create DIM movie with audience's participation by replacing the original roles' face in a pre-created CG movie with audiences' own highly realistic 3D CG faces. Then the effects of DIM movie on audience experience are evaluated subjectively. The result suggests that most of the participants are seeking for higher realism, impression and satisfaction by replacing not only face part but also body, hair and voice. The first experimental trial demonstration of FCS was performed at the Mitsui-Toshiba pavilion of the 2005 World Exposition in Aichi Japan. Then, 1,640,000 people have experienced this event during 6 months of exhibition and FCS became one of the most popular events at Expo.2005.

    Original languageEnglish
    Pages (from-to)1594-1603
    Number of pages10
    JournalIEICE Transactions on Information and Systems
    VolumeE91-D
    Issue number6
    DOIs
    Publication statusPublished - 2008 Jun

    Fingerprint

    Computer graphics
    Computer vision
    Signal processing
    Casting
    Demonstrations

    Keywords

    • Audience-driven movie
    • Facial modeling and animation
    • Immersive space
    • Innovative entertainment
    • Instant casting

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering
    • Software
    • Artificial Intelligence
    • Hardware and Architecture
    • Computer Vision and Pattern Recognition

    Cite this

    "Dive into the movie" audience-driven immersive experience in the story. / Morishima, Shigeo.

    In: IEICE Transactions on Information and Systems, Vol. E91-D, No. 6, 06.2008, p. 1594-1603.

    Research output: Contribution to journalArticle

    @article{7caf92d6ab614115a48e88ae9e08605b,
    title = "{"}Dive into the movie{"} audience-driven immersive experience in the story",
    abstract = "{"}Dive into theMovie (DIM){"} is a name of project to aim to realize a world innovative entertainment system which can provide an immersion experience into the story by giving a chance to audience to share an impression with his family or friends by watching a movie in which all audience can participate in the story as movie casts. To realize this system, several techniques to model and capture the personal characteristics instantly in face, body, gesture, hair and voice by combining computer graphics, computer vision and speech signal processing technique. Anyway, all of the modeling, casting, character synthesis, rendering and compositing processes have to be performed on real-time without any operator. In this paper, first a novel entertainment system, Future Cast System (FCS), is introduced which can create DIM movie with audience's participation by replacing the original roles' face in a pre-created CG movie with audiences' own highly realistic 3D CG faces. Then the effects of DIM movie on audience experience are evaluated subjectively. The result suggests that most of the participants are seeking for higher realism, impression and satisfaction by replacing not only face part but also body, hair and voice. The first experimental trial demonstration of FCS was performed at the Mitsui-Toshiba pavilion of the 2005 World Exposition in Aichi Japan. Then, 1,640,000 people have experienced this event during 6 months of exhibition and FCS became one of the most popular events at Expo.2005.",
    keywords = "Audience-driven movie, Facial modeling and animation, Immersive space, Innovative entertainment, Instant casting",
    author = "Shigeo Morishima",
    year = "2008",
    month = "6",
    doi = "10.1093/ietisy/e91-d.6.1594",
    language = "English",
    volume = "E91-D",
    pages = "1594--1603",
    journal = "IEICE Transactions on Information and Systems",
    issn = "0916-8532",
    publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
    number = "6",

    }

    TY - JOUR

    T1 - "Dive into the movie" audience-driven immersive experience in the story

    AU - Morishima, Shigeo

    PY - 2008/6

    Y1 - 2008/6

    N2 - "Dive into theMovie (DIM)" is a name of project to aim to realize a world innovative entertainment system which can provide an immersion experience into the story by giving a chance to audience to share an impression with his family or friends by watching a movie in which all audience can participate in the story as movie casts. To realize this system, several techniques to model and capture the personal characteristics instantly in face, body, gesture, hair and voice by combining computer graphics, computer vision and speech signal processing technique. Anyway, all of the modeling, casting, character synthesis, rendering and compositing processes have to be performed on real-time without any operator. In this paper, first a novel entertainment system, Future Cast System (FCS), is introduced which can create DIM movie with audience's participation by replacing the original roles' face in a pre-created CG movie with audiences' own highly realistic 3D CG faces. Then the effects of DIM movie on audience experience are evaluated subjectively. The result suggests that most of the participants are seeking for higher realism, impression and satisfaction by replacing not only face part but also body, hair and voice. The first experimental trial demonstration of FCS was performed at the Mitsui-Toshiba pavilion of the 2005 World Exposition in Aichi Japan. Then, 1,640,000 people have experienced this event during 6 months of exhibition and FCS became one of the most popular events at Expo.2005.

    AB - "Dive into theMovie (DIM)" is a name of project to aim to realize a world innovative entertainment system which can provide an immersion experience into the story by giving a chance to audience to share an impression with his family or friends by watching a movie in which all audience can participate in the story as movie casts. To realize this system, several techniques to model and capture the personal characteristics instantly in face, body, gesture, hair and voice by combining computer graphics, computer vision and speech signal processing technique. Anyway, all of the modeling, casting, character synthesis, rendering and compositing processes have to be performed on real-time without any operator. In this paper, first a novel entertainment system, Future Cast System (FCS), is introduced which can create DIM movie with audience's participation by replacing the original roles' face in a pre-created CG movie with audiences' own highly realistic 3D CG faces. Then the effects of DIM movie on audience experience are evaluated subjectively. The result suggests that most of the participants are seeking for higher realism, impression and satisfaction by replacing not only face part but also body, hair and voice. The first experimental trial demonstration of FCS was performed at the Mitsui-Toshiba pavilion of the 2005 World Exposition in Aichi Japan. Then, 1,640,000 people have experienced this event during 6 months of exhibition and FCS became one of the most popular events at Expo.2005.

    KW - Audience-driven movie

    KW - Facial modeling and animation

    KW - Immersive space

    KW - Innovative entertainment

    KW - Instant casting

    UR - http://www.scopus.com/inward/record.url?scp=68149164340&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=68149164340&partnerID=8YFLogxK

    U2 - 10.1093/ietisy/e91-d.6.1594

    DO - 10.1093/ietisy/e91-d.6.1594

    M3 - Article

    AN - SCOPUS:68149164340

    VL - E91-D

    SP - 1594

    EP - 1603

    JO - IEICE Transactions on Information and Systems

    JF - IEICE Transactions on Information and Systems

    SN - 0916-8532

    IS - 6

    ER -