Design and Implementation of Immersive Media System Based on Dynamic Projection Mapping and Gesture Recognition


KIPS Transactions on Software and Data Engineering, Vol. 9, No. 3, pp. 109-122, Mar. 2020
https://doi.org/10.3745/KTSDE.2020.9.3.109,   PDF Download:
Keywords: Dynamic Projection Mapping, Realistic Media, Augmented Reality, Drawing System
Abstract

In recent, projection mapping, which has attracted high attention in the field of realistic media, is regarded as a technology to increase the users’ immersion. However, most existing methods perform projection mapping on static objects. In this paper, we developed a technology to track the movements of users and dynamically map the media contents to the users' bodies. The projected media content is built by predefined gestures just using the user’s bare hands without the special devices. An interactive immersive media system has been implemented by integrating these dynamic projection mapping technologies and gesture-based drawing technologies. The proposed realistic media system recognizes the movements and open / closed states of the user 's hands, selects the functions necessary to draw a picture. The users can freely draw the picture by changing the color of the brush using the colors of any real objects. In addition, the user’s drawing is dynamically projected on the user’s body, allowing the user to design and wear his t-shirt in real-time.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
K. S. Joon, K. Y. Jin, Y. Choi, "Design and Implementation of Immersive Media System Based on Dynamic Projection Mapping and Gesture Recognition," KIPS Transactions on Software and Data Engineering, vol. 9, no. 3, pp. 109-122, 2020. DOI: https://doi.org/10.3745/KTSDE.2020.9.3.109.

[ACM Style]
Kim Sang Joon, Koh You Jin, and Yoo-Joo Choi. 2020. Design and Implementation of Immersive Media System Based on Dynamic Projection Mapping and Gesture Recognition. KIPS Transactions on Software and Data Engineering, 9, 3, (2020), 109-122. DOI: https://doi.org/10.3745/KTSDE.2020.9.3.109.