Advanced optical feedback of redesigned focused augmented mirror-based facial makeup system

Ja Hu Ku, Jae Seok Jang, Soon Ki Jung

Research output: Contribution to journalArticlepeer-review

Abstract

This research began with the idea of using a mirror, which is common in our life, as a device of Augmented Reality (AR) to support the general service of facial makeup. Focused Augmented Mirror is a system of one-way mirrors with a certain degree of transparency in a certain direction, and a display behind them [1]. The mirror reflects original image of user on its surface, and the projected image from display behind of mirror merged on the surface of mirror, in order to provide an augmented image for user. This paper deals with optical feedback to minimize user's sense of incompatibility in facial makeup service using Focused Augmented Mirror. In the makeup section, there is a benefit obtained by blending users' original face image with the cloned original image converted in HSV format with edited hue & saturation, rather than blending with simple RGB plain data in make-up process. The Matching Position adjusts the position of the image output from the screen behind the mirror to overlap on the original image reflected on the mirror surface with the image of the user taken by the depth-camera. The Color Adjustment works for recovering the original color data, lost due to the transmittance characteristic of one-way mirror and the external environment factor. It measures the error in blended image on mirror surface with a separated camera when using the system for the first time, then it builds a feedback set that allows continuous color correction without additional camera. This study provides user-friendly services with three types of optical feedback that support Focused Augmented Mirror and presents directions of human stereo vision error correction, or more accurate color adjustment for advanced service.

Original languageEnglish
Pages (from-to)6427-6436
Number of pages10
JournalInformation
Volume20
Issue number9
StatePublished - Sep 2017

Keywords

  • Color Adjustment
  • Face-detection
  • Half-mirror
  • Virtual cosmetic

Fingerprint

Dive into the research topics of 'Advanced optical feedback of redesigned focused augmented mirror-based facial makeup system'. Together they form a unique fingerprint.

Cite this