This project presents a cross-media immersive gesture experience, including poster design and projection mapping of a gesture-based interactive motion graphic design. The physical performance in Peking Opera is a multidimensional art form filled with randomness and unpredictability.
The formal performance patterns in Peking Opera stem from its extensive cultural refinement and contribute to its cross-cultural transmission. However, the high complexity of singing and dialogue prevents the audience from easily experiencing the cultural depth and charm of the performance itself. My design aims to combine body movement and the use of the hand as a medium to restore fluidity and leverage the abstract and surreal sound experiences of Peking Opera performances, making them more personal and emotionally resonant.
The project designs the visual system of Peking Opera gestures by establishing a connection between sign language and Peking Opera performance. The icons and patterns on the folded poster are generated by the movement of hands through TouchDesigner, a motion-based software, which is realized with webcam tracking technology. This measure intends to transform the audience from mere spectators into active participants in the drama, engaging the human body in the performance. By integrating with their movements, as well as an abstract symbol design and real-time interaction, the audience becomes intimately engaged in Peking Opera performances. The low cognitive cost of gesture interaction allows audiences to limitlessly explore this cultural medium.