Background
Have you ever considered how body is related to space?
Body Theater explores how our bodies shape our experiences in physical and digital spaces, focusing on the connection between body, cognition, and interaction.
Goal
Your body could be more interactive!
Create a unique sensory experience by linking the body's motions with auditory stimuli and visual effect to deepen engagement.
Potential Impact
You'll have better perception about body.
Offer innovative ways for artistic expression and immersive experiences, enhancing our understanding of how the body influences perception and interaction.
Duration
September - December 2021
4 months
Type
Interaction Design
New Media Art
My Roles
Interaction Design
Kinect Develop
Tools
Kinect, Kinect Studio
VS Code, Max
What is Body Theater?
"
Regain the rhythm of the body, engage in a physical performance, and have a conversation with oneself.
"
Body Moovement to Sound
Compiling music based on dance, establishing connections between dance movements and auditory stimuli, linking the curves and movements in the human body with the melodies and rhythms in music.
Body Moovement to Visual
Syncing movements with visuals to create imagery through motion, matching appropriate visuals to human body movements.
Turn on
the music
Innovative
Why do we want to discuss body?
Discussing the body is vital to understand its impact on cognition and interaction, especially how it shapes our experiences and perceptions in both digital and physical spaces. This includes examining how bodily presence influences cognitive processes and cultural expressions, fostering deeper engagement and participation.
A Key Absence of Body
In an era dominated by screens, the body itself and its interaction are 'neglected.' Those of us who are constantly in the 'audience role' are merely 'observers' in both listening and seeing.
Embodied Cognition
Highlighting the body's role in organismic cognition, movement, sensations, and experiences shape our perception of the world. Our cognition is molded by the body and its activities.
The Body
Theater
In theater, everyone is both audience and actor, breaking body passivity for deeper engagement. It lets all create music, visuals, and connect with their soul through their bodies.
How To Build A Body Theter?
Design Space
Experience Journey
1/
Choose Music
Participants choose the music they would interact with from our database.
2/
Explore Logic
Participants explore the space, discovering interaction patterns.
3/
Enjoy Creation
Participants' actions overlay with real-time generated music and visuals.
4/
Loop
New visual and auditory stimuli affect participants, cycling continuously.
Body Movement Mapping
Technological Path
Step1
Ableton Live 10 Suite
Create musical stimulation
Step3
Kinect Studio
Record and edit body position/ color/ speed information
Step5
Max
Generate music and interactive visuals according to the rules
Step2
Kinect
Recording body images based on musical movements
Step4
Visual Studio
Write code to extract key body information and write it into a csv file
Technological Path Detail
1/
Ableton Live 10 Suite
The music used to assist the user in listening to the dance is edited here.
4/
Visual Studio Code
Using Visual Studio Code to read Kinect's .xef file, parsing out skeletal information and depth information of the human body, then parsing the data into .csv format, and feeding it into Max for interaction.
2.3/
Kinect Kinect Studio
Kinect captures the user's rich movements and recognizes them according to the above rules
Max
Classifying Kinect skeletal nodes and depth information. Controlling sound effects (volume, delay, sine wave values, vibration depth/level) with Max MSP. Controlling visual effects with Max Jitter.
5/
Behind the Scene
