Posted on: September 25, 2023
mediapipe2osc is a Javascript solution for sending mediapipe landmark coordinates via UDP as OSC messages to any application that can receive them such as Unity, Unreal, Ableton Live, Max and more. Offers the potential to control and manipluate data, audio and visual output using body, hand or face detection and positional tracking.
This solution uses the osc.js library and builds on monlim’s MediaPipe-Hands-OSC to include face and body detection and tracking.
Current capabilities include:
You can download the repo from here.
Overall, mediapipe2osc aims to provide a quick, low-cost and accessible way to incorporate human detection, tracking and embodied interactional technology into creative projects.