NeuralX Motion Analytics Pipeline
We modeled 823 muscles with the musculoskeletal structure for the full-body human simulation. We referred to anatomy literature to create the model as accurately as possible and implemented the neuromuscular controller with multiple deep neural networks which mimic the structure of the human motor cortex. This enabled us to run the unprecedented musculoskeletal level movement analysis based on a 2D video feed taken by mobile phones. Our pipeline takes a 2D video as an input, and then, it applies our proprietary biomechanical vision to estimate the skeletal movement in the 3D space, and finally, the biomechanical human analysis is executed to analyze human movements as detail as possible. Please refer to the paper “Deep Learning of Biomimetic Sensorimotor Control for Biomechanical Human Animation”, which was presented at Siggraph 2018, for more details.
Motion Analytics and Motion Data Synthesis with Biomechanical Human Simulation
Here are examples of motion analytics at the musculoskeletal level, which is unprecedented. What is more interesting is that we can use such a simulator to synthesize various human movement datasets which we can feed to computer vision models to be trained as the human motion AI. The combination of this motion simulator and environment simulation brought us the generative AI which can synthesize the training dataset without manual data collection or annotations process.
The use case of our motion analytics AI and Generative AI workouts
Toned.ai is our motion analytics AI and generative AI use case, an affordable and cutting-edge AI-powered personal trainer. It offers customized workouts, daily generative classes, motion tracking, and personalized audio coaching. Our generative AI creates personalized workout content that changes daily based on the user's progress. We're leveraging ChatGPT and speech synthesis to deliver fully personalized audio coaching and a text-based interface for daily Q&A. We believe that everyone should have access to high-quality fitness coaching and we're using the latest AI tech to make it accessible to all. Toned's AI personal trainer is designed to help fitness enthusiasts worldwide achieve their goals and unleash their potential.
Check the app at Toned.ai!