Skip to main content
  1. Home
  2. Computing
  3. Emerging Tech
  4. Features

AI fitness coach senses the muscle mechanics as you exercise and prevents rookie injuries

Most fitness apps offer encouragement dressed up as coaching, but BioCoach offers anatomy-specific corrections, and I could see it becoming a smartphone app real soon.

Add as a preferred source on Google
Woman exercises with her Apple Watch and Dexcom G7.
Dexcom

During the pandemic, the US Consumer Product Safety Commission recorded a 48% spike in at-home exercise injuries. You might think that the culprit was bad equipment, but it was bad form. People had no coach around to correct it.  

Researchers at Drexel University and Michigan State University have built a prototype that addresses exactly that problem, in real time, using your phone camera, and there’s real potential for it to become a legitimate fitness app in future (via Tech Xplore).

What is the system called and how does it work?

The system, called BioCoach, was presented at the Conference on Computer Vision and Pattern Recognition in June 2026. It uses AI and live video (via a camera) to watch you exercise, analyze your body mechanics, and deliver specific, biomechanics-based corrections. 

Recommended Videos

To do this, the system processes video through two parallel streams: first uses a 3D convolutional neural network to capture your visual appearance and body movement patterns, while the second reconstructs your skeleton in three dimensions, analyzing your joint angles, range of motion, and the phase of the movement you’re in. 

Before offering you feedback, BioCoach identifies which joints are most involved in the exercise you’re performing. For instance, if you’re performing push ups, it will specifically monitor your shoulders, elbows, and wrists, offering personalized corrections. 

And I’m not talking about the generic “keep your back straight” comments that most fitness apps offer. The prototype goes above and beyond, offering anatomically precise guidance like “increase elbow flexion to 90 degrees at the bottom.” 

How did it perform against the competition?

The research team has trained BioCoach on Qualcomm’s Exercise Video Dataset, with over 200 re-annotated videos and over 2,400 new notes, to teach BioCoach to explain not just what to fix, but why it matters.

BioCoach has already been tested against similar programs from Nvidia, ByteDance, Alibaba, Salesforce, OpenAI, and MIT, among others. It outperformed Stream-VLM, which is a program from MIT and Nvidia, on text quality and judged correctness. It showed improvements in anatomy-specific feedback accuracy as well.

For now, the system is still a prototype, but the team is working on adding the ability to estimate joint reaction forces and muscle activation patterns, all from a video feed. 

The research was supported by the National Science Foundation, and this is why I strongly believe that BioCoach could be developed in a revolutionary smartphone app, which offers personalized corrective measures and encourages the right form and posture, preventing painful injuries and sustainable workout programs for people, which works both indoors and outdoors.

BioCoach is more advanced than most AI-based fitness coaches available

To give you some context, both Apple Fitness+ and Mirror offer video-based workout programs, but the feedback is pre-recorded and not dynamic like what BioCoach offers.

Peloton’s hardware offers a Movement-Tracking Camera that counts reps and flags issues, but it requires dedicated equipment like Bike+, Tread+, or Row+, and doesn’t explain the reasoning behind the form corrections and how they can benefit you.

Similarly, Google’s Health Coach and Samsung Health analyze biometric signals like heart rate and activity cadence to suggest certain improvements, but they can’t see you moving, and therefore, don’t provide any guidance for your form.

BioCoach, in contrast, is the first system to combine 3D skeletal reconstruction with a language model that explains the mechanical consequence of each correction. If it ever reaches your phone as a consumer app, which I truly hope it does, it could make genuinely expert coaching accessible to anyone with a camera.

Shikhar Mehrotra
For more than five years, Shikhar has consistently simplified developments in the field of consumer tech and presented them…
The Mac Pro nearly received an M3 Extreme chip twice as powerful as M3 Ultra
High production costs likely killed Apple’s M3 Extreme plans
Apple's Mac Pro on a table at a press event.

Apple discontinued the Mac Pro earlier this year, ending a 20-year run for a computer that once represented the very best of the company’s desktop lineup. However, Apple reportedly had much bigger plans for the machine before ultimately replacing it with the Mac Studio.

According to Bloomberg’s Mark Gurman, Apple developed an M3 Extreme chip that could have offered twice as many CPU and GPU cores as the M3 Ultra. The processor was intended to sit above the Ultra tier and could have finally given the Mac Pro the performance advantage it badly needed. Apple eventually abandoned the chip due to concerns over production costs and limited demand for such an expensive machine.

Read more
Hidden prompts can secretly rewrite an AI’s memory, and researchers say that’s a serious problem
Researchers discover AI attack that rewrites an assistant's long-term memory
Chatbot on a smartphone.

Large language models are getting better at remembering us. Whether it's your preferred writing style, recurring tasks, shopping habits or project deadlines, AI assistants are increasingly storing long-term memories to make future conversations feel more personal and useful. But according to new research, that same feature could become one of AI's biggest security vulnerabilities.

Researchers from New Mexico State University have demonstrated a new attack called GhostWriter, capable of secretly planting false memories inside AI agents. Rather than stealing information outright, the attack manipulates what an AI remembers, potentially causing it to make dangerous decisions long after the original attack has taken place.

Read more
This experiment shows how easy it is to poison an open-weight AI model for under $100
This research raises new doubts about trusting open weight AI models.
Computer, Electronics, Laptop

Open-weight AI models have been having a moment lately. Just this month, Moonshot's massive Kimi K3 model landed close behind Claude Fable 5 and GPT 5.6 Sol in several benchmarks, all while remaining fully open-weight and downloadable by anyone.

However, Katie Paxton-Fear, a cybersecurity lecturer at Manchester Metropolitan University and staff security advocate at Semgrep, managed to poison an open-weight model and proved how easily that openness can be turned against you (via The Register).

Read more