Cornell's EchoMotion tracks your whole body using just a smartwatch's speaker and microphone

Researchers track whole body movement with just a smartwatch

Cornell's EchoMotion tracks your whole body using just a smartwatch's speaker and microphone

Cornell researchers built EchoMotion, which turns an off-the-shelf smartwatch into a sonar-like full-body tracker. Two speakers emit inaudible ultrasonic waves and the microphones read the echoes bouncing off your limbs, feeding a small AI model that predicts 12 joint positions. On an unmodified Samsung Galaxy Watch 6, average joint error was under four inches, dropping to about 2.4 inches after a one-time 12-minute calibration. It sips roughly 12 milliwatts and works on other watches without retraining.

In the very near future, with wearables like smartwatches or smartglasses, a personal agent will write a description of your whole day – what you did, what you ate. This project enables the body tracking part of that vision.
  1. kostarelo

    When I put my amazfit helios strap to record a workout of type Strength, it automatically tries to detect the movements I'm doing and figure out what muscles I'm working out. It actually works, not 100%, but it works. It tracks my pull ups, my push ups, my dips, really good. I was wondering how they do it but didn't look more into it.

    I'm sure other watches/trackers do that as well. It's really impressive what we can do with just a watch.

  2. thih9

    If you own an iPhone, go to Health app and scroll through your mobility stats. You'll find step length, double support time, walking asymmetry, etc.

    Apple released a document in 2022 where they documented these features[1], along with details on how they work. I guess next versions will have more accuracy.

    [1]: https://www.apple.com/healthcare/docs/site/Measuring_Walking... (PDF)

  3. qzervaas

    Not quite to the same level, but I've recently been working on something similar with my rowing app [1].

    The most common use-case is to get rowing data directly from a PM5 or FTMS rower using Bluetooth, but if you don't have a smart rower it uses Apple Watch motion to detect your strokes / stroke rate.

    It detects peaks on the pull, then ignores the recovery so it doesn't detect it as a second stroke.

    It adapts to how hard you're pulling as you go, so it picks up your strokes within the first few without any setup.

    Overall this works well for rowing, but obviously can't accurately work out distance / power etc.

    [1] Streaks Strokes: https://strokesrowing.com

  4. amelius

    Note: ultrasound for humans is not necessarily ultrasound for pets.

  5. _bent

    (How) would this handle multiple people using the same system being in vicinity (e.g. in the gym)? Wouldn't the speakers talk over each other?

More from this day

2026-11-16