Case study · Human–machine interaction

Posture
Loop

A camera-based human–machine posture rehabilitation system.

Time

3 months
2024.12–2025.3

Team

Individual project
(Academic)

Tools

Python, OpenCV, MediaPipe Pose, NumPy, Pandas, scikit-learn, Flask, WebSocket, Processing

A webcam reads your skeleton and gives a short cue when you lean. No wearables, no clinic.

LIVE · BROWSER APP
The browser version tracking me as I shift and return to the middle.
01 · What it is

A loop, not a lecture

Strict correction makes people tune out. Posture Loop gives a short cue and lets you decide when to adjust.

1 · Camera sees you2 · Model reads posture3 · A short cue4 · You adjust
Supports physiotherapists, never replaces themOnly a camera, no wearablesYou lead, the system cues
02 · The problem

Posture drifts quietly

Hours at a desk slowly pull the body out of line. These four are the most common.

Leaning to one side43%
Uneven shoulders32%
Tilted hips25%
Head pushed forward
Today’s fixes need a clinica wearableor a lot of money
03 · How I solved it

Five steps, one camera

A 3-second calibration first sets your baseline, not an ideal body.

Cameralaptop or phone
33 keypointsMediaPipe Pose
3 anglesshoulder · hip · shift
Small modelbalanced · left · right
Cuescreen + voice
Three-second calibration capturing a personal baseline
Calibration in the browser app

Try the model: lean, and see what it says

Drag the sliders. It only speaks when it is sure.

Balanced
0%
Left-leaning
0%
Right-leaning
0%
🔈

Probabilities approximate the trained model using its training distributions.

04 · Result

Tested on me, then turned into practice

28 poses

Everyday and unusual poses. Filter by what the system said.

Test pose classified balancedbalanced
Test pose classified left-leaningleft_leaning
Test pose classified balancedbalanced
Test pose classified right-leaningright_leaning
Test pose classified balancedbalanced
Test pose classified left-leaningleft_leaning
Test pose classified right-leaningright_leaning
Test pose classified balancedbalanced
Test pose classified left-leaningleft_leaning
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified right-leaningright_leaning
Test pose classified right-leaningright_leaning
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified left-leaningleft_leaning
Test pose classified balancedbalanced
Test pose classified balancedbalanced
Test pose classified left-leaningleft_leaning
Test pose classified right-leaningright_leaning
Test pose classified left-leaningleft_leaning
Test pose classified balancedbalanced

19 minutes at a desk

One real session from the log. Scrub across it.

BalancedLeft-leaningRight-leaning
Scrub the timeline
0

samples logged

0%

time balanced

0

posture changes

0

voice prompts

About three prompts a minute: useful, but a lot of voice while working.

From watching to practicing

A short exercise in the browser. Nothing leaves your computer.

Runs the app’s real thresholds. Drag the figure sideways for five rounds.

Ready

Lateral Shift Practice

1/5

Stand in the middle

Pick a direction, then press Start.

Target progress0%

Simulated body; the real app uses a live camera.

Posture Loop browser app
Rounds completed5/5
Practice duration0:46
Alignment score83/100
Avg. shoulder tilt0.9°
Return-to-center error0.6% of frame
Round consistency0.5° variability

One recorded session · camera estimates, not a diagnosis.

Calibration clip
Calibrate · hold still for the baseline
Practice clip
Practice · shift, hold, return to the middle
Summary clip
Summary · results after five rounds
05 · What’s next

Where this could go

FEWER PROMPTS

Speak less, mean more

The log replays to 65 voice prompts in 19 minutes. Next: cue only when a lean lasts.

MORE POSTURES

Beyond left and right

The model reads sideways lean. Head-forward and tilted hips are the next classes.

MORE BODIES

Test with others

So far it was tested on me. Next: more people, with a physiotherapist in the loop.

Copyright © 2026 Anqi Wang