I'm Guillem, a robotics engineer building digital health tools with computer vision, wearables, machine learning and robotics.

Postdoctoral scholar at UC Irvine. I design, build and clinically validate movement-sensing tools, from on-device smartwatch algorithms to 3D body tracking from a single phone video, so rehabilitation can be measured at home.

7Papers
70+Study participants
5Health apps built
Guillem at his desk testing the ActiVary watch face on screen
01 — Computer vision

Single-camera 3D pose estimation.

Step 1 · Capture

A single smartphone recording

No markers, no sensors, no lab. One phone video of a patient reaching as far as they can in every direction.

Step 2 · Reconstruct

Body and hand pose in 3D

I use state-of-the-art monocular 3D models to track body and hand pose from a single camera, and benchmark and optimise the processing so the motion is stable and accurate.

Step 3 · Measure

Reachable workspace

A sphere around the shoulder is split into the clinical regions used in the validated reachable workspace test.

Step 4 · Score

A clinical score from a video

Every hand position is coloured by region, and the area covered becomes the reachable workspace score clinicians use in ALS, DMD and stroke.

Loading 3D replay · 0%
Q1 · upper medialQ2 · lower medial Q3 · upper lateralQ4 · lower lateralQ5 · behind
Drag to rotate · ⌘/Ctrl + scroll to zoom · double-click to resetDrag to rotate · pinch to zoom
ActiVary
02 — Wearables

Increasing arm movement with smart feedback.

Active time · GMAC

Complete the green ring.

Minutes of purposeful arm use, computed on the watch from 50 Hz accelerometry, worn on the affected side.

Wear time

Knows when it's on.

Off-body and heart-rate sensors detect wear, so missing data is never mistaken for inactivity.

Personal goals

Week 1 sets the bar.

A baseline week sets the goal at 125%, then it adapts: +10% when you hit it, -5% when you don't.

Haptic nudge

Below your goal? It buzzes.

After 30 inactive minutes the watch vibrates. In a 14-person stroke pilot, arm activity rose significantly in the 15 minutes after each nudge.

Guided exercises

Exercises on the wrist.

Personalised, diverse exploratory exercises, one tap away.

ADEM metric

Not just more. More diverse.

Kurtosis of wrist tilt measures how varied movement is, in real time, on the watch. Sensors 2024 ↗

Under the hood

High wear time, good usability.

9-week home pilot after stroke (BSN 2026). Java · Wear OS · Room · custom watch face. Paper ↗ GitHub ↗

03 — Projects

Things I've built.

2022 – nowUC Irvine · PhD & postdoc

Markerless reachable workspace with SAM 3D Body

Full 3D body mesh from a single phone video, scored with the clinical reachable workspace protocol for ALS, DMD and stroke studies.

PyTorchSAM 3D Bodythree.js

Smart glasses for movement analysis

Prototyping perception pipelines with foundation models on Ray-Ban Meta glasses: guided capture, cloud analytics and automatic range-of-motion reports.

Ray-Ban MetaFoundation modelsCloud

Benchmarking 3D hand tracking for dexterity

Critical evaluation of monocular 3D hand-tracking models against multi-iPhone 3D reconstruction, for hand-dexterity outcomes.

MediaPipeRTMPoseMulti-camera calibration

Proprio · iOS app for proprioception training ↗

AR game that trains finger proprioception with a single camera. Led usability testing with clinicians, designers and engineers through App Store release.

iOSUnityARUX researchLiveWell App Factory grant

OpenPoint · webcam proprioception test ↗

Point to a finger hidden by AR; computer vision measures the error. Full-stack web app, validated in 40 adults and 16 people post-stroke (Sensors 2024).

ReactFirebaseMediaPipe

Counting arm repetitions with IMUs ↗

iOS app and open benchmark of deterministic and learning-based repetition counters across exercise, daily-living and rehab datasets.

iOSIMUSignal processing

Rehab ChatBot

Cross-platform conversational app that guides stroke survivors to rehabilitation information, designed for behaviour change.

LLM APIsCross-platformConversational UX
2020 – 22MSc robotics · UPC & industry

RGB-D instance segmentation for bin picking

MSc thesis at Bitmetrics: fine-tuned vision models that fuse colour and depth, about 10% better segmentation for robotic picking.

RGB-DDeep learningCalibration

Classifying crutch gait with Kinect

Recognised the four most common crutch gait patterns from Kinect v2 skeletons with an SVM (87.8% accuracy).

KinectSVM

Frontier-based exploration

Custom exploration strategy for a laser-scanning mobile robot, compared with biggest- and closest-frontier methods.

SLAMMobile robots
Before 2020School & BSc · Barcelona, Colorado
04 — Papers

Published work.

Google Scholar ↗
2026ActiVary: A Consumer Smartwatch System for Promoting Active and Diverse Upper-Limb Movement After StrokeBSN 2026 · Porto, PortugalWearables↗ 2026Comparison of Reachable Workspace Capacity to Real-World Arm Use Performance: A Wearable Accelerometry Study on Chronic StrokeSensorsWearables↗ 2025A Home-Based Suite of Sensors for Monitoring and Improving Upper Extremity Proprioception After StrokeIEEE ICORR · Best Paper nomineeWearables · Robotics↗ 2025TapStrapGest: Elicitation and Recognition of Ring-based Multi-Finger GesturesProc. ACM on Human-Computer InteractionML · HCI↗ 2024Using a Webcam to Assess Upper Extremity Proprioception: Experimental Validation and Application to Persons Post StrokeSensorsVision↗ 2024Real-Time Sensing of Upper Extremity Movement Diversity Using Kurtosis Implemented on a SmartwatchSensorsWearables↗ 2024Democratizing arm proprioception assessment with a webcamIEEE Haptics SymposiumVision↗
05 — CV

Where I've been.

Awards & honours

Best Paper nomineeIEEE ICORR 2025
Balsells PhD FellowshipFull scholarship · UC Irvine · 2022
MAE Merit FellowshipMechanical & Aerospace Engineering · UC Irvine
LiveWell App Factory grantShepherd Center · Proprio app
Balsells Mobility ProgramBachelor's thesis at UCCS · 2020
2nd place, TAP sponsor challengeCU Boulder Hackathon · 2020
UPC Engineering Award17th edition · mind-controlled robotic arm
Youth Research Award ×2Generalitat de Catalunya · robotic arm · camera drone
"Character of the Future"Rotary Club prize