When I put my amazfit helios strap to record a workout of type Strength, it automatically tries to detect the movements I'm doing and figure out what muscles I'm working out. It actually works, not 100%, but it works. It tracks my pull ups, my push ups, my dips, really good. I was wondering how they do it but didn't look more into it.
I'm sure other watches/trackers do that as well. It's really impressive what we can do with just a watch.
If you own an iPhone, go to Health app and scroll through your mobility stats. You'll find step length, double support time, walking asymmetry, etc.
Apple released a document in 2022 where they documented these features[1], along with details on how they work. I guess next versions will have more accuracy.
Similarly Garmin run watches [1] can tell ground contact time of each foot, your vertical oscillation and how much you slow down when you step down and speed up when you push off for each foot.
Not quite to the same level, but I've recently been working on something similar with my rowing app [1].
The most common use-case is to get rowing data directly from a PM5 or FTMS rower using Bluetooth, but if you don't have a smart rower it uses Apple Watch motion to detect your strokes / stroke rate.
It detects peaks on the pull, then ignores the recovery so it doesn't detect it as a second stroke.
It adapts to how hard you're pulling as you go, so it picks up your strokes within the first few without any setup.
Overall this works well for rowing, but obviously can't accurately work out distance / power etc.
Nice! I'm a Concept2 rower, what advantages does it have over the built-in software and ErgData app?
Also, you need to update your little rowing person animation at the top of the page; they're not hinging their hips enough and they're engaging their arms way too early. It's a silly little thing, but as someone who focuses on form it jumped out at me when I loaded the page.
>It's a silly little thing, but as someone who focuses on form it jumped out at me when I loaded the page.
I know exactly what you mean- In college I had to make sure I wasn't facing the ergs at the gym because my coxswain instinct was to go over and start yelling at them for "popping their knees"
I did something similar about ten years ago for sculling using the a mobile phone gyro to detect the scull's surge with each stroke to get a stroke rate. The code was based on an algorithm described in a paper I found online, but coded from scratch. I was rather proud of that. GPS gave an approximate speed.
The product is for the elderly. Humans loose access to the higher pitches as we age. The effect is rather dramatic. There were once ultrasound products meant to selectively dissuade young people from hanging around areas they were unwanted.
>> The Mosquito device, whose high-frequency shriek is audible only to those under around 25, has been bought by police, local councils, shops, and even private home owners, to tackle concerns over groups of young people congregating and causing disruption.
I must report that this "under 25" is not very accurate, at least with 30-40 I sense _something_ not necessarily really hearing anything but there is something my brain notices and its very annoying, I once rotate such a device in a hotel. outdoor restaurant because it was super annoying, apparently the thought keeping children out of that area.
I guess I'm unusual, because one of these devices used to drive me nuts by the entrance to a grocery store until I figured out why there was a high-pitched whine there. Or maybe the device was malfunctioning and working at a lower range. In any case, I'm definitely not under 25 and I think I can hear at least some of these devices.
Specifically, the left speaker transmits C-FMCW chirps sweeping from 18kHz to 21 kHz, while the right speaker transmits in the range of 21.5 kHz to 24.5 kHz. Each speaker transmitsC-FMCW chirps with = 600 samples per chirp. With a 50 kHz sampling rate, the sweep period for each chirpis 600/50000 = 0.012 sec (12 milliseconds). Assuming a speed of sound of 343 m/s at room temperature (20◦C),and following the formula provided in 2, the resolution of the EchoMotion sensing system is approximately 0.343cm (or 3.43 mm), and the sensing range is about 205.8 cm (approximately 2 m).
Such an interesting direction, especially for older adults. I hope I live to see the day when devices like this can genuinely help our aging parents stay active and exercise safely, even in remote areas where access to a qualified trainer is limited.
Nah, they will all be frail, some earlier, some later.
It will be more the age of robots. Just look at Asia
with that and you can see that they shape the future
there, not just China - really, Asia. It's a bit sad
to see how the USA and Europe decline in comparison
here.
I bet it could technically detect breathing issues like sleep apnea but they shy away from any wording that would resemble a medical diagnosis, which would immediately trigger regulatory approvals like for ECG features.
In theory you can extract respiration from RSA and possibly even by looking closely at a chest-based EEG but if you want dependable results you want a strap that can feel the pull on your chest or a radar pointed at it or something.
When you attempt biofeedback in the 1970s paradigm (look at the biosignal in real time and extend your brain’s sensorimotor maps) as compared to the 2020s paradigm (sit with a $300 device for 3 minutes, get some score and say “gee whizz!” you learn right away that many biosensors are a joke.
So its taking accelerometer data from a watch, and using it to predict body position with a model trained on whole body motion as measured by ultrasound. neat.
No, from the article: “ It uses the built-in speaker and microphone on a commercial smartwatch to determine a person’s body position using a sonar-like sensing system.” The move to commercial smartwatches uses just their single speaker and mic, rather than their custom unit they built that had dual speakers and mics.
We could argue that the age of computing before about 2005 was the teenage years of the PC and before 2018-2020 was the teenage years for mobile devices.
Look at the rates of improvements since. For general computing they're marginal for the average person, maybe a tripling of performance every 15 years, which isn't nothing but it's also not life changing.
I.mean, follows the same principle of a Nintendo Switch/Wii controller? Games like Just Dance require certain movements and these are tracked with the Joycons
When I put my amazfit helios strap to record a workout of type Strength, it automatically tries to detect the movements I'm doing and figure out what muscles I'm working out. It actually works, not 100%, but it works. It tracks my pull ups, my push ups, my dips, really good. I was wondering how they do it but didn't look more into it.
I'm sure other watches/trackers do that as well. It's really impressive what we can do with just a watch.
If you own an iPhone, go to Health app and scroll through your mobility stats. You'll find step length, double support time, walking asymmetry, etc.
Apple released a document in 2022 where they documented these features[1], along with details on how they work. I guess next versions will have more accuracy.
[1]: https://www.apple.com/healthcare/docs/site/Measuring_Walking... (PDF)
Similarly Garmin run watches [1] can tell ground contact time of each foot, your vertical oscillation and how much you slow down when you step down and speed up when you push off for each foot.
[1] https://www.garmin.com/en-US/garmin-technology/running-scien...
[EDIT]: I think a chest HR monitor is also needed for some of those measurements
Not quite to the same level, but I've recently been working on something similar with my rowing app [1].
The most common use-case is to get rowing data directly from a PM5 or FTMS rower using Bluetooth, but if you don't have a smart rower it uses Apple Watch motion to detect your strokes / stroke rate.
It detects peaks on the pull, then ignores the recovery so it doesn't detect it as a second stroke.
It adapts to how hard you're pulling as you go, so it picks up your strokes within the first few without any setup.
Overall this works well for rowing, but obviously can't accurately work out distance / power etc.
[1] Streaks Strokes: https://strokesrowing.com
Nice! I'm a Concept2 rower, what advantages does it have over the built-in software and ErgData app?
Also, you need to update your little rowing person animation at the top of the page; they're not hinging their hips enough and they're engaging their arms way too early. It's a silly little thing, but as someone who focuses on form it jumped out at me when I loaded the page.
>It's a silly little thing, but as someone who focuses on form it jumped out at me when I loaded the page.
I know exactly what you mean- In college I had to make sure I wasn't facing the ergs at the gym because my coxswain instinct was to go over and start yelling at them for "popping their knees"
I did something similar about ten years ago for sculling using the a mobile phone gyro to detect the scull's surge with each stroke to get a stroke rate. The code was based on an algorithm described in a paper I found online, but coded from scratch. I was rather proud of that. GPS gave an approximate speed.
Note: ultrasound for humans is not necessarily ultrasound for pets.
And not necessarily for humans in this case, it emits from 18kHz to 24.5kHz. Completely within hearing range for most mammals (https://en.wikipedia.org/wiki/Hearing_range)
The product is for the elderly. Humans loose access to the higher pitches as we age. The effect is rather dramatic. There were once ultrasound products meant to selectively dissuade young people from hanging around areas they were unwanted.
https://www.theguardian.com/uk/2007/mar/17/society.humanrigh...
>> The Mosquito device, whose high-frequency shriek is audible only to those under around 25, has been bought by police, local councils, shops, and even private home owners, to tackle concerns over groups of young people congregating and causing disruption.
[Insert appropriate Abe Simpson clip.]
I must report that this "under 25" is not very accurate, at least with 30-40 I sense _something_ not necessarily really hearing anything but there is something my brain notices and its very annoying, I once rotate such a device in a hotel. outdoor restaurant because it was super annoying, apparently the thought keeping children out of that area.
I'm in my 40s and I can hear those "under 25" sounds.
I guess I'm unusual, because one of these devices used to drive me nuts by the entrance to a grocery store until I figured out why there was a high-pitched whine there. Or maybe the device was malfunctioning and working at a lower range. In any case, I'm definitely not under 25 and I think I can hear at least some of these devices.
(How) would this handle multiple people using the same system being in vicinity (e.g. in the gym)? Wouldn't the speakers talk over each other?
How does this work when there are multiple in the room? Does each device have its own signature so it will detect only its "waves"?
Not passive, noise pollution.
https://dl.acm.org/doi/epdf/10.1145/3832001This was done with existing watch speakers and microphones. Wouldn’t ultrasound-specific speakers work better and be inaudible?
Are these loud? If so I could imagine having many people wearing these would be unbearable. I can hear very well to about 20-21kHz.
Such an interesting direction, especially for older adults. I hope I live to see the day when devices like this can genuinely help our aging parents stay active and exercise safely, even in remote areas where access to a qualified trainer is limited.
Nah, they will all be frail, some earlier, some later.
It will be more the age of robots. Just look at Asia with that and you can see that they shape the future there, not just China - really, Asia. It's a bit sad to see how the USA and Europe decline in comparison here.
> Just look at Asia with that and you can see that they shape the future there, not just China - really, Asia.
Any non demo tech that's widely used there?
Perhaps we can now finally have a way to measure respiratory rate using a smartwatch.
I'd have imagined that light-based heart monitoring (PPG) would discern 2 fluctuating signals - pulse, and respiration.
Can't finger-tip pulse-ox monitors detect respiration derived fluctuations in oxygenation? A very brief search suggests one can.
I suspect you want a comparison of both respiratory effort and effect, however.
Respiration rate is definitely a metric that shows up in Garmin during both activities and sleep using the HR sensor via respiratory sinus arrythmia.
https://support.garmin.com/en-US/?faq=2yEgS0Pax53UDqUH7q4WC6
It gets further enhanced into breathing variations during sleep tracking if you enable the SpO2 sensor.
https://support.garmin.com/en-US/?faq=efzfZVuaKM8fLFgE36jvG9
I bet it could technically detect breathing issues like sleep apnea but they shy away from any wording that would resemble a medical diagnosis, which would immediately trigger regulatory approvals like for ECG features.
In theory you can extract respiration from RSA and possibly even by looking closely at a chest-based EEG but if you want dependable results you want a strap that can feel the pull on your chest or a radar pointed at it or something.
When you attempt biofeedback in the 1970s paradigm (look at the biosignal in real time and extend your brain’s sensorimotor maps) as compared to the 2020s paradigm (sit with a $300 device for 3 minutes, get some score and say “gee whizz!” you learn right away that many biosensors are a joke.
So its taking accelerometer data from a watch, and using it to predict body position with a model trained on whole body motion as measured by ultrasound. neat.
No, from the article: “ It uses the built-in speaker and microphone on a commercial smartwatch to determine a person’s body position using a sonar-like sensing system.” The move to commercial smartwatches uses just their single speaker and mic, rather than their custom unit they built that had dual speakers and mics.
I know this is an unpopular opinion, but this is bad for privacy especially in the hands of Big Tech.
It's quite interesting in that tiny devices are almost like ... average computers in the 1990s era. Or even better than that, now.
We could argue that the age of computing before about 2005 was the teenage years of the PC and before 2018-2020 was the teenage years for mobile devices.
Look at the rates of improvements since. For general computing they're marginal for the average person, maybe a tripling of performance every 15 years, which isn't nothing but it's also not life changing.
I.mean, follows the same principle of a Nintendo Switch/Wii controller? Games like Just Dance require certain movements and these are tracked with the Joycons
This intends to track the whole body by just the watch, not one 9-axis IMU each on every tracked parts.
Wii required positioning with IR emitters for certain motions. Not sure about switch.
Also this is fundamentally different — those were motion sensors, this is ultrasonic position sensing — more like sonar than gyroscopes.
one good recommend to keep spatial position accurate an such controllers, is to keep teleporting yourself against the drift! /j