A deep learning-augmented smart mirror to enhance fitness training
Credit: Lanza et al.

In recent years, engineers and computer scientists have created a wide range of technological tools that can enhance fitness training experiences, including smart watches, fitness trackers, sweat-resistant earphones or headphones, smart home gym equipment and smartphone applications. New state-of-the-art computational models, particularly deep learning algorithms, have the potential to improve these tools further, so that they can better meet the needs of individual users.

Researchers at University of Brescia in Italy have recently developed a computer vision system for a smart mirror that could improve the effectiveness of fitness training both in home and gym environments. This system, introduced in a paper published by the International Society of Biomechanics in Sports, is based on a deep learning algorithm trained to recognize human gestures in video recordings.

“Our commercial partner ABHorizon invented the concept of a product that can guide and teach you during your personal fitness training,” Bernardo Lanza, one of the researchers who carried out the study, told TechXplore. “This device can show you the best way to train based on your specific needs. To develop this device further, they asked us to investigate the viability of an integrated vision system for exercise evaluation.”


Coordinates of these joints are used to determine the phases of exercise and count repetitions. The smart mirror shows the user with the joints involved in the exercise. The researchers render the joints based on the exercise type. Credit: Lanza et al.

The low-cost computer vision system developed by Lanza and his colleagues utilizes a skeletonization algorithm (i.e., a deep learning algorithm that can attain skeletons from images), running on an embedded Nvidia Jetson Nano device with two fisheye cameras. As part of their study, the researchers trained this system to process and detect human movements in the video footage captured by the two fisheye cameras.

“A vision system, like the one we developed, can extract information from images by means of an AI algorithm,” Lanza said. “Our most recent paper demonstrates the accuracy of our system in measuring arm movements in simple fitness exercises, such as biceps curls.”

In one of their previous studies, the researchers presented a software design that could be used to create a comprehensive prototype of the smart fitness mirror envisioned by AB-Horizon. Their goal was to produce a device with production costs, a high performance, and a low energy consumption.

A deep learning-augmented smart mirror to enhance fitness training
Evolution of the elbow angle during a biceps curl exercise. On the y-axis we can see the value of the elbow angle, performing different phases of the exercise (folding from 180 ° to 0°/ standing 0° / opening). Credit: Lanza et al.

“The main advantage of our system is the absence of objects in contact with the user,” Lanza explained. “With cameras and AI applications, we understand and assess body motion, detect postural errors, and analyze simple fitness exercises. Nowadays our system analysis is based on simple body variables (elbow angle, hand position…) but we are working to improve the evaluation capability of the machine.”

The smart mirror that Lanza and his colleagues are helping to design would ideally be able to evaluate fitness exercises similarly to human personal trainers or in even more comprehensive ways. For instance, it could allow users to keep count of repetitions they performed for specific exercises, while also detecting the fundamental motion (e.g., traction, flection, rotation, etc.) of different body parts.

All fitness related information detected and calculated by the mirror is displayed on it, changing in real-time, so that users can keep track of it during workouts or use it to improve their training performance. Lanza and his colleagues evaluated their computer vision system in a series of tests, particularly focusing on its ability to track and make fitness predictions while users were performing biceps curls.

“We evaluated the accuracy of the vision system in understanding the different phases of an exercise,” Lanza said. “In traditional biomechanical analyses, the specific accuracy of our measurements is not acceptable, but we analyze a whole time series of body kinematics. This approach allows us to detect and understand fitness exercises and their peculiarities.”

The researchers found that with well-designed and calibrated software, their low-cost vision system could offer valuable fitness-related data while users performed simple fitness exercises. When integrated into the smart mirror created by AB-Horizon, the new system could significantly help users who are training without a supervising coach in both home and gym environments.

So far, the Lanza and his colleagues primarily evaluated their system’s performance on its own. However, they are now creating a prototype that would display the results of their system’s analyses on a smart mirror screen integrated into a motorized gymnastics machine.

“For this project, we collaborated with AB-Horizon, our commercial partner,” Lanza added. “In addition to designing the gym machinery, our partner will integrate the vision system with their prototype. Their experience in the fitness industry allows us to develop our software using athletic principles and a personal trainer from the company also guides us through the testing process. As part of future developments, an intelligent evaluator will detect the exercise.”

The intelligent evaluator that Lanza and his colleagues are working on should be able to interpret qualitative information by analyzing raw body kinematic data. To train this model, therefore, the researchers will first be collecting large amounts of data during fitness tests with both athletes and less-experienced fitness trainees. More information: Bernardo Lanza, Cristina Nuzzi, Simone Pasinetti, Matteo Lancini, Deep learning for gesture recognition in gym training performed by a vision-based augmented reality smart mirror, 40th International Society of Biomechanics in Sports Conference, Liverpool, UK: July 19–23, 2022. commons.nmu.edu/isbs/vol40/iss1/87/

© 2022 Science X Network

Citation: A deep learning-augmented smart mirror to enhance fitness training (2022, September 13) retrieved 13 September 2022 from https://techxplore.com/news/2022-09-deep-learning-augmented-smart-mirror.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

NEWS RELATED

Connexion satellite sur les smartphones Apple et Huawei: qu’est-ce que c’est exactement ?

Cette semaine, Apple et Huawei ont présenté deux nouveaux smartphones ; l’iPhone 14 et le Mate 50. Parmi leurs nombreuses fonctionnalités, une se démarque plus que les autres : leur connexion satellite. Une fonctionnalité annoncée comme révolutionnaire et qui devrait, à terme, devenir la norme, mais en quoi consiste-t-elle exactement ? En ...

View more: Connexion satellite sur les smartphones Apple et Huawei: qu’est-ce que c’est exactement ?

Torna Smart and coop, il bando che premia le idee imprenditoriali innovative da realizzare

Torna Smart and coop, il bando che premia le idee imprenditoriali innovative da realizzare Arezzo, 13 settembre 2022 – Torna Smart and coop, il bando che premia le idee imprenditoriali innovative da realizzare in forma cooperativa. La nuova edizione del bando, promosso da Fondazione CR Firenze, Legacoop Toscana e Fondazione NOI-Legacoop Toscana, si ...

View more: Torna Smart and coop, il bando che premia le idee imprenditoriali innovative da realizzare

Duh! Dua ASN di Jateng Ketahuan Berbuat Mesum di Mobil, Direkam di Smartphone

Sepasang kekasih yang tertangkap saat berbuat asusila di dalam mobil dihadirkan saat pers rilis di Polrestabes Semarang, Selasa. [ANTARA/ I.C.Senjaya] SuaraJawaTengah.id – Polrestabes Semarang mengamankan sepasang ASN di lingkungan Pemerintah Provinsi Jawa Tengah yang tertangkap basah berbuat asusila di dalam sebuah mobil di kawasan Marina, Kota Semarang. “Keduanya ini ...

View more: Duh! Dua ASN di Jateng Ketahuan Berbuat Mesum di Mobil, Direkam di Smartphone

Nothing Phone (1) Claimed To Be The Top Selling Android Smartphone Around Rs 30,000 In India: Report

Nothing Phone (1) Claimed To Be The Top Selling Android Smartphone Around Rs 30,000 In India: Report The Indian smartphone market has seen a plethora of smartphones launching around the Rs 30,000 price bracket lately but a few have intrigued interest like the Nothing Phone (1) has. Speaking to ...

View more: Nothing Phone (1) Claimed To Be The Top Selling Android Smartphone Around Rs 30,000 In India: Report

Tinggal Selangkah Lagi, Konsep Smart City di Bekasi Bakal Segera Terealisasi

ILUSTRASI – Gubernur Anies Baswedan di ruang Jakarta Smart City, Balai Kota DKI, Jakarta Pusat, Kamis (19/10/2017). [suara.com/Bowo Raharjo] SuaraBekaci.id – Asisten Daerah III Kabupaten Bekasi Jaoharul Alam mengatakan program pengembangan wilayah yang mengusung konsep smart city atau kota pintar di wilayahnya dipastikan terealisasi pada 2022. Menurutnya, realisasi pengembangan ...

View more: Tinggal Selangkah Lagi, Konsep Smart City di Bekasi Bakal Segera Terealisasi

Smart City Kabupaten Bekasi Akan Direalisasikan Tahun Ini

Ilustrasi Smart City. [Tumisu/Pixabay] Suara.com – Program pengembangan wilayah yang mengusung konsep smart city atau kota pintar di Kabupaten Bekasi akan terealisasi pada tahun ini. Namun, hal ini masih menunggu penandatanganan kesepakatan dengan Kementerian Kominfo. “Tinggal selangkah lagi,  September ini kami melakukan penandatanganan nota kesepahaman dengan Kementerian Kominfo terkait ...

View more: Smart City Kabupaten Bekasi Akan Direalisasikan Tahun Ini

New smart driving licence testing centres at Gautrain stations get thumbs up

Pretoria – Gautrain motorists have taken to social media to express positive experiences and efficiency at the new driving licence testing centres. The new innovative and advanced licensing centres were launched in Gauteng by the Road Traffic Management Corporation (RTMC) and the Department of Public Transport and Roads Infrastructure. To ...

View more: New smart driving licence testing centres at Gautrain stations get thumbs up

Virgil van Dijk 'has clearly been smarting' over criticism despite having received 'enough praise to get him to the moon', claims ESPN's Craig Burley... but co-pundit Steve Nicol insists the Liverpool defender has a right to be 'prickly'

Virgil van Dijk has hit back at pundits who have criticized his Liverpool sideThe Reds were blasted for their shocking performance against Napoli last weekThe defender spoke after Jurgen Klopp's side bounced back with a win over AjaxESPN's Craig Burley suggested Van Dijk could not handle the negative reaction

View more: Virgil van Dijk 'has clearly been smarting' over criticism despite having received 'enough praise to get him to the moon', claims ESPN's Craig Burley... but co-pundit Steve Nicol insists the Liverpool defender has a right to be 'prickly'

Huawei Partners with Kasetsart University on Smart University Development to Facilitate Innovations Driving Thailand’s Digital Economy

Nuevo sistema de alertas a smartphones en México: todos los equipos deberán permitir los mensajes de alerta con vibración y sonido únicos

Ban na smartfony w szkole? Badania sugerują, że to dobry pomysł. Na Zachodzie już się zaczęło

Dal Superbonus allo smart working: le misure del decreto Aiuti bis

Smart working fino al 31 dicembre per i fragili e per chi ha figli under 14

iQOO Neo 7 5G Could Join the 120W Fast Charging Smartphone Club

Smart working prorogato per i fragili. Bonus bollette e pensioni: tutte le misure del decreto Aiuti Bis

Smart Eye and OMNIVISION announce next generation automotive interior sensing solution that satisfies GSR and Euro NCAP requirements

Smartphone brands ramp up offline play with experience centres, doorstep services before festive season

When AI is not smart enough for the job

Saldão do Cliente: 5 Smart TVs para você maratonar a sua saga favorita em casa com qualidade de imagem

Lavoro, smart working per fragili e genitori di under-14 fino al 31 dicembre

OTHER NEWS

Breaking thailand news, thai news, thailand news Verified News Story Network