Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
3D Pose Estimation and Time-Series Classification for Distinguishing Normal and Fatigued States.: Smart-phone based approach
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.
2025 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesisAlternative title
3D-poseuppskattning och tidsserieklassificering för att skilja mellan normala och utmattade tillstånd : Smartphone-baserad metod (Swedish)
Abstract [en]

Background: Subtle shifts in gait, such as slower steps or reduced joint angles,often signal fatigue but are difficult to detect without costly sensors or lab-grademotion-capture systems.Objectives: This thesis develops a video-based fatigue detection system using consumer smartphones, aiming to make motion analysis accessible. Specifically, we aimto:• Capture synchronized multi-angle videos using three smartphones;• Extract 2D keypoints with MMPose HRNet and reconstruct 3D poses usingSemGCN;• Compute kinematic features (joint velocities, accelerations, angles);• Train machine learning models (Conv1D-BiLSTM and RandomForest-GradientBoosting)to classify normal vs. fatigued gait and predict fatigue scores.Method: Volunteers walked normally and after fatiguing exercise while three smartphones recorded from different angles. We synchronized the video streams, extracted 2D keypoints using MMPose HRNet, and reconstructed 3D joint tracks withSemGCN. Kinematic features were calculated and segmented into 20-frame windows,feeding into a Conv1D-BiLSTM network and a RandomForest-GradientBoosting ensemble. Models were trained with 4-fold stratified cross-validation, early stopping,and learning-rate scheduling. Performance was evaluated via classification accuracyand mean absolute error (MAE) for fatigue scores, with robustness tested undervarying lighting and camera positions.Results: The Conv1D-BiLSTM model achieved 83.7% accuracy (±1.8%) and MAE= 2.6 on a 0–5 fatigue scale. The RandomForest-GradientBoosting ensemble achieved93.1% accuracy (±1.5%) and MAE = 1.9. Ablation studies showed kinematic features improved accuracy by up to 7%, and performance remained stable (within 7%)under lighting and angle variations.Conclusion: Using only smartphones and open-source tools, our pipeline reliablydetects fatigued gait and quantifies fatigue levels, enabling accessible health trackingfor occupational safety, sports, and rehabilitation.Keywords: 3D pose estimation, fatigue detection, MMPose HRNet, SemGCN, BiLSTM, Random Forest, smartphone video, kinematic features.

Place, publisher, year, edition, pages
2025. , p. 37
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:bth-28298OAI: oai:DiVA.org:bth-28298DiVA, id: diva2:1981297
Subject / course
DV1478 Bachelor Thesis in Computer Science
Educational program
DVGDT Bachelor Qualification Plan in Computer Science 60.0 hp
Supervisors
Available from: 2025-07-04 Created: 2025-07-03 Last updated: 2025-09-30Bibliographically approved

Open Access in DiVA

fulltext(2433 kB)353 downloads
File information
File name FULLTEXT01.pdfFile size 2433 kBChecksum SHA-512
3a75cc82131180706b0b14430e9ce83c96c96e3fa0f9e6bc032554121c24d01a6b2dbda1f4bc163b6bc6931d32db72a4d3426de2521238f3f0c37aebeb3bda01
Type fulltextMimetype application/pdf

By organisation
Department of Computer Science
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 355 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 479 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf