DOI: 10.11118/ecos2026_035
A UNIFIED FORMAT FOR AGGREGATING PRE-TRAINED POSE ESTIMATORS INTO CUSTOM HUMAN-SKELETON DATASETS
- Damian Sova1, Oldrich Trenz1
- 1 Department of Informatics, Faculty of Business and Economics, Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic
Human pose estimation works well on benchmark datasets but loses accuracy once a model is deployed on real footage with varying distances, crowds and occlusion. Building a labelled dataset for each new deployment is expensive, so this work asks whether existing pre-trained detectors can be combined to generate such a dataset cheaply, without retraining any of them. The proposed Unified Format runs three public detectors (PoseNet, MoveNet, MMPose), maps their native keypoints into one common 27-keypoint skeleton, matches detected people across models and fuses them by weighted average. The method was evaluated on the COCO WholeBody validation subset (2,693 images with humans, 11,004 ground-truth instances) using OKS, average percentage error and mean squared error. The fused skeleton provides usable positional localisation (APE 3.3%, MSE 1,213.84) and predicts slightly more pose instances than MMPose alone (70.39% vs 69.84%), but it remains weaker than MMPose on the main accuracy-oriented metrics (OKS 0.23 vs 0.28; correct keypoints 37.93% vs 43.62%). The result is an honest, reproducible tool chain rather than a new state of the art.
Keywords: human pose estimation, neural networks, dataset generation, data fusion, COCO WholeBody, OKS
pages: 323-329, online: 2026
References
- ALINEZHAD NOGHRE, G., DANESH PAZHO, A., SANCHEZ, J. 2022. ADG-Pose: Automated Dataset Generation for Real-World Human Pose Estimation. Cham: Springer International Publishing. ISBN 978-3-031-09282-4. https://doi.org/10.1007/978-3-031-09282-4_22
Go to original source... - BLAZEPOSE. 2020. BlazePose: On-device Real-time Body Pose Tracking. CVPR Workshop on Computer Vision for AR/VR. https://storage.googleapis.com/mediapipe-assets/Model%20Card%20BlazePose%20GHUM%203D.pdf
- COCO CONSORTIUM. 2024. COCO Dataset: Keypoints Evaluation. https://cocodataset.org/#keypoints-eval
- MMPOSE CONTRIBUTORS. 2020. OpenMMLab Pose Estimation Toolbox and Benchmark. https://github.com/open-mmlab/mmpose
- MOVENET. 2024. MoveNet: Efficient Human Pose Estimation in the Cloud and on Mobile. TensorFlow. https://www.tensorflow.org/hub/tutorials/movenet
- REN, S., HE, K., GIRSHICK, R. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv:1506.01497v3. https://doi.org/10.48550/arXiv.1506.01497
Go to original source... - SOVA, D. 2024. Automated neural network learning for higher accuracy human skeleton detection under realistic conditions. Master's thesis, head: Trenz, O. Brno: Mendel University in Brno.
- SUN, K., XIAO, B., LIU, D. 2019. Deep High-Resolution Representation Learning for Human Pose Estimation. arXiv: 1902.09212. https://arxiv.org/abs/1902.09212
Go to original source... - TOSHEV, A., SZEGEDY, C. 2014. DeepPose: Human Pose Estimation via Deep Neural Networks. In: IEEE CVPR. New York: IEEE. https://doi.org/10.1109/CVPR.2014.214
Go to original source... - XU, L., LIU, W., XU, J. 2022. ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild. IEEE TPAMI. https://github.com/jin-s13/COCO-WholeBody
- ZHANG, Y., CHEN, W. 2022. Decision-level information fusion powered human pose estimation. Applied Intelligence. 53, 2161-2172. https://doi.org/10.1007/s10489-022-03623-z
Go to original source... - ZHENG, C., WU, W., CHEN, C. 2020. Deep Learning-Based Human Pose Estimation: A Survey. ACM Computing Surveys. arXiv:2012.13392 https://doi.org/10.48550/arXiv.2012.13392
Go to original source...

