Hi5✋: Synthetic Data for Inclusive, Robust, Hand Pose Estimation

Dataset Download:

• Link: Download Link (Link contain's author's institution)

Unity Game Engine Project

• Same dropbox link above, Hi5_Unity_Project.zip
• For game engine project setup, please follow unity-setup-guide.md

Data Augmentation

• The data_processing/ directory contains code for processing, and augmenting the synthetic data.

Training Code

• For Training and Evaluation, please use ViTPose repository: https://github.com/ViTAE-Transformer/ViTPose
• Please follow the training and evaluation instructions from the repository.
• To reproduce our results, add the content in the config files to ViTPose/configs/hand/2d_kpt_sview_rgb_img/topdown_heatmap/
• Exact command line arguments used in this study can be seen in terminal commands.md file.
• Trained checkpoints in Dropbox

Other datasets

• OneHand10K: https://www.yangangwang.com/papers/WANG-MCC-2018-10.html
• 11k hands: https://sites.google.com/view/11khands

Hand Assets

• Male: https://assetstore.unity.com/packages/3d/characters/humanoids/leap-motion-realistic-male-hands-109961
• Female: https://assetstore.unity.com/packages/3d/characters/humanoids/leap-motion-realistic-female-hands-211090