A curated list of related resources for hand pose estimation. Feel free to contribute!
- Evaluation
- arXiv Papers
- Journal Papers
- Conference Papers
- Theses
- Datasets
- Workshops
- Challenges
- Other Related Papers
* indicates equal contribution
See folder evaluation to get more details about performance evaluation for hand pose estimation.
• [arXiv:2112.02753] MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image. [PDF] [Code]
Xingyu Chen, Yufeng Liu, Yajiao Dong, Xiong Zhang, Chongyang Ma, Yanmin Xiong, Yuan Zhang, Xiaoyan Guo
• [arXiv:2111.06500] Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation. [PDF]
John Yang, Yash Bhalgat, Simyung Chang, Fatih Porikli, Nojun Kwak
• [arXiv:2109.14744] The Object at Hand: Automated Editing for Mixed Reality Video Guidance from Hand-Object Interactions. [PDF]
Yao Lu, Walterio W. Mayol-Cuevas
• [arXiv:2109.14657] Understanding Egocentric Hand-Object Interactions from Hand Pose Estimation. [PDF]
Yao Lu, Walterio W. Mayol-Cuevas
• [arXiv:2109.11747] A Multi-View Video-Based 3D Hand Pose Estimation. [PDF]
Leyla Khaleghi, Alireza Sepas Moghaddam, Joshua Marshall, Ali Etemad
• [arXiv:2109.05488] ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis [PDF] [Code]
Kailin Li, Lixin Yang, Xinyu Zhan, Jun Lv, Wenqiang Xu, Jiefeng Li, Cewu Lu
• [arXiv:2108.13995] Realistic Hands: A Hybrid Model for 3D Hand Reconstruction. [PDF] [Project]
Michael Seeber, Martin R. Oswald, Roi Poranne
• [arXiv:2108.07044] Towards unconstrained joint hand-object reconstruction from RGB videos. [PDF] [Project] [Code]
Yana Hasson, Gül Varol, Ivan Laptev, Cordelia Schmid
• [arXiv:2107.00887] HO-3D_v3: Improving the Accuracy of Hand-Object Annotations of the HO-3D Dataset. [PDF]
Shreyas Hampali, Sayan Deb Sarkar, Vincent Lepetit
• [arXiv:2106.05954] Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation. [PDF]
Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Jan Kautz, Otmar Hilliges
• [arXiv:2106.04324] Contrastive Representation Learning for Hand Shape Estimation. [PDF] [Project] [Code] [Data]
Christian Zimmermann, Max Argus, Thomas Brox
• [arXiv:2104.14639] HandsFormer: Keypoint Transformer for Monocular 3D Pose Estimation ofHands and Object in Interaction. [PDF]
Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, Vincent Lepetit
• [arXiv:2102.07067] FastHand: Fast Hand Pose Estimation From A Monocular Camera. [PDF]
Shan An, Xiajie Zhang, Dong Wei, Haogang Zhu, Jianyu Yang, Konstantinos A. Tsintotas
• [arXiv:2012.11260] Unsupervised Domain Adaptation with Temporal-Consistent Self-Training for 3D Hand-Object Joint Reconstruction. [PDF]
Mengshi Qi, Edoardo Remelli, Mathieu Salzmann, Pascal Fua
• [arXiv:2008.08324] FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration. [PDF] [Project]
Yu Rong, Takaaki Shiratori, Hanbyul Joo
• [arXiv:2006.05927] Recent Advances in 3D Object and Hand Pose Estimation. [PDF]
Vincent Lepetit
• [arXiv:2001.08047] Attention! A Lightweight 2D Hand Pose Estimation Approach. [PDF]
Nicholas Santavas, Ioannis Kansizoglou, Loukas Bampis, Evangelos Karakasis, Antonios Gasteratos
• [arXiv:2001.00702] HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. [PDF] [Code]
Zhaohui Zhang, Shipeng Xie, Mingxiu Chen, Haichao Zhu
• [arXiv:1912.12436] Silhouette-Net: 3D Hand Pose Estimation from Silhouettes. [PDF]
Kuo-Wei Lee, Shih-Hung Liu, Hwann-Tzong Chen, Koichi Ito
• [arXiv:1911.12501] An End-to-end Framework for Unconstrained Monocular 3D Hand Pose Estimation. [PDF]
Sanjeev Sharma, Shaoli Huang, Dacheng Tao
• [arXiv:1912.01875] GraphPoseGAN: 3D Hand Pose Estimation from a Monocular RGB Image via Adversarial Learning on Graphs. [PDF]
Yiming He, Wei Hu, Siyuan Yang, Xiaochao Qu, Pengfei Wan, Zongming Guo
• [arXiv:1911.07424] Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation. [PDF]
Cheol-hwan Yoo, Seung-wook Kim, Seo-won Ji, Yong-goo Shin, Sung-jea Ko
• [arXiv:1807.00898] Model-based Hand Pose Estimation for Generalized Hand Shape with Appearance Normalization. [PDF]
Jan Wöhlke, Shile Li, Dongheui Lee
• [arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]
Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez
• [arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project]
Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang
• [arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]
Yu Zhang, Chi Xu, Li Cheng
• [2021 TPAMI] HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks. [PDF]
Jameel Malik, Soshi Shimada, Ahmed Elhayek, Sk Aziz Ali, Christian Theobalt, Vladislav Golyanik, Didier Stricker
• [2020 TPAMI] 3D Hand Pose Estimation Using Synthetic Data and Weakly Labeled RGB Images. [PDF]
Yujun Cai, Liuhao Ge, Jianfei Cai, Nadia Magnenat-Thalmann, Junsong Yuan
Markus Oberweger, Paul Wohlhart, Vincent Lepetit
• [2019 TPAMI] Feature Boosting Network For 3D Pose Estimation. [PDF]
Jun Liu, Henghui Ding, Amir Shahroudy, Ling-Yu Duan, Xudong Jiang, Gang Wang, Alex C. Kot
• [2018 TPAMI] Opening the Black Box: Hierarchical Sampling Optimization for Hand Pose Estimation. [PDF]
Danhang Tang*, Qi Ye*, Shanxin Yuan, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton
• [2018 IJCV] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges. [PDF] [Project] [Code]
James Steven Supančič III, Grégory Rogez, Yi Yang, Jamie Shotton, Deva Ramanan
• [2018 TPAMI] Real-time 3D Hand Pose Estimation with 3D Convolutional Neural Networks. [PDF]
Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann
• [2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. [PDF] [Project]
Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng
• [2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses. [PDF]
Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim
• [2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. [PDF] [Project]
Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, Juergen Gall
Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng
• [2021 TIP] Hand Pose Understanding with Large-Scale Photo-Realistic Rendering Dataset. [PDF]
Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui, Ping Tan, Liang Chang, Hongan Wang
• [2021 TIP] Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusion. [PDF]
Yujin Chen, Zhigang Tu, Di Kang, Ruizhi Chen, Linchao Bao, Zhengyou Zhang, Junsong Yuan
• [2021 Neurocomputing] Spatial-aware Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]
Pengfei Ren, Haifeng Sun, Weiting Huang, Jiachang hao, Daixuan Cheng, Qi Qi, Jingyu Wang, Jianxin Liao
• [2021 TMM] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation. [PDF] [Code]
Xingyuan Zhang, Fuhai Zhang
• [2020 TIP] Weakly-supervised Learning for Single Depth based Hand Shape Recovery. [PDF]
Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma, Hongan Wang
• [2020 Signal Process Image Commun] Accurate 3D Hand Pose Estimation Network Utilizing Joints Information. [PDF]
Xiongquan Zhang; Shiliang Huang; Zhongfu Ye
• [2020 TCSVT] Improve Regression Network on Depth Hand Pose Estimation with Auxiliary Variable. [PDF]
Lu Xu, Chen Hu, Ji’an Tao, Jianru Xue, Kuizhi Mei
• [2020 TVCG] 3D Hand Tracking in the Presence of Excessive Motion Blur. [PDF]
Gabyong Park, Antonis Argyros, Juyoung Lee, Woontack Woo
• [2019 Computers & Graphics] Simple and effective deep hand shape and pose regression from a single depth image. [PDF]
Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Didier Stricker
• [2019 TIP] SRHandNet: Real-time 2D Hand Pose Estimation with Simultaneous Region Localization. [PDF] [Project]
Yangang Wang, Baowen Zhang, Cong Peng
• [2019 Sensors] WHSP-Net: A Weakly-Supervised Approach for 3D Hand Shape and Pose Recovery from a Single Depth Image. [PDF]
Jameel Malik*, Ahmed Elhayek*, Didier Stricker
Yafei Gao*, Yida Wang*, Pietro Falco, Nassir Navab, Federico Tombari
• [2018 PR] A Survey on 3D Hand Pose Estimation: Cameras, Methods, and Datasets. [PDF]
Rui Li, Zhenyu Liu, Jianrong Tan
• [2018 Neurocomputing] A CRNN module for hand pose estimation. [PDF]
Zhongxu Hu, Youmin Hu, Jie Liu, Bo Wu, Dongmin Han, Thomas Kurfess
Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla
• [2018 TCSVT] Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image. [PDF] [Project] [Code]
Yangang Wang, Cong Peng and Yebin Liu
• [2018 IVC] Top-down model fitting for hand pose recovery in sequences of depth images. [PDF]
Meysam Madadi, Sergio Escalera, Alex Carruesco, Carlos Andujar, Xavier Baró, Jordi Gonzàlez
• [2018 TCYB] Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images. [PDF]
Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu
• [2018 IEEE Access] SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds. [PDF] [Project]
Xinghao Chen, Guijin Wang, Cairong Zhang, Tae-Kyun Kim, Xiangyang Ji
• [2018 Neurocomputing] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF] [Project] [Code]
Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang
• [2018 PR] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]
Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu
• [2018 TIP] Robust 3D Hand Pose Estimation from Single Depth Images using Multi-View CNNs. [PDF]
Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann
• [2018 JVCI] Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]
Guijin Wang, Xinghao Chen*, Hengkai Guo*, Cairong Zhang
• [2017 TCYB] Hough Forest with Optimized Leaves for Global Hand Pose Estimation with Arbitrary Postures. [PDF]
Hui Liang, Junsong Yuan, J. Lee, Liuhao Ge and Daniel Thalmann
• [2017 TCSVT] Robust RGB-D Hand Tracking Using Deep Learning Priors. [PDF]
Jordi Sanchez-Riera, Kathiravan Srinivasan, Kai-Lung Hua, Wen-Huang Cheng, M. Anwar Hossain, and Mohammed F. Alhamid
• [2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning. [PDF]
Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor
• [2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression. [PDF]
Damien Foururea, Rémi Emonet, Elisa Fromont, Damien Muselet, Natalia Neverova, Alain Trémeaua, Christian Wolf
• [2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation. [PDF] [Project]
Philip Krejov, Andrew Gilbert, Richard Bowden
• [2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations. [PDF]
Hui Liang, Junsong Yuan, Daniel Thalmann
Hui Liang, Junsong Yuan, Daniel Thalmann
• Toward Human-Like Grasp: Dexterous Grasping via Semantic Representation of Object-Hand. [PDF]
Tianqiang Zhu, Rina Wu, Xiangbo Lin, Yi Sun
• Self-Supervised Transfer Learning for Hand Mesh Recovery From Binocular Images. [PDF]
Zheng Chen, Sihan Wang, Yi Sun, Xiaohong Ma
• Self-Supervised 3D Hand Pose Estimation from monocular RGB via Contrastive Learning. [PDF] (Oral)
Adrian Spurr, Aneesh Dahiya, Xucong Zhang, Xi Wang, Otmar Hilliges
Xiao Tang, Tianyu Wang, Chi-Wing Fu
Viktor Rudnev, Vladislav Golyanik, Jiayi Wang, Hans-Peter Seidel, Franziska Mueller, Mohamed Elgharib, Christian Theobalt
Zhe Cao*, Ilija Radosavovic*, Angjoo Kanazawa, Jitendra Malik
• HandFoldingNet: A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeleton. [PDF] [Code]
Wencan Cheng, Jae Hyun Park, Jong Hwan Ko
• H2O: Two Hands Manipulating Objects for First Person Interaction Recognition. [PDF] [Project] [Code]
Taein Kwon, Bugra Tekin, Jan Stuhmer, Federica Bogo, Marc Pollefeys
• I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling. [PDF]
Ping Chen, Yujin Chen, Dong Yang, Fangyin Wu, Qin Li, Qingpei Xia, Yong Tan
• SemiHand: Semi-supervised Hand Pose Estimation with Consistency. [PDF]
Linlin Yang, Shicheng Chen, Angela Yao
• End-to-End Detection and Pose Estimation of Two Interacting Hands. [PDF]
Donguk Kim, Kwang In Kim, Seungryul Baek
Hanwen Jiang, Shaowei Liu, Jiashun Wang, Xiaolong Wang
Xiong Zhang, Hongsheng Huang, Jianchao Tan, Hongmin Xu, Cheng Yang, Guozhu Peng, Lei Wang, Ji Liu
Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Jiefeng Li, Cewu Lu
• TravelNet: Self-supervised Physically Plausible Hand Motion Learning from Monocular Color Images. [PDF]
Zimeng Zhao, Xi Zhao and Yangang Wang
• Interacting Two-Hand 3D Pose and Shape Reconstruction from Single Color Image. [PDF] [Project] [Code]
Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma and Hongan Wang
• Removing the Bias of Integral Pose Regression. [PDF]
Kerui Gu, Linlin Yang, Angela Yao
• Monocular Real-time Full Body Capture with Inter-part Correlations. [PDF]
Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, Feng Xu
Kevin Lin, Lijuan Wang, Zicheng Liu
Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox
Evonne Ng, Hanbyul Joo, Shiry Ginosar, Trevor Darrell
• Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration. [PDF]
Xingyu Chen, Yufeng Liu, Chongyang Ma, Jianlong Chang, Huayan Wang, Tian Chen, Xiaoyan Guo, Pengfei Wan, Wen Zheng
• Model-based 3D Hand Reconstruction via Self-Supervised Learning. [PDF]
Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ying Zhang, Xuefei Zhe, Ruizhi Chen, Junsong Yuan
Shaowei Liu*, Hanwen Jiang*, Jiarui Xu, Sifei Liu, Xiaolong Wang
• [2021 3DV] A Skeleton-Driven Neural Occupancy Representation for Articulated Hands. [PDF] [Project] [Code] (Oral)
Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges, Siyu Tang
• [2021 3DV] Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation. [PDF] [Project] [Code] (Oral)
Zicong Fan, Adrian Spurr, Muhammed Kocabas, Siyu Tang, Michael J. Black, Otmar Hilliges
• [2021 DICTA] Semi-Supervised 3D Hand Shape and Pose Estimation with Label Propagation. [PDF]
Samira Kaviani, Amir Rahimi, Richard Hartley
• [2021 BMVC] Joint-Aware Regression: Rethinking Regression-Based Method for 3D Hand Pose Estimation. [PDF]
Xiaozheng Zheng, Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi and Jianxin Liao
Ziwei Yu, Linlin Yang, Shicheng Chen and Angela Yao
Jun Lv, Wenqiang Xu, Lixin Yang, Sucheng Qian, Chongzhao Mao, Cewu Lu
• [2021 BMVC] Multi-view Image-based Hand Geometry Refinement using Differentiable Monte Carlo Ray Tracing. [PDF]
Giorgos Karvounas, Nikolaos Kyriazis, Iason Oikonomidis, Aggeliki Tsoli, Antonis A. Argyros
• [2021 SIGGRAPH] ManipNet: Neural Manipulation Synthesis with a Hand-Object Spatial Representation. [PDF] [Code]
He Zhang, Yuting Ye, Takaaki Shiratori, Taku Komura
• [2021 SIGGRAPH] Single Depth View-Based Real-time Reconstruction of Hand-object Interactions. [PDF]
Hao Zhang, Yuxiao Zhou, Yifei Tian, Jun-Hai Yong, Feng Xu
Qiang Zhang, Yunzhu Li, Yiyue Luo, Wan Shou, Michael Foshey, Junchi Yan, Joshua B. Tenenbaum, Wojciech Matusik, Antonio Torralba
Moran Li, Yuan Gao, Nong Sang
Razvan Caramalau, Binod Bhattarai, Tae-Kyun Kim
Fanqing Lin, Connor Wilhelm, Tony Martinez
• [2021 WACV] MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation. [PDF]
Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie
• [2021 WACV] Temporal-Aware Self-Supervised Learning for 3D Hand Pose and Mesh Estimation in Videos. [PDF]
Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie
• [2021 PETRA] Weakly-supervised hand part segmentation from depth images. [PDF]
Mohammad Rezaei, Farnaz Farahanipad, Alex Dillhoff, Ramez Elmasri, Vassilis Athitsos
• [2021 PETRA] A Pipeline for Hand 2-D Keypoint Localization Using Unpaired Image to Image Translation. [PDF]
Farnaz Farahanipad, Mohammad Rezaei, Alex Dillhoff, Farhad Kamangar, Vassilis Athitsos
Omid Taheri, Nima Ghorbani, Michael J. Black, Dimitrios Tzionas
Vasileios Choutas, Georgios Pavlakos, Timo Bolkart, Dimitrios Tzionas , Michael J. Black
• The Phong Surface: Efficient 3D Model Fitting using Lifted Optimization. [PDF] (Oral)
Jingjing Shen, Thomas J. Cashman, Qi Ye, Tim Hutton, Toby Sharp, Federica Bogo, Andrew William Fitzgibbon, Jamie Shotton
Sheng Jin, Lumin Xu, Jin Xu, Can Wang, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo
• Dual Grid Net: hand mesh vertex regression from single depth maps. [PDF]
Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao
• Hand-Transformer: Non-Autoregressive Structured Modeling for 3D Hand Pose Estimation. [PDF]
Lin Huang, Jianchao Tan, Ji Liu, and Junsong Yuan
Samarth Brahmbhatt, Chengcheng Tang, Chris Twigg, Charles C. Kemp, and James Hays
• SeqHAND: RGB-Sequence-Based 3D Hand Pose and Shape Estimation. [PDF]
John Yang, Hyung Jin Chang, Seungeui Lee, Nojun Kwak
• HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalizationm. [PDF] [Project]
Neng Qian, Jiayi Wang, Franziska Mueller, Florian Bernard, Vladislav Golyanik, Christian Theobalt
• JGR-P2O: Joint Graph Reasoning based Pixel-to-Offset Prediction Network for 3D Hand Pose Estimation from a Single Depth Image. [PDF] [Code] (Spotlight)
Linpu Fang, Xingyan Liu, Li Liu, Hang Xu, Wenxiong Kang
• Adaptive Computationally Efficient Network for Monocular 3D Hand Pose Estimation. [PDF] (Spotlight)
Zhipeng Fan, Jun Liu, Yao Wang
• Collaborative Learning of Gesture Recognition and 3D Hand Pose Estimation with Multi-Order Feature Analysis. [PDF] (Spotlight)
Siyuan Yang, Jun Liu, Shijian Lu, Meng Hwa Er, Alex C. Kot
• DeepHandMesh: Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modeling from a Single RGB Image. [PDF] [Project] (Oral)
Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee
• InterHand2.6M: A New Large-scale Dataset and Baseline for 3D Single and Interacting Hand Pose Estimation from a Single RGB Image. [PDF] [Project] [Code]
Gyeongsik Moon, Shoou-i Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee
• I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image. [PDF] [Code]
Gyeongsik Moon, Kyoung Mu Lee
• Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints. [PDF]
Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz
• Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction. [PDF] [Code]
Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, MingXiu Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, Haifeng Sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Linlin Yang, Dongheui Lee, Angela Yao, Weiguo Zhou, Sijia Mei, Yunhui Liu, Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Philippe Weinzaepfel, Romain Brégier, Gregory Rogez, Vincent Lepetit, Tae-Kyun Kim
• Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild. [PDF] [Project] (Oral) (Paper Award Nominees)
Dominik Kulon, Riza Alp Güler, Iasonas Kokkinos, Michael Bronstein, Stefanos Zafeiriou
• Weakly-supervised Domain Adaptation via GAN and Mesh Model for Estimating 3D Hand Poses Interacting Objects. [PDF] [Code] (Oral) (Paper Award Nominees)
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim
• GanHand: Predicting Human Grasp Affordances in Multi-Object Scenes. [PDF]
Enric Corona, Albert Pumarola, Guillem Alenya, Francesc Moreno-Noguer, Gregory Rogez
• Cross-Modal Variational Alignment of Latent Spaces. [PDF]
Thomas Theodoridis, Theocharis Chatzis, Vassilios Solachidis, Kosmas Dimitropoulos, Petros Daras
Zhixuan Yu*, Jae Shin Yoon*, Prashanth Venkatesh, Jaesik Park, Jihun Yu, Hyun Soo Park
Yihui He*, Rui Yan*, Shoou-I Yu, Katerina Fragkiadaki
• HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map. [PDF]
Jameel Malik, Ibrahim Abdelaziz, Ahmed Elhayek, Soshi Shimada, Sk Aziz Ali, Vladislav Golyanik, Christian Theobalt, Didier Stricker
• Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge. [PDF]
Long Zhao, Xi Peng, Yuxiao Chen, Mubbasir Kapadia, Dimitris N. Metaxas
• Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstruction. [PDF] [Project] [Code]
Yana Hasson, Bugra Tekin, Federica Bogo, Ivan Laptev, Marc Pollefeys, Cordelia Schmid
Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu
Bardia Doosti, Shujon Naha, David Crandall, Majid Mirbagheri
Shreyas Hampali, Mahdi Rad, Markus Oberweger, Vincent Lepetit
• [2020 ICRA] Robust, Occlusion-aware Pose Estimation for Objects Grasped by Adaptive Hands . [PDF] [Code]
Bowen Wen, Chaitanya Mitash, Sruthi Soorian, Andrew Kimmel, Avishai Sintov, Kostas E. Bekris
• [2020 CVPRW] MediaPipe Hands: On-device Real-time Hand Tracking. [PDF]
Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, Matthias Grundmann
• [2020 ISMAR] 3D Hand Pose Estimation with a Single Infrared Camera via Domain Transfer Learning. [PDF]
Gabyong Park, Tae-Kyun Kim, Woontack Woo
• [2020 ISMAR] Bare-hand Depth Inpainting for 3D Tracking of Hand Interacting with Object. [PDF]
Woojin Cho, Gabyong Park, Woontack Woo
• [2020 3DV] Grasping Field: Learning Implicit Representations for Human Grasps. [PDF] [Code] (Best Paper Award)
Korrawe Karunratanakul, Jinlong Yang, Yan Zhang, Michael Black, Krikamol Muandet, Siyu Tang
• [2020 UIST] DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera. [PDF] [Project] [Code]
Keunwoo Park, Sunbum Kim, Youngwoo Yoon, Tae-Kyun Kim, Geehyuk Lee
Breannan Smith, Chenglei Wu, He Wen, Patrick Peluse, Yaser Sheikh, Jessica Hodgins, Takaaki Shiratori
• [2020 SIGGRAPH Asia] RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video. [PDF] [Project]
Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, and Christian Theobalt
• [2020 SIGGRAPH] MEgATrack: Monochrome Egocentric Articulated Hand-Tracking for Virtual Reality. [PDF]
Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D. Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, Asaf Nitzan, Gang Dong, Yuting Ye, Lingling Tao, Chengde Wan, Robert Wang
• [2020 MM] MM-Hand: 3D-Aware Multi-Modal Guided Hand Generation for 3D Hand Pose Synthesis. [PDF] [Code]
Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan
• [2020 MM] Adaptive Wasserstein Hourglass for Weakly Supervised Hand Pose Estimation from Monocular RGB. [PDF]
Yumeng Zhang, Li Chen, Yufeng Liu, Junhai Yong, Wen Zheng
• [2020 MM] HOT-Net: Non-Autoregressive Transformer for 3D Hand-Object Pose Estimation. [PDF]
Lin Huang, Jianchao Tan, Jingjing Meng, Ji Liu, and Junsong Yuan
• [2020 BMVC] PMD-Net: Privileged Modality Distillation Network for 3D Hand Pose Estimation from a Single RGB Image. [PDF]
Kewen Wang and Xilin Chen
• [2020 BMVC] SIA-GCN: A Spatial Information Aware Graph Neural Network with 2D Convolutions for Hand Pose Estimation. [PDF]
Deying Kong, Haoyu Ma and Xiaohui Xie
• [2020 BMVC] Explicit Knowledge Distillation for 3D Hand Pose Estimation from Monocular RGB. [PDF]
Yumeng Zhang, Li Chen, Yufeng Liu, Wen Zheng and JunHai Yong
• [2020 BMVC] BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networks. [PDF] [Code]
Lixin Yang, Jiasen Li, Wenqiang Xu, Yiqun Diao, Cewu Lu
• [2020 Ubicomp] FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. [PDF] (ECCV 2020 Demo Award Nominee)
Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang
• [2020 FG] Hand tracking from monocular RGB with dense semantic labels. [PDF]
Peter Thompson, Aphrodite Galata
• [2020 FG] Generative Model-Based Loss to the Rescue: A Method to Overcome Annotation Errors for Depth-Based Hand Pose Estimation. [PDF]
Jiayi Wang, Franziska Mueller, Florian Bernard, Christian Theobalt
• [2020 IROS] Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning. [PDF]
Guillermo Garcia-Hernando, Edward Johns, Tae-Kyun Kim
• [2020 CHI] Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor. [PDF]
Kazuyuki Arimatsu, Hideki Mori
Weiting Huang, Pengfei Ren, Jingyu Wang, Qi Qi, Haifeng Sun
• [2020 WACV] Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation. [PDF] [Code]
Yifei Chen*, Haoyu Ma*, Deying Kong, Xiangyi Yan, Jianbao Wu, Wei Fan, Xiaohui Xie
• [2020 WACV] 3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space. [PDF]
Jiajun Gu, Zhiyong Wang, Wanli Ouyang, Weichen Zhang, Jiafeng Li, Li Zhuo
• [2020 WACV] DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images in 3D Hand Pose Estimation. [PDF]
Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Wei Fan, Xiaohui Xie
• [2020 WACV] Rotation-invariant Mixed Graphical Model Network for 2D Hand Pose Estimation. [PDF]
Deying Kong, Haoyu Ma, Yifei Chen, Xiaohui Xie
• [2020 ICASSP] Weakly Supervised Segmentation Guided Hand Pose Estimation During Interaction With Unknown Objects. [PDF]
Cairong Zhang, Guijin Wang, Xinghao Chen, Pengwei Xie, Toshihiko Yamasaki
Zhengyi Zhao, Tianyao Wang, Siyu Xia, Yangang Wang
• FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. [PDF] [Project] [Code]
Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox
• A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Image. [PDF] [Code]
Fu Xiong*, Boshen Zhang*, Yang Xiao, Zhiguo Cao, Taidong Yu, Joey Tianyi Zhou, and Junsong Yuan
• Exploiting Spatial-temporal Relationships for 3D Pose Estimation via Graph Convolutional Networks. [PDF]
Yujun Cai, Liuhao Ge, Jun Liu, Jianfei Cai, Tat-Jen Cham, Junsong Yuan, and Nadia Magnenat Thalmann
Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas and Michael J. Black
• SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-supervised Learning. [PDF] [Code]
Yujin Chen, Zhigang Tu, Liuhao Ge, Dejun Zhang, Ruizhi Chen, Junsong Yuan
Xiong Zhang*, Qiang Li*, Wenbo Zhang, Wen Zheng
• Aligning Latent Spaces for 3D Hand Pose Estimation. [PDF]
Linlin Yang*, Shile Li*, Dongheui Lee, Angela Yao
• [HANDS19 Workshop] Disentangling Pose from Appearance in Monochrome Hand Images. [PDF]
Yikang Li, Chris Twigg, Yuting Ye, Lingling Tao, Xiaogang Wang
• [HANDS19 Workshop] RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images. [PDF]
Shanxin Yuan, Bjorn Stenger, Tae-Kyun Kim
• [HANDS19 Workshop] Explicit Pose Deformation Learning for Tracking Human Poses. [PDF]
Xiao Sun, Chuankang Li, Stephen Lin
• [HANDS19 Workshop] Hand Pose Ensemble Learning based on Grouping Features of Hand Point Sets. [PDF]
Tianqiang Zhu, Yi Sun, Xiaohong Ma, Xiangbo Lin
• Disentangling Latent Hands for Image Synthesis and Pose Estimation. [PDF]
Linlin Yang, Angela Yao
• Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer. [PDF]
Shile Li, Dongheui Lee
• H•O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions. [PDF] (Oral)
Bugra Tekin, Federica Bogo, Marc Pollefeys
• Self supervised 3D hand pose estimation. [PDF] [Code] (Oral) (Best Paper Finalists)
Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao
Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma
• Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. [PDF] [Project] [Code] (Oral)
Georgios Pavlakos*, Vasileios Choutas*, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, Michael J. Black
Yana Hasson, Gül Varol, Dimitris Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, and Cordelia Schmid
Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, Junsong Yuan
Adnane Boukhayma, Rodrigo de Bem, Philip H.S. Torr
• Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering. [PDF]
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim
Donglai Xiang, Hanbyul Joo, Yaser Sheikh
• [2019 SIGGRAPH] Interactive Hand Pose Estimation using a Stretch-Sensing Soft Glove. [PDF] [Project]
Oliver Glauser, Shihao Wu, Daniele Panozzo, Otmar Hilliges, Olga Sorkine-Hornung
• [2019 SIGGRAPH] InteractionFusion: Real-time Reconstruction of Hand Poses and Deformable Objects in Hand-object Interactions. [PDF]
Hao Zhang, Zi-Hao Bo, Jun-Hai Yong, Feng Xu
• [2019 SIGGRAPH] Real-time pose and shape reconstruction of two interacting hands with a single depth camera. [PDF] [Project]
Franziska Mueller, Micah Davis, Florian Bernard, Oleksandr Sotnychenko, Mickeal Verschoor, Miguel A. Otaduy, Dan Casas, Christian Theobalt
• [2019 FG] Deep Conditional Variational Estimation for Depth-Based Hand Poses. [PDF]
Lu Xu, Chen Hu, Yinqi Li, Ji’an Tao, Jianru Xue, Kuizhi Mei
• [2019 BMVC] Unified 2D and 3D Hand Pose Estimation from a Single Visible or X-ray Image. [PDF]
Akila Pemasiri, Kien Nguyen Thanh, Sridha Sridharan, Clinton Fookes
• [2019 BMVC] TAGAN: Tonality Aligned Generative Adversarial Networks for Realistic HandPose Synthesis. [PDF]
Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Xiaohui Xie, Yen-Yu Lin, Wei Fan
Dominik Kulon, Haoyang Wang, Riza Alp Güler, Michael Bronstein, Stefanos Zafeiriou
• [2019 BMVC] Adaptive Graphical Model Network for 2D Handpose Estimation. [PDF]
Deying Kong, Yifei Chen, Haoyu Ma, Xiangyi Yan, Xiaohui Xie
• [2019 BMVC] SRN: Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]
Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi, Weiting Huang
• [2019 BMVC] End-to-End 3D Hand Pose Estimation from Stereo Cameras. [PDF] (Oral)
Yuncheng Li, Zehao Xue, Yingying Wang, Liuhao Ge, Zhou Ren, Jonathan Rodriguez
• [2019 ACCV] Hand Pose Estimation Based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]
Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu
• [2019 ICASSP] Cascaded Point Network for 3D Hand Pose Estimation. [PDF]
Yikun Dou, Xuguang Wang, Yuying Zhu, Xiaoming Deng, Cuixia Ma, Liang Chang, Hongan Wang
• [2019 ICASSP] A Novel Framework of Hand Localization and Hand Pose Estimation. [PDF]
Yunlong Che, Yuxiang Song, Yue Qi
• [2019 ICRA] Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. [PDF] [Code]
Shuang Li*, Xiaojian Ma*, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bing Fang, Fuchun Sun, Jianwei Zhang
Georg Poier, Michael Opitz, David Schinagl and Horst Bischof
• HandMap: Robust Hand Pose Estimation via Intermediate Dense Guidance Map Supervision. [PDF] [Project] [Code]
Xiaokun Wu, Daniel Finnegan, Eamonn O'Neill, Yongliang Yang
• HBE: Hand Branch Ensemble network for real time 3D hand pose estimation. [PDF]
Yidan Zhou, Jian Lu, Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma
• Point-to-Point Regression PointNet for 3D Hand Pose Estimation. [PDF]
Liuhao Ge, Zhou Ren, Junsong Yuan
• Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images. [PDF] (Oral)
Yujun Cai, Liuhao Ge, Jianfei Cai, Junsong Yuan
Aggeliki Tsoli, Antonis A. Argyros
• Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. [PDF] (Oral)
Qi Ye, Tae-Kyun Kim
• Hand Pose Estimation via Latent 2.5D Heatmap Regression. [PDF]
Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz
• [Hands18 Workshop] Adapting Egocentric Visual Hand Pose Estimation Towards a Robot-Controlled Exoskeleton. [PDF]
Gerald Baulig, Thomas Gulde, Cristobal Curio
• [Hands18 Workshop] Estimating 2D Multi-Hand Poses From Single Depth Images. [PDF]
Le Duan, Minmin Shen, Song Cui, Zhexiao Guo, Oliver Deussen
• [Hands18 Workshop] Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation. [PDF] [Project]
Dafni Antotsiou, Guillermo Garcia-Hernando, Tae-Kyun Kim
• First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF] [Project] [Code]
Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim
Georg Poier, David Schinagl, Horst Bischof
Liuhao Ge, Yujun Cai, Junwu Weng, Junsong Yuan
Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao
Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges
• Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images. [PDF] [Project]
Mahdi Rad, Markus Oberweger, Vincent Lepetit
• GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. [PDF] [Supp] [Project] (Spotlight)
Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, Christian Theobalt
• V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map. [PDF] [Code]
Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
• Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF] (Spotlight)
Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim
• Augmented skeleton space transfer for depth-based hand pose estimation. [PDF] (Oral)
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim
• [3D HUMANS Workshop] Monocular RGB Hand Pose Inference From Unsupervised Refinable Nets. [PDF]
Endri Dibra, Silvan Melchior, Ali Balkis, Thomas Wolf, Cengiz Oztireli, Markus Gross
• [2018 ISMAR] Hybrid 3D Hand Articulations Tracking Guided by Classification and Search Space Adaptation. [PDF]
Gabyong Park, Woontack Woo
• [2018 ACCV] Hand Pose Estimation based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]
Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu
• [2018 ACCV] Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation. [PDF] [Project] (Oral)
Battushig Myanganbayar, Cristina Mata, Gil Dekel, Boris Katz, Guy Ben-Yosef, Andrei Barbu
• [2018 ACCV] Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotations. [PDF] (Oral)
Mahdi Rad, Markus Oberweger, Vincent Lepetit
• [2018 PCM] Hand Pose Estimation with Attention-and-Sequence Network. [PDF]
Tianping Hu*, Wenhai Wang*, Tong Lu
• [2018 PCM] Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation. [PDF]
Haoqian Wang, Da Li, Xingzheng Wang
• [2018 ICPR] Local Regression Based Hourglass Network for Hand Pose Estimation from a Single Depth Image. [PDF]
Jia Li, Zengfu Wang
• [2018 ICPR] Dynamic Projected Segmentation Networks for Hand Pose Estimation. [PDF]
Yunlong Che, Yue Qi
• [2018 3DV] DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning from Synthetic Depth. [PDF]
Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Kiran Varanasi, Kiarash Tamaddon, Alexis Heloir, Didier Stricker
• [2018 ICIP] Networks Effectively Utilizing 2D Spatial Information for Accurate 3D Hand Pose Estimation. [PDF]
Baoen Liu, Shiliang Huang, Zhongfu Ye
Evangelos Kazakos, Christophoros Nikou, Ioannis Kakadiaris
• [2018 ICIP] Fast Lifting for 3D Hand Pose Estimation in AR/VR Applications. [PDF]
Onur Guleryuz, Christine Kaeser-Chen
• [2018 BMVC] Structure-Aware 3D Hourglass Network for Hand Pose Estimation from Single Depth Image. [PDF]
Fuyang Huang, Ailing Zeng, Minhao Liu, Jing Qin, Qiang Xu
• [2018 BMVC] 3D Hand Pose Estimation using Simulation and Partial-Supervision with a Shared Latent Space. [PDF] [Code] (Oral)
Masoud Abdi, Ehsan Abbasnejad, Chee Peng Lim, Saeid Nahavandi
• [2018 FG] Kinematic Constrained Cascaded Autoencoder for Real-time Hand Pose Estimation. [PDF]
Yushun Lin, Xiujuan Chai, Xilin Chen
• [2018 WACV] Using a single RGB frame for real time 3D hand pose estimation in the wild. [PDF] [Project] [Code]
Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros
Christian Zimmermann, Thomas Brox
Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt
Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani
Chiho Choi, Sangpil Kim, Karthik Ramani
• Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization. [PDF] [Project] [Code]
Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly
• [Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo. [PDF]
Paschalis Panteleris, Antonis Argyros
• [Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation. [PDF] [Project] [Code]
Markus Oberweger and Vincent Lepetit
• [Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo. [PDF]
Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh
Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh
• Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation. [PDF] [Code]
Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao
• Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis. [PDF]
Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim
• 3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images. [PDF] [Project]
Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann
• [2017 3DV] Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image. [PDF]
Jameel Malik, Ahmed Elhayek, Didier Stricker
• [2017 3DV] How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data? [PDF]
Endri Dibra*, Thomas Wolf*, Cengiz Öztireli, Markus Gross
• [2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation. [PDF] [Code]
Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang
Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang
• [2017 SIGGRAPH Asia] Articulated distance fields for ultra-fast tracking of hands interacting. [PDF]
Jonathan Taylor*, Vladimir Tankovich*, Danhang Tang*, Cem Keskin*, David Kim, Philip Davidson, Adarsh Kowdle, Shahram Izadi
Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon
• [2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together. [PDF] [Project]
Javier Romero*, Dimitrios Tzionas* and Michael J. Black
• [2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation. [PDF]
Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu
Konstantinos Roditakis, Alexandros Makris and Antonis Argyros
• [2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]
Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu
Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez
• [2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks. [PDF] [Project]
Duncan Goudie, Aphrodite Galata
• Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation. [PDF] [Project]
Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim
• Hand Pose Estimation from Local Surface Normals. [PDF]
Chengde Wan, Angela Yao, and Luc Van Gool
Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt
• Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs. [PDF] [Project] [Code]
Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann
• DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features. [PDF][Project]
Ayan Sinha*, Chiho Choi*, Karthik Ramani
Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit
David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton
Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin
• [2016 ACCV] Hand Pose Regression via A Classification-guided Approach. [PDF]
Hongwei Yang, Juyong Zhang
• [2016 ICPR] Deep learning for integrated hand detection and pose estimation. [PDF]
Tzu-Yang Chen, Min-Yu Wu, Yu-Hsun Hsieh, Li-Chen Fu
• [2016 ICPR] Depth-based 3D hand pose tracking. [PDF]
Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.
Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei
• [2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. [PDF]
Jonathan Taylor et al.
• [2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking. [PDF] [Project] [Code]
Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi
Markus Oberweger, Paul Wohlhart, Vincent Lepetit
• Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. [PDF]
Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton
James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton
• 3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points. [PDF]
Peiyi Li, Haibin Ling
Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani
• Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions. [PDF]
Sven Bambach, Stefan Lee, David Crandall, Chen Yu
• Understanding Everyday Hands in Action from RGB-D Images. [PDF]
Gregory Rogez, James Supancic III, Deva Ramanan
• Cascaded Hand Pose Regression. [PDF]
Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun
Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt
• Learning an Efficient Model of Hand Shape Variation from Depth Images. [PDF]
Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon
Georg Poier, Konstantinos Roditakis, Samuel Schulter, Damien Michel, Horst Bischof and Antonis A. Argyros
Aaron Wetzler, Ron Slossberg and Ron Kimmel
Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi
Markus Oberweger, Paul Wohlhart, Vincent Lepetit
• [2015 FG] Combining Discriminative and Model Based Approaches for Hand Pose Estimation. [PDF] [Project]
Philip Krejov, Andrew Gilbert, Richard Bowden
Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi
Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun
Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim
Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon
Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros
• [2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. [PDF] [Project]
Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin
• [2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests. [PDF] [Project]
Danhang Tang, Tsz Ho Yu and T-K. Kim
• [2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data. [PDF] [Project]
Srinath Sridhar, Antti Oulasvirta, Christian Theobalt
Chi Xu, Li Cheng
• [2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points. [PDF] [Project]
Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.
• [2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.
Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun
• [2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors. [PDF]
Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun
• [2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect. [PDF] [Project] [Code]
Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros
• [2020] Learning without Labeling for 3D Hand Pose Estimation. [PDF]
Georg Poier, Graz University of Technology
• [2018] Computational Learning for Hand Pose Estimation. [PDF]
Chiho Choi, Purdue University
• [2018] 3D hand pose estimation: methods, datasets, and challenges. [PDF]
Shanxin Yuan, Imperial College London
• [2018] 3D hand pose estimation using convolutional neural networks. [PDF]
Qi Ye, Imperial College London
• [2018] 3D Hand Pose Estimation from Images for Interactive Applications. [PDF]
Markus Oberweger, Graz University of Technology
• [2018] Articulated Human Pose Estimation in Unconstrained Images and Videos. [PDF]
Umar Iqbal, University of Bonn
• [2018] Real-Time Generative Hand Modeling and Tracking. [PDF]
Anastasia Tkach, EPFL
• [2018] Recovery of the 3D Virtual Human: Monocular Estimation of 3D Shape and Pose with Data Driven Priors. [PDF] [Project]
Endri Dibra, ETH Zürich
Meysam Madadi, Universitat Autònoma de Barcelonato
• [2017] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF] [Project]
Dimitrios Tzionas, University of Bonn
• [2016] Tracking Hands in Action for Gesture-based Computer Input. [PDF]
Srinath Sridhar, Max Planck Institute for Informatics
Danhang Tang, Imperial College London
Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France
Philip Krejov, University of Surrey
• [2015] Efficient Tracking of the 3D Articulated Motion of Human Hands. [PDF]
Iason Oikonomidis, University of Crete
• [2015] Vision-based hand pose estimation and gesture recognition. [PDF]
Hui Liang, Nanyang Technological University
• [2015] Localization of Humans in Images Using Convolutional Networks. [PDF]
Jonathan Tompson, New York University
- S/R: Synthetic (S) or Real (R) or Both (B)
- C/D: Color (RGB) or Depth (D)
- Obj: Interaction with objects or not
- #J: No. of joints or Mesh (M)
- V: view (3rd or egocentric)
- #S: No. of subjects
- #F: No. of frames (train/test)
- Mesh: Mesh annotations
| Dataset | Year | S/R | Mesh | Obj | #J | V | #S | #F | Paper |
|---|---|---|---|---|---|---|---|---|---|
| NYU | 2014 | R | ❌ | ❌ | 36 | 3rd | 2 | 72k/8k | SIGGRAPH 2014 [PDF] |
| ICVL | 2014 | R | ❌ | ❌ | 16 | 3rd | 10 | 331k/1.5k | CVPR 2014 [PDF] |
| MSRA15 | 2015 | R | ❌ | ❌ | 21 | 3rd | 9 | 76,375 | CVPR 2015 [PDF] |
| BigHand2.2M | 2017 | R | ❌ | ❌ | 21 | 3rd | 10 | 2.2M | CVPR 2017 [PDF] |
| SynHandEgo | 2019 | R | ✅ | ❌ | - | ego | - | - | Computers & Graphics 2019 [PDF] |
| FHAD | 2018 | R | ❌ | ✅ | 21 | ego | 6 | 100k | CVPR 2018 [PDF] |
| SynHand5M | 2018 | S | - | ❌ | M | 3rd | - | 5M | 3DV 2018 [PDF] |
| MSRC (FingerPaint) | 2015 | S | ❌ | ❌ | 21 | both | 1 | 100k | CHI 2015 [PDF] |
| HandNet | 2015 | R | ❌ | ❌ | 6 | 3rd | 10 | 202k/10k | BMVC 2015 [PDF] |
| Hands in Action | 2014 | R | - | ✅ | - | 3rd | - | - | IJCV 2016 [PDF] |
| MSRA14 | 2014 | R | ❌ | ❌ | 21 | 3rd | 6 | 2,400 | CVPR 2014 [PDF] |
| ASTAR | 2013 | R | - | ❌ | 20 | 3rd | 30 | 870 | ICCV 2013 [PDF] |
| Dataset | Year | S/R | Mesh | Obj | #J | V | #S | #F | Paper |
|---|---|---|---|---|---|---|---|---|---|
| ContactPose | 2020 | R | ✅ | ✅ | 21 | 3rd | 50 | 2.9M | ECCV 2020 [PDF] |
| Ego3DHands | 2020 | S | - | ❌ | 21 | ego | 1 | 50k/5k | arXiv 2020 [PDF] |
| ObMan | 2019 | S | ✅ | ✅ | - | - | - | 150k | CVPR 2019 [PDF] |
| EgoDexter | 2017 | R | - | ✅ | 5 | ego | 4 | 1485 | ICCV 2017 [PDF] |
| SynthHands | 2017 | S | - | Both | 21 | ego | 2 | 63,530 | ICCV 2017 [PDF] |
| RHD | 2017 | S | - | ❌ | 21 | 3rd | 20 | 41k/2.7k | ICCV 2017 [PDF] |
| STB | 2017 | R | - | ❌ | 21 | 3rd | 1 | 18k | ICIP 2017 [PDF] |
| Dexter+Object | 2016 | R | - | ✅ | 5 | 3rd | 2 | 3,014 | ECCV 2016 [PDF] |
| UCI-EGO | 2014 | R | - | ❌ | 26 | ego | 2 | 400 | ECCVW 2014 [PDF] |
| Dexter1 | 2013 | R | - | ❌ | 6 | 3rd | 1 | 2,137 | ICCV 2013 [PDF] |
| Dataset | Year | S/R | Mesh | Obj | #J | V | #S | #F | Paper |
|---|---|---|---|---|---|---|---|---|---|
| HIU-DMTL-Data | 2021 | R | ❌ | ❌ | 21 | 3rd/ego | 200 | 40,000 | ICCV 2021 [PDF] |
| InterHand2.6M | 2020 | R | ❌ | ❌ | 21 | 3rd | 27 | 2.6M | ECCV 2020 [PDF] |
| YouTube 3D Hands | 2020 | R | ✅ | ✅ | - | 3rd | - | 47,125/1525/1525 | CVPR 2020 [PDF] |
| OneHand10K | 2019 | R | - | ❌ | 21 | 3rd | 1 | 10k/1.3k | TCSVT 2019 [PDF] |
| FreiHAND | 2019 | R | - | ✅ | 21 | 3rd | - | 130k/3960 | ICCV 2019 [PDF] |
| GANerated Hands | 2018 | S | - | Both | 21 | ego | - | 330k | CVPR 2018 [PDF] |
| CMU Panoptic HandDB | 2017 | B | - | ❌ | 21 | 3rd | - | 14,817 | CVPR 2017 [PDF] |
| MHP | 2017 | R | - | ❌ | 21 | 3rd | 9 | 80k | IVC 2017 [PDF] |
Credits:
- [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
- [2] Depth-based hand pose estimation: methods, data, and challenges, ICCV 2015 Link
- [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects, IJCV 2016 [PDF]
- [4] MPI Hand Tracking Central
• HANDS 2019, In conjunction with ICCV 2019
• HANDS 2018, In conjunction with ECCV 2018
- HANDS18: Methods, Techniques and Applications for Hand Observation. [PDF]
• HANDS 2017, In conjunction with ICCV 2017
- Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF]
• HANDS 2016, In conjunction with CVPR 2016
• HANDS 2015, In conjunction with CVPR 2015
• PeopleCap 2018, In conjunction with ECCV 2018
• PeopleCap 2017, In conjunction with ICCV 2017
- Submission Website: Depth-Based Task, Depth-Based Hand-Object Task, RGB-Based Hand-Object Task
- Documents
- Submission Website: Frame and Tracking Task, Hand-Object Task
- Documents
• [arXiv 2011.07252] Ego2Hands: A Dataset for Egocentric Two-hand Segmentation and Detection. [PDF] [Code]
Fanqing Lin, Tony Martinez
Anurag Ranjan, David T. Hoffmann, Dimitrios Tzionas, Siyu Tang, Javier Romero, and Michael J. Black
Supreeth Narasimhaswamy*, Zhengwei Wei*, Yang Wang, Justin Zhang, Minh Hoai
Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D. Twigg, Kenrick Kin
• [2018 CVPRW] HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands. [PDF] [Code]
Akshay Rangesh, Mohan M. Trivedi
Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos
Aisha Urooj Khan, Ali Borji
• [2018 CVPR] Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. [PDF] [Project] (CVPR Best Student Paper Award)
Hanbyul Joo, Tomas Simon, Yaser Sheikh
• [2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks. [PDF]
Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani
• [2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training. [PDF] [Project] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand] (CVPR Best Paper Award)
Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb
Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi
Dimitrios Tzionas and Juergen Gall
Contributions welcome! Read the contribution guidelines first.
Please feel free to pull requests, open an issue or send me email ([email protected]) to add awesome papers.
To the extent possible under law, xinghaochen has waived all copyright and related or neighboring rights to this work.