Awesome Sign Language Rcognition and Sign Language Translation

A collection of resources about Sign Language Recognition (SLR) and Translation (SLT)

Why awesome sign language recognition?

This is a collection of papers and resources I curated when learning the ropes in Sign Language Recognition and Translation. It is under construction and I will update it continuously. Feel free to contribute.

Contributing

If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request.

Feedback and contributions are welcome!

Table of Contents

• Basics
• Datasets
• Papers
  • Isolated sign language recognition
  • Continuous sign language recognition
  • Sign language translation
• Benchmarks
• Challenges
• Workshops
• Popular implementations
  • PyTorch

Basics

• WIKI: Sign Language
• Awesome Sign Language Resources
• Basic Sign Language Recognition
• Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective

Popular Datasets

• AUTSL [paper]
• ICSL(SLR500) / CCSL(SLR100)
• WLASL [paper]
• MS-ASL
• BSL-1K [paper]
• How2Sign [paper]
• CSL-Daily [paper]

Dataset	Sign Language	Classes	Signers	Videos	Type	Modalities	Year	Avail. *
SLR500	Chinese	500	50	125,000	Isolated	RGB+D	2016	Yes
AUTSL	Turkish	226	43	38,336	Isolated	RGB+D	2020	Yes
WLASL	American	2,000	119	21,083	Isolated	RGB	2020	Yes
MS-ASL	American	1,000	222	25,513	Isolated	RGB	2019	No
BSL-1K	British	1,064	40	273,000	Isolated	RGB	2021	No
SLR100	Chinese	100	50	25,000	Continuous	RGB+D	2016	Yes
How2Sign	American	**	11	35,000	Continuous	RGB+D	2021	Yes
PHOENIX-2014T	German	1,066	9	8,257	Translation	RGB	2014	Yes
CSL-Daily	Chinese	2000	10	20,654	Translaion	RGB	2021

* Public availability at the moment.
** Vocabulary size 16k.

Above is a brief summary of popular sign language dataset. A more complete list of dataset can be found at https://how2sign.github.io/related_datasets.html

Papers

Isolated sign language recognition

• [2021 CVPRW] Skeleton Aware Multi-modal Sign Language Recognition.[paper][code]
  Songyao Jiang, Bin Sun, Lichen Wang, Yue Bai, Kunpeng Li, Yun Fu
• [2021 TMM] Spatial-Temporal Multi-Cue Network for Sign Language Recognition and Translation.[paper]
  Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li
• [2021 AAAI] Hand-Model-Aware Sign Language Recognition.[paper]
  Hezhen Hu, Wengang Zhou, Houqiang Li
• [WACV 2021] Hand Pose Guided 3D Pooling for Word-level Sign Language Recognition.[paper]
  Al Amin Hosain; Panneer Selvam Santhalingam; Parth Pathak; Huzefa Rangwala; Jana Kosecka
• [2020 ECCV] BSL-1K: Scaling Up Co-articulated Sign Language Recognition Using Mouthing Cues.[paper][code]
  Samuel Albanie, Gül Varol, Liliane Momeni, Triantafyllos Afouras, Joon Son Chung, Neil Fox, Andrew Zisserman

Continuous sign language recognition

• [2021 ICCV] Visual Alignment Constraint for Continuous Sign Language Recognition.[paper][code]
  Yuecong Min, Aiming Hao, Xiujuan Chai, and Xilin Chen

• [2020 ECCV] Fully Convolutional Networks for Continuous Sign Language Recognition.[paper]
  Ka Leong Cheng, Zhaoyang Yang, Qifeng Chen, and Yu- Wing Tai

• [2020 AAAI] Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognition. [paper]
  Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li

• [2019 CVPR] Iterative Alignment Network for Continuous Sign Language Recognition. [paper]
  Junfu Pu Wengang Zhou Houqiang Li

• [2018 AAAI] Video-based Sign Language Recognition without Temporal Segmentation.[paper]
  Jie Huang, Wengang Zhou, Qilin Zhang, Houqiang Li, Weiping Li

Sign language translation

• [2021 ACMMM] Skeleton-Aware Neural Sign Language Translation. [paper][code]
  Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Lei Xie, Sanglu Lu
• [2021 CVPR] Improving Sign Language Translation With Monolingual Data by Sign Back-Translation. [paper]
  Hao Zhou, Wengang Zhou, Weizhen Qi, Junfu Pu, Houqiang Li
• [2021 TMM] Spatial-Temporal Multi-Cue Network for Sign Language Recognition and Translation. [paper]
  Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li
• [2020 NeurIPS] TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation. [paper][code]
  Dongxu Li, Chenchen Xu, Xin Yu, Kaihao Zhang, Ben Swift, Hanna Suominen, Hongdong Li
• [2018 CVPR] Neural Sign Language Translation [paper][code]
  Necati Cihan Camgoz, Simon Hadfield, Oscar Koller, Hermann Ney, Richard Bowden

Benchmarks

Paper with code

Challenges

CVPR 2021 Looking at People Large Scale Signer Independent Isolated SLR Challenge [RGB][RGB+D][paper]

Workshops

CVPR 2021 ChaLearn Looking at People Sign Language Recognition in the Wild Workshop

Popular implementations

https://github.com/jackyjsy/CVPR21Chal-SLR/
https://github.com/0aqz0/SLR