A collection of resources about Sign Language Recognition (SLR) and Translation (SLT)
This is a collection of papers and resources I curated when learning the ropes in Sign Language Recognition and Translation. It is under construction and I will update it continuously. Feel free to contribute.
If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request.
Feedback and contributions are welcome!
- WIKI: Sign Language
- Awesome Sign Language Resources
- Basic Sign Language Recognition
- Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective
- AUTSL [paper]
- ICSL(SLR500) / CCSL(SLR100)
- WLASL [paper]
- MS-ASL
- BSL-1K [paper]
- How2Sign [paper]
- CSL-Daily [paper]
Dataset | Sign Language | Classes | Signers | Videos | Type | Modalities | Year | Avail. * |
---|---|---|---|---|---|---|---|---|
SLR500 | Chinese | 500 | 50 | 125,000 | Isolated | RGB+D | 2016 | Yes |
AUTSL | Turkish | 226 | 43 | 38,336 | Isolated | RGB+D | 2020 | Yes |
WLASL | American | 2,000 | 119 | 21,083 | Isolated | RGB | 2020 | Yes |
MS-ASL | American | 1,000 | 222 | 25,513 | Isolated | RGB | 2019 | No |
BSL-1K | British | 1,064 | 40 | 273,000 | Isolated | RGB | 2021 | No |
SLR100 | Chinese | 100 | 50 | 25,000 | Continuous | RGB+D | 2016 | Yes |
How2Sign | American | ** | 11 | 35,000 | Continuous | RGB+D | 2021 | Yes |
PHOENIX-2014T | German | 1,066 | 9 | 8,257 | Translation | RGB | 2014 | Yes |
CSL-Daily | Chinese | 2000 | 10 | 20,654 | Translaion | RGB | 2021 |
* Public availability at the moment.
** Vocabulary size 16k.
Above is a brief summary of popular sign language dataset. A more complete list of dataset can be found at https://how2sign.github.io/related_datasets.html
- [2021 CVPRW] Skeleton Aware Multi-modal Sign Language Recognition.[paper][code]
Songyao Jiang, Bin Sun, Lichen Wang, Yue Bai, Kunpeng Li, Yun Fu - [2021 TMM] Spatial-Temporal Multi-Cue Network for Sign Language Recognition and Translation.[paper]
Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li - [2021 AAAI] Hand-Model-Aware Sign Language Recognition.[paper]
Hezhen Hu, Wengang Zhou, Houqiang Li - [WACV 2021] Hand Pose Guided 3D Pooling for Word-level Sign Language Recognition.[paper]
Al Amin Hosain; Panneer Selvam Santhalingam; Parth Pathak; Huzefa Rangwala; Jana Kosecka - [2020 ECCV] BSL-1K: Scaling Up Co-articulated Sign Language Recognition Using Mouthing Cues.[paper][code]
Samuel Albanie, Gül Varol, Liliane Momeni, Triantafyllos Afouras, Joon Son Chung, Neil Fox, Andrew Zisserman
-
[2021 ICCV] Visual Alignment Constraint for Continuous Sign Language Recognition.[paper][code]
Yuecong Min, Aiming Hao, Xiujuan Chai, and Xilin Chen -
[2020 ECCV] Fully Convolutional Networks for Continuous Sign Language Recognition.[paper]
Ka Leong Cheng, Zhaoyang Yang, Qifeng Chen, and Yu- Wing Tai -
[2020 AAAI] Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognition. [paper]
Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li -
[2019 CVPR] Iterative Alignment Network for Continuous Sign Language Recognition. [paper]
Junfu Pu Wengang Zhou Houqiang Li -
[2018 AAAI] Video-based Sign Language Recognition without Temporal Segmentation.[paper]
Jie Huang, Wengang Zhou, Qilin Zhang, Houqiang Li, Weiping Li
- [2021 ACMMM] Skeleton-Aware Neural Sign Language Translation. [paper][code]
Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Lei Xie, Sanglu Lu - [2021 CVPR] Improving Sign Language Translation With Monolingual Data by Sign Back-Translation. [paper]
Hao Zhou, Wengang Zhou, Weizhen Qi, Junfu Pu, Houqiang Li - [2021 TMM] Spatial-Temporal Multi-Cue Network for Sign Language Recognition and Translation. [paper]
Hao Zhou, Wengang Zhou, Yun Zhou, Houqiang Li - [2020 NeurIPS] TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation. [paper][code]
Dongxu Li, Chenchen Xu, Xin Yu, Kaihao Zhang, Ben Swift, Hanna Suominen, Hongdong Li - [2018 CVPR] Neural Sign Language Translation [paper][code]
Necati Cihan Camgoz, Simon Hadfield, Oscar Koller, Hermann Ney, Richard Bowden
CVPR 2021 Looking at People Large Scale Signer Independent Isolated SLR Challenge [RGB][RGB+D][paper]
CVPR 2021 ChaLearn Looking at People Sign Language Recognition in the Wild Workshop
https://github.com/jackyjsy/CVPR21Chal-SLR/
https://github.com/0aqz0/SLR