The Sign Language Translator is an open-source project developing an AI-powered tool for real-time sign language translation. It invites contributors to improve accuracy and accessibility, helping the deaf and hard-of-hearing community. Join us in advancing inclusively through AI and collaboration.
| Year | Paper | GitHub Repository & Stars |
|---|---|---|
| 2025 | Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues | N/A |
| 2025 | KD-MSLRT: Lightweight Sign Language Recognition Model Based on Mediapipe and 3D to 1D Knowledge Distillation | N/A |
| 2024 | SignGraph: A Sign Sequence is Worth Graphs of Nodes | GitHub ⭐21 |
| 2024 | Improving Continuous Sign Language Recognition with Adapted Image Models | GitHub ⭐7 |
| 2024 | Sign Stitching: A Novel Approach to Sign Language Production | GitHub ⭐6 |
| 2024 | Sign-IDD: Iconicity Disentangled Diffusion for Sign Language Production | GitHub ⭐5 |
| 2024 | A Data-Driven Representation for Sign Language Production | GitHub ⭐5 |
| 2024 | TCNet: Continuous Sign Language Recognition from Trajectories and Correlated Regions | GitHub ⭐4 |
| 2024 | Improvement in Sign Language Translation Using Text CTC Alignment | GitHub ⭐1 |
| 2024 | Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research | GitHub ⭐1 |
| 2024 | An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs | GitHub ⭐N/A |
| 2024 | Linguistics-Vision Monotonic Consistent Network for Sign Language Production | N/A |
| 2024 | Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis | N/A |
| 2024 | Scaling up Multimodal Pre-training for Sign Language Understanding | N/A |
| 2024 | A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalities | N/A |
| 2024 | A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production | N/A |
| 2024 | T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text | N/A |
| 2024 | Continuous Sign Language Recognition with Adapted Conformer via Unsupervised Pretraining | N/A |
| 2024 | Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation | N/A |
| 2024 | E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods | N/A |
| 2024 | A Hong Kong Sign Language Corpus Collected from Sign-interpreted TV News | N/A |
| 2024 | LLMs are Good Sign Language Translators | N/A |
| 2024 | Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation | N/A |
| 2023 | CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational Alignment | GitHub ⭐118 |
| 2023 | Continuous Sign Language Recognition with Correlation Network | Corrnet: GitHub, Corrnet_plus: GitHub, Adaptsign: GitHub ⭐118 |
| 2023 | Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining | GitHub ⭐53 |
| 2023 | Self-Emphasizing Network for Continuous Sign Language Recognition | GitHub ⭐46 |
| 2023 | Gloss-Free End-to-End Sign Language Translation | GitHub ⭐37 |
| 2023 | Gloss Attention for Gloss-free Sign Language Translation | GitHub ⭐31 |
| 2023 | A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation | GitHub ⭐18 |
| 2023 | Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment | GitHub ⭐12 |
| 2023 | AdaBrowse: Adaptive Video Browser for Efficient Continuous Sign Language Recognition | GitHub ⭐8 |
| 2023 | Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations | N/A |
| 2023 | SignDiff: Diffusion Models for American Sign Language Production | N/A |
| 2023 | Sign Language Translation with Iterative Prototype | N/A |
| 2023 | Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods | N/A |
| 2023 | Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse | N/A |
| 2023 | CoSign: Exploring Co-occurrence Signals in Skeleton-based Continuous Sign Language Recognition | N/A |
| 2022 | Self-Mutual Distillation Learning for Continuous Sign Language Recognition | GitHub ⭐127 |
| 2022 | Temporal Lift Pooling for Continuous Sign Language Recognition | GitHub ⭐21 |
| 2022 | Modeling Intensification for Sign Language Generation: A Computational Approach | GitHub ⭐13 |
| 2022 | Using Neural Machine Translation Methods for Sign Language Translation | GitHub ⭐8 |
| 2022 | A Token-level Contrastive Framework for Sign Language Translation | GitHub ⭐6 |
| 2022 | Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production | GitHub ⭐4 |
| 2022 | Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation | N/A |
| 2022 | SDW-ASL: A Dynamic System to Generate Large Scale Dataset for Continuous American Sign Language | N/A |
| 2022 | Prior Knowledge and Memory Enriched Transformer for Sign Language Translation | N/A |
| 2022 | Including Facial Expressions in Contextual Embeddings for Sign Language Generation | N/A |
| 2022 | All You Need In Sign Language Production | N/A |
| 2022 | MLSLT: Towards Multilingual Sign Language Translation | N/A |
| 2021 | Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation | GitHub ⭐19 |
| 2021 | Self-Mutual Distillation Learning for Continuous Sign Language Recognition | GitHub ⭐127 |
| Year | Title | Paper Link | GitHub Repository |
|---|---|---|---|
| 2022 | MLSLT: Towards Multilingual Sign Language Translation | Paper Link | GitHub Repository |
| 2022 | Open-Domain Sign Language Translation Learned from Online Video | Paper Link | GitHub Repository |
| 2022 | Prior Knowledge and Memory Enriched Transformer for Sign Language Translation | Paper Link | GitHub Repository |
| 2023 | SLTUNET: A Simple Unified Model for Sign Language Translation | Paper Link | GitHub Repository |
| 2023 | Gloss Attention for Gloss-free Sign Language Translation | Paper Link | GitHub Repository |
| 2025 | Improving Multilingual Sign Language Translation with Automatically Discovered Interlingua | Paper Link | GitHub Repository |
Feel free to contribute by adding more research papers and their corresponding GitHub repositories to this list!
| Dataset Name | Description | Dataset Link |
|---|---|---|
| RWTH-PHOENIX-Weather 2014 T | Over a period of three years (2009 - 2011) the daily news and weather forecast airings of the German public tv-station PHOENIX featuring sign language interpretation were recorded. 386 editions transcribed using gloss notation. | RWTH-PHOENIX-Weather 2014 T |
| How2Sign | A large-scale multimodal dataset for continuous American Sign Language (ASL). Includes finger spelling, isolated signs, and continuous sign language content. | How2Sign Datasets |
| CSL-Daily | A large-scale continuous Chinese SLT dataset, covering daily-life topics with spoken language translations and gloss-level annotations. | CSL-Daily |
| Activity net | A large-scale video benchmark for human activity understanding. | Activity net Official Site |
| GSL (Greek Sign Language) | A large-scale RGB+D dataset for Greek Sign Language (GSL) recognition/translation. | Greek Sign Language Dataset |
| OpenASL | Large-scale American Sign Language (ASL) - English dataset with 288 hours of ASL videos in multiple domains from over 200 signers. | OpenASL GitHub Repository |
| BOBSL (BBC-Oxford British Sign Language) | A large-scale dataset of British Sign Language (BSL): ~1,400 hours of BSL-interpreted BBC broadcast footage, with written English subtitles. | BOBSL Dataset |
| WLASL | A large video dataset for Word-Level American Sign Language (ASL) recognition, featuring 2,000 different words. | WLASL Repository |
| AUTSL (Ankara University Turkish Sign Language) | A large-scale, multimode dataset with 226 signs performed by 43 signers (38,336 video samples total). | AUTSL Dataset |
| FDMSE-ISL | A large-scale isolated Indian sign language dataset with 2002 words, 40033 videos, ~36.2 hours total, 7.8M frames. | FDMSE-ISL Official Site |
| LSA64 | Argentinian Sign Language dataset with 3200 videos (10 subjects, 5 reps each, 64 signs). | LSA64 Homepage |
| Indian Sign Language Dataset (Kaggle) | A collection of ISL gesture images for real-world scenario simulation. | Indian Sign Language Dataset on Kaggle |
| ISL-CSLTR | Corpus with 700 fully annotated videos, 18,863 sentence-level frames, 1036 word-level images across 100 spoken language sentences by 7 signers. | ISL-CSLTR |
| INCLUDE | Indian Lexicon Sign Language Dataset with 0.27 million frames over 4,287 videos, 263 word signs, 15 categories. | INCLUDE Dataset |
| Indian Sign Language Dataset (GTS) | A dataset for Indian Sign Language from GTS.ai (download link). | GTS.ai Download |
| Indian Sign Language - Medical words | 18,000 images across 20 words, labeled with participant IDs. | Medical Words Dataset |
| indian_hand_sign_language (Roboflow) | An image-based dataset for Indian Sign Language recognition. | Roboflow Universe |
| Sign Language Datasets | A collection of datasets for sign language recognition and translation, covering various sign languages and formats. | Sign Language Datasets on GitHub |
| Yemeni Sign Language Dataset | A dataset focusing on Yemeni Sign Language, available on Kaggle. | Yemeni Sign Language Dataset on Kaggle |
| DailyMoth-70h | An ASL-to-English sign language dataset containing over 70 hours of video with aligned English captions. | DailyMoth-70h on Papers with Code |
| Spreadthesign | An online multilingual sign languages dictionary with over 610,000 signed videos. | Spreadthesign Official Website |
Contributors are encouraged to add more datasets to this list to support the development and research in sign language translation.