Problem E / I
SignOLight
- Verdict
- Accepted
- Stack
- React · Express.js · Three.js
- Links
- GitHub repository ↗
Statement
SignOLight plays YouTube videos alongside a real-time 3D sign language avatar synced to the video's captions, making video content more accessible to the deaf and hard-of-hearing community. Captions are converted into sign notation and simplified language using Gemma, with support for both Bangla and English content, so the avatar can sign along with a wide range of videos without requiring any pre-processing.
Subtasks
- 01
Real-Time 3D Avatar
A Three.js-rendered avatar signs along in sync with video captions as playback progresses.
- 02
AI Caption Translation
Uses Gemma to convert captions into sign notation and simplified language automatically.
- 03
Bangla-English Support
Works across both Bangla and English captioned content for wider accessibility.
- 04
Any YouTube Video
Plays alongside any YouTube video without needing pre-processed or specially prepared content.
Constraints
-
React
JavaScript library for building user interfaces with reusable components.
-
Express.js
Minimalist Node.js web framework for building APIs and server-side applications with a simple, flexible routing layer.
-
Three.js
JavaScript library for creating and rendering interactive 3D graphics in the browser using WebGL.
Next problem F
WhatsApp Thread Summarizer