Inspiration
Sign language translator plus gamification for learning sign language. The translator I first started working on it on my second year of college. The gamification was added because I saw my mother playing Duolingo (a language learning app).
What it does
It uses Machine Learning to track and classify your hand movements. It then classifies that movement into the respective hand sign. This classification is then used for the game dynamics.
How we built it
The team created its own dataset. Then it trained the model to classify hand signs. It achieved a 95% accuracy. Later this model was integrated into a web app using javascript, specifically ReactJS.
Challenges we ran into
The main challenges were creating the dataset. We used around 8,000 data samples to train the model. All those samples were almost entirely taken by hand.
Accomplishments that we're proud of
www.signy.ai The website works! :)
What we learned
That you can combine two simple ideas and create something wonderful.
What's next for Signy
Promoting. We need customer feedback in order to tackle the challenges that Signy faces.
Built With
- flask
- postgresql
- python
- react
- tensorflow
- typescript
Log in or sign up for Devpost to join the conversation.