All About Sign-Speak

Welcome to our Sign-Speak FAQ, where we address some of your most pressing questions about our goals and offerings:

Sign-Speak is a forward-thinking AI research and product startup with a core goal: to create AI solutions that empowers the Deaf and Hard of Hearing individuals to interact freely, with our community autonomy at the core of all of what Sign-Speak does. 

Our sense of urgency stems from the recognition of the historical exclusion of Deaf and Hard of Hearing individuals from mainstream tech advancements. Every day without accessible AI tools widens the existing technology gap. That is why we prioritize continuous improvement through early community feedback and partnerships.

Our Commitment:

We have been in this development journey for the past 8 years, Sign-Speak is committed to evolving and expanding our impact within the community. We also aim to make sign language recognition as widespread as voice recognition. Right now we are a small company, but we are hopeful that as we grow we can do things to make sure that our community is gaining more skills and truly expanding the opportunities.

What is Sign-Speak? 

At Sign-Speak, we prioritize collaboration with the Deaf and Hard of Hearing communities to provide tools tailored to their needs. Our key offerings include:

  • Sign Language Recognition: Converts sign language into text or voice.

  • Sign Language Avatar: Translates voice into sign language.

  • Captioning: Converts voice into text.

We understand from personal experiences that accessibility needs vary within the D/HH community, ranging from reliance on sign language to captioning or a mix of both. Our goal is to offer a comprehensive tool that addresses these diverse communication needs.

What does Sign-Speak Offer?

Sign-Speak aims to complement by being a tool, not replacing interpreters. Our tools serve as empowerment for Deaf and Hard of Hearing individuals in situations where interpreters are unavailable. We envision a world where AI innovations benefit everyone, including our community, ensuring that Deaf and Hard of Hearing individuals can access products and services on par with their hearing counterparts.

Challenges We Aim to Address:

  • Equal payment for products and services but we currently do not get to experience them the same. We aim to finally provide equivalent usability by having sign language activation in all of these products. 

  • Interpreter shortages and the need for quick communication solutions.

  • The desire for sign language recognition to facilitate efficiency in various tasks (ability to sign your notes, being able to caption sign video faster etc).

What is Sign-Speak’s goal?

The Sign-Speak team was born from a shared vision to revolutionize communication, driven by Nikolas (Niko) Kelly's personal experiences. Witnessing the lack of accessibility for himself and the community, Nikolas, while at the National Technical Institute of the Deaf, recognized the stark contrast in interpreter access between NTID/RIT and the broader world.

This realization prompted him to question the discrepancies in service and product accessibility. Determined to make a difference, Nikolas recruited Nicholas Wilkins and Yamillet Payano to co-found an AI company focused on sign language recognition. This endeavor aimed to provide Nikolas and our community with another avenue for access. 

Last year we've welcomed Brian Hertneky, a seasoned Deaf entrepreneur and marketing expert, adding invaluable expertise to our team.

Composed of diverse backgrounds in machine learning, business, product development, and policy, our team collaborates to develop reliable, safe, and beneficial products. Explore our open roles and join us in our mission at Careers.

Who is part of the Sign-Speak team? 

  • Sign-Speak currently is working to offer a closed captioning or cc system to the Deaf and Hard of Hearing community that will make it easier for all of us to provide accessibility by captioning our ASL videos. 

  • We are also currently testing our bidirectional automated American Sign Language (ASL) system that allows for sign language to voice and vice versa in real-time. 

We want sign language technology to be as widely spread as voice recognition. So that we finally can have functional equivalency and accessibility where there is none.

What is Sign-Speak currently working on?

  • Sign-Speak is looking at the problem from all angles and we are uniquely using the avatar, sign language recognition, and captioning in a comprehensive tool to be able to address the diversity of communication needs within our community.

  • We are also approaching this from a COMMUNITY CENTRIC APPROACH. Meaning that we are committed to user feedback and iterations of our technology to make sure that the community gets a continuously better experience.

  • We have an inclusive vision where we believe that we need to bring all the stakeholders in the community together to foster a culture of inclusivity, diversity, and accessibility.

  • We are using 2D cameras to solve this issue so there is no special equipment needed.

What makes Sign-Speak unique? 

We actively engage with our diverse Deaf and Hard of Hearing community across the US to gather data, ensuring the representation of regional variations and cultural nuances.

We are also committed to regular updates to our model based on community feedback to help improve the experience of the Deaf and Hard of Hearing customers over time. The more you use our products the more it gets used to your signs, and the more you elevate the service we provide to you.

How do you handle the potential biases in your training data, particularly regarding regional variations in sign language expressions and cultural nuances?

There are many challenges technologically speaking, as many people have been trying to “crack” sign language barriers for many years now. We have seen many companies try this for the last couple of years and Sign-Speak is among multiple companies that are trying to build this. We have learned from the mistakes of previous startups and have implemented effective strategies for developing a system that can recognize sign language.

Nonetheless, we are at the start of our journey and we hope that you join us for the ride to meet the accessibility needs of all individuals who are Deaf and Hard of Hearing tailored to empower their autonomy.

Who else is building this technology?