Soca: Blind person helper

Project Overview

‍

Soca is a blind-person helper app to connects blind people and volunteers. You can sign up as a blind or volunteer user to help a blind person. Soca utilizes video calling & speech recognition features to help blind people. Volunteers can see what the cameras record from blind users and can control the blind user's device flashlight when calling.

‍

What is a blind person to do?

1. The blind user can use Siri or Google Assistant to make a help call, then Soca will connect blind people and a volunteer.
2. When a blind person connects with a volunteer, a blind person can ask anything to get information about what's camera recording is now. For example, "Can you read the expiration date of this food, please?" or "What is the nominal of this money?".

‍

What is a volunteer to do?

1. Volunteers will be notified when a blind person makes a help call.
2. Volunteers can reject or answer the help call.
3. When answering a call, the volunteer can see real-time video from a blind person, and the volunteer must answer questions from a blind person.

‍

Development

I'm using firebase to build a backend with typescript language and using callable to communicate between server and client. Also, I'm using Agora RTC Engine to make video calling features and implement VOIP to handle incoming calling in the background with OneSignal.

‍

Creating an app for blind users, it's tough. I waste more time figuring out how to make this app blind person friendly and the excellent way it makes speech recognition features. So I'm integrating my app with Siri and Google Assistant.

‍

‍