top of page
Screen Shot 2022-10-06 at 11_edited.png

We developed an AI system that can help visually impaired people recognize scene curved text accurately and conveniently in their daily lives. A vision assistance system that helps visually impaired people interact with the modern world.

Crystal Eye

How does it work?

Capture with Camera.

Upload picture to Phone App.

Recognition.

AI Technology for Scene Curved Text Detection and Recognition

Product Features

Screen Shot 2022-10-06 at 5.59.53 PM.png

​Object Recognition

Accurately recognizes a large range of different types of objects and shows the possibility of the recognition (0~1)

Screen Shot 2022-10-06 at 5.31.39 PM.png

Text Recognition

Can accurately recognize organized text and displays the recognition time (average below 1.5 seconds)

Screen Shot 2022-10-06 at 5.24.48 PM.png

Recognize Currency

Recognizes different types of currency (rmb, euro, dollar) and also the value/amount of the piece of paper money.

Screen Shot 2022-10-07 at 12.51.01 PM.png

Scene Curved Text

Curved or distorted scene text can also be accurately recognized through the system that we have developed and deployed.

Assistance System

We developed an assistance system that contains 2 different scene curved text detection and recognition algorithms with different balances between accuracy and speed: the two-stage algorithm Differentiable Binarization Network (DBNet) and End-to-End algorithm Point Gathering Network (PGNet). 

Phone App

We also developed a user-friendly mobile APP to call on these algorithms, along with other types of recognition (such as object, face and plant ). To help visually impaired people use my system more conveniently, we added speech recognition and speech synthesis for APP control.

Advantages

Screen Shot 2022-12-28 at 12.19.36 PM.png
Screen Shot 2022-12-28 at 12.14.01 PM.png
Screen Shot 2022-12-27 at 11_edited.jpg

Decreased Cost

- To decrease the cost, we leveraged cloud computing power and phone computing power, making it more affordable for the visually impaired people in our society.

5G and 4G networks

- By taking advantage of 5G and 4G networks already existing in many places, it can increase the accessibility of our product to the visually impaired and can also decrease the cost.

Small camera

- Camera is small in size and can be attached to any pair of glasses then connected to a mobile phone, it is lighter, more accessible, and not as inconveniently gigantic.

Screen Shot 2022-12-29 at 9.03.11 PM.png

Easy Updates

Screen Shot 2022-12-29 at 9.25.35 PM.png

Accesible Service

- New updates and features in the system can be easily deployed to the glasses so that there isn't the need of getting a new one per every update *远程升级

- Easily accessible to the visually impaired and payment occurs monthly, can choose one of three different services: Standard, Navigation and Scene Understanding

Screen Shot 2022-12-27 at 9.12.09 PM.png

​Visually impaired hoped to not only understand the static objects and text in their environment but also the movements and human action of others in their environment as well, to navigate freely and get to their destination.

bottom of page