## Inspiration

Want to take advantage of the AR and object detection technologies to help people to gain safer walking experiences and communicate distance information to help people with visual loss navigate.

## What it does

Augment the world with the beeping sounds that change depending on your proximity towards obstacles and identifying surrounding objects and convert to speech to alert the user.

## How we built it

ARKit; RealityKit uses Lidar sensor to detect the distance; AVFoundation, text to speech technology; CoreML with YoloV3 real time object detection machine learning model; SwiftUI

## Challenges we ran into

Computational efficiency. Going through all pixels in the LiDAR sensor in real time wasn’t feasible. We had to optimize by cropping sensor data to the center of the screen

## Accomplishments that we're proud of

It works as intended.

## What we learned

We learned how to combine AR, AI, LiDar, ARKit and SwiftUI to make an iOS app in 15 hours.

## What's next for SeerAR

Expand to Apple watch and Android devices;
Improve the accuracy of object detection and recognition;
Connect with Firebase and Google cloud APIs;
## Inspiration

One of our teammate’s grandfathers suffers from diabetic retinopathy, which causes severe vision loss.
Looking on a broader scale, over 2.2 billion people suffer from near or distant vision impairment worldwide. After examining the issue closer, it can be confirmed that the issue disproportionately affects people over the age of 50 years old. We wanted to create a solution that would help them navigate the complex world independently.

## What it does

### Object Identification:

Utilizes advanced computer vision to identify and describe objects in the user's surroundings, providing real-time audio feedback.

### Facial Recognition:

It employs machine learning for facial recognition, enabling users to recognize and remember familiar faces, and fostering a deeper connection with their environment.

### Interactive Question Answering:

Acts as an on-demand information resource, allowing users to ask questions and receive accurate answers, covering a wide range of topics.

### Voice Commands:

Features a user-friendly voice command system accessible to all, facilitating seamless interaction with the AI assistant: Sierra.

## How we built it

* Python
* OpenCV
* GCP & Firebase
* Google Maps API, Google Pyttsx3, Google’s VERTEX AI Toolkit (removed later due to inefficiency)

## Challenges we ran into

* Slow response times with Google Products, resulting in some replacements of services (e.g. Pyttsx3 was replaced by a faster, offline nlp model from Vosk)
* Due to the hardware capabilities of our low-end laptops, there is some amount of lag and slowness in the software with average response times of 7-8 seconds.
* Due to strict security measures and product design, we faced a lack of flexibility in working with the Maps API. After working together with each other and viewing some tutorials, we learned how to integrate Google Maps into the dashboard

## Accomplishments that we're proud of

We are proud that by the end of the hacking period, we had a working prototype and software. Both of these factors were able to integrate properly. The AI assistant, Sierra, can accurately recognize faces as well as detect settings in the real world. Although there were challenges along the way, the immense effort we put in paid off.

## What we learned

* How to work with a variety of Google Cloud-based tools and how to overcome potential challenges they pose to beginner users.
* How to connect a smartphone to a laptop with a remote connection to create more opportunities for practical designs and demonstrations.
How to connect a smartphone to a laptop with a remote connection to create more opportunities for practical designs and demonstrations.
How to create docker containers to deploy google cloud-based flask applications to host our dashboard.
How to develop Firebase Cloud Functions to implement cron jobs. We tried to developed a cron job that would send alerts to the user.

## What's next for Saight

### Optimizing the Response Time

Currently, the hardware limitations of our computers create a large delay in the assistant's response times. By improving the efficiency of the models used, we can improve the user experience in fast-paced environments.

### Testing Various Materials for the Mount

The physical prototype of the mount was mainly a proof-of-concept for the idea. In the future, we can conduct research and testing on various materials to find out which ones are most preferred by users. Factors such as density, cost and durability will all play a role in this decision.
## Inspiration

It was our first time at a Hackathon, so we decided to put our own enjoyment and quality of time there over accomplishing any of the verticals/ challenges set out by Treehacks itself. We made a promise to ourselves that as long as we were proud with what we created regardless of how insignificant or lackluster it may be compared to the real breadwinners, we’d be successful. So we started by just throwing random pitches about things we may be able to do. Eventually, Michelle suggested using Ren’Py to create a game. At first Kendrick thought it was a joke, but we ultimately decided to go through with it, and here we are now.

## What it does

It’s a short visual novel game that puts you in the shoes of a high school student transferring to a new school. You, the protagonist, recently purchased a new laptop. However, you run into the struggle of not knowing which internet browser is right for you. When you attend school, you run into three students, Google Chrome, Mozilla Firefox, and Safari, who all have different personality types. Your experience with them will help you decide which internet browser you would like to use in the end!

## How we built it

We used a program called Ren’Py that helps to create visual novel type of games. The program was made using Python and Cython, but writing out the actual code uses Python.

## Challenges we ran into

Kendrick: I didn’t know how to use Ren’Py, so I had to adopt the “monkey see monkey do” mindset. It was rough, but I thoroughly enjoyed the time spent on this project.
Michelle: One thing I felt like was a big problem was the amount of time that we were given. Me, with poor time management skills, was always distracted, but I was able to pull through and get the game finished.

## Accomplishments that we're proud of

Being the first Hackathon we have ever attended, the entire game was a huge accomplishment for us. We had fun working together, laughing at all the scenarios and ideas that we came up with. Because we struggled so hard in the beginning, we feel so accomplished that we learned from these struggles and that we were able to pull through and get as much finished as we could. Although we did not entirely complete what we had planned for the story, we enjoyed ourselves and had a great time.

## What we learned

Time management: sometimes one has to buckle down and just push through to get things accomplished.
Teamwork: We were pretty much at different skill levels when starting this project. However, we both motivated each other to sit ourselves down and get cracking on this project.
Relax: The last thing one wants to do at a Hackathon is stress out! People barely get enough sleep already. Working at one's own pace brought us a much more enjoyable experience at this first hackathon.

## What's next for Browsing for the Right One!

Browsing for the Right One! Was ultimately cut short of what it was projected to be. So, as a possible future endeavor, we may expand the content of this shell of a game by adding what we intentionally wanted inside it before the reality of the situation took its toll: a deeper plot, more choices for the player to make, as well as multiple endings.