## Inspiration

Our mission is to foster a **culture of understanding**. A culture where people of diverse backgrounds get to truly *connect* with each other. But, how can we reduce the barriers that exists today and make the world more inclusive?
Our solution is to bridge the communication gap of **people with different races and cultures** and **people of different physical abilities**.

## What we built

In 36 hours, we created a mixed reality app that allows everyone in the conversation to communicate using their most comfortable method:

You want to communicate using your mother tongue?
Your friend wants to communicate using sign language?
Your aunt is hard of hearing and she wants to communicate without that back-and-forth frustration?

Our app enables everyone to do that.

## How we built it

VRbind takes in speech and coverts it into text using Bing Speech API. Internally, that text is then translated into your mother tongue language using Google Translate API, and given out as speech back to the user through the built-in speaker on Oculus Rift. Additionally, we also provide a platform where the user can communicate using sign language. This is detected using the leap motion controller and interpreted as an English text. Similarly, the text is then translated into your mother tongue language and given out as speech to Oculus Rift.

## Challenges we ran into

We are running our program in Unity, therefore the challenge is in converting all our APIs into C#.

## Accomplishments that we are proud of

We are proud that we were able complete with all the essential feature that we intended to implement and troubleshoot the problems that we had successfully throughout the competition.

## What we learned

We learn how to code in C# as well as how to select, implement, and integrate different APIs onto the unity platform.

## What's next for VRbind

Facial, voice, and body language emotional analysis of the person that you are speaking with.
## Inspiration

Students often have a hard time finding complementary co-founders for their ventures/ideas and have limited interaction with students from other universities. Many universities don't even have entrepreneurship centers to help facilitate the matching of co-founders. Furthermore, it is hard to seek validation from a wide range of perspectives on your ideas when you're immediate network is just your university peers.

## What it does

VenYard is a gamified platform that keeps users engaged and interested in entrepreneurship while building a community where students can search for co-founders across the world based on complementary skill sets and personas. VenYard’s collaboration features also extend to the ideation process feature where students can seek feedback and validation on their ideas from students beyond their university. We want to give the same access to entrepreneurship and venture building to every student across the world so they can have the tools and support to change the world.

## How we built it

We built VenYard using JS, HTML, CSS, Node.js, MySQL, and a lack of sleep!

## Challenges we ran into

We had several database-related issues related to the project submission page and the chat feature on each project dashboard. Furthermore, when clicking on a participant on a project's dashboard, we wanted their profile to be brought up but we ran into database issues there but that is the first problem we hope to fix.

## Accomplishments that we're proud of

For a pair of programmers who have horrible taste in design, we are proud of how this project turned out visually. We are also proud of how we have reached a point in our programming abilities where we are able to turn our ideas into reality!

## What we learned

We were able to advance our knowledge of MySql and Javascript specifically. Aside from that, we were also able to practice pair programming by using the LiveShare extension on VSCode.

## What's next for VenYard

We hope to expand the "Matching" feature by making it so that users can specify more criteria for what they want in the ideal co-founder. Additionally, we probably would have to take a look at the UI and make sure it's user-friendly because there are a few aspects that are still a little clunky. Lastly, the profile search feature needs to be redone because our initial idea of combining search and matching profiles doesn't make sense.

## User Credentials if you do not want to create an account

username: [revantkantamneni@gmail.com](mailto:revantkantamneni@gmail.com)
password: revant

## Submission Category

Education and Social Good

## Discord Name

revantk16#6733, nicholas#2124
## Inspiration

Our inspiration stemmed from the desire to empower the deaf and hard of hearing community by providing them with a more inclusive means of communication. We recognized the importance of American Sign Language (ASL) as a primary mode of communication for many individuals and sought to leverage technology to make ASL more accessible in virtual environments.

## What it does

ASL GestureSense Unity is a groundbreaking project that enables real-time recognition and interpretation of American Sign Language (ASL) gestures in virtual environments. It allows users to interact naturally and intuitively with digital applications using ASL, bridging communication gaps and fostering inclusivity.

## How we built it

ASL GestureSense Unity was developed using Unity, Met Quest 2, and various XR interaction toolkits. Unity provided the foundational environment for our project, allowing us to leverage its powerful rendering capabilities and cross-platform compatibility.

The integration of Met Quest 2 extended our project's capabilities with its advanced hardware features, including high-resolution displays, precise motion tracking, and hand gesture recognition. We harnessed these features to create immersive experiences that closely mimic real-world interactions.

In conjunction with Unity and Met Quest 2, we employed XR interaction toolkits such as the XR Interaction Toolkit and VRTK (Virtual Reality Toolkit). These toolkits enabled us to implement complex interaction mechanics, including hand tracking, gesture recognition, and object manipulation. Additionally, VRTK complemented our development efforts by offering a wide range of tools and utilities designed to streamline the creation of interactive VR applications. With VRTK, we were able to enhance our project with advanced hand gesture recognition capabilities, enabling precise detection and interpretation of gestures performed by users' left and right hands.

We utilized Unity's native scripting API along with custom shaders and physics simulations to achieve lifelike interactions and visual effects.

Throughout the development cycle, we conducted rigorous testing and optimization to ensure optimal performance across different devices and platforms.

## Challenges we ran into

During our journey, we encountered a variety of challenges that tested our problem-solving skills and resilience. One significant hurdle was grappling with compatibility issues between Meta Quest 2 and both mobile phones and laptops. Ensuring seamless interaction across different devices proved to be a daunting task.

Furthermore, we faced numerous build issues, particularly in configuring project settings and managing packages. Unity editor version compatibility also emerged as a persistent issue, requiring careful navigation and troubleshooting to maintain project stability and functionality.

Moreover, addressing boundary loss in Meta Quest 2 controllers presented its own set of challenges, demanding innovative solutions to ensure reliable tracking and user experience in virtual environments.

Despite these obstacles, our team remained dedicated and resourceful, leveraging our collective expertise to overcome each challenge and propel the project forward.

## Accomplishments that we're proud of

One of our proudest achievements is venturing into virtual reality (VR) and Meta Quest 2 for the first time. Despite the novelty and complexity, we swiftly integrated the hardware with our software in a remarkably short period. Navigating VR hardware and establishing seamless communication demanded dedication and perseverance, expanding our technical prowess.

Witnessing our user interface (UI) on the Meta Quest platform was a significant milestone. For VR novices, this integration validated our adaptability and enthusiasm. It fueled further exploration in VR design and development, marking a transformative journey into uncharted technological terrain.

## What we learned

Our project journey underscored the value of embracing new challenges without hesitation. We learned that perseverance and a willingness to explore the unknown are vital for growth. By confronting difficulties head-on, we gained invaluable insights and experiences that transcend technical skills. Above all, we discovered that pushing beyond our comfort zones fosters resilience and adaptability, essential qualities in the dynamic world of technology.

## What's next for ASL GestureSense Unity

Our vision extends beyond gesture recognition. We aim to incorporate subtitle features for hand gestures, enhancing accessibility and learning opportunities. Additionally, we're committed to developing comprehensive tutorials to facilitate the learning of sign language. By combining innovation with education, we aspire to empower individuals and promote inclusivity on a broader scale.