## Inspiration

Inspired by leap motion applications

## What it does

User can their gesture to control motor, speaker, and led matrix.

## How we built it

Use arduino to control motor, speaker, led matrix and use Bluetooth to connect with computer that is connected to Oculus and leap-motion.

## Challenges we ran into

Put augmented reality overlay onto the things that we want to control.

## Accomplishments that we're proud of

Successfully controlled their components using gestures.

## What we learned

How to make use of Oculus and Leap-motion.

## What's next for Augmented Reality Control Experience (ARCX)

People with disabilities can use this technology to control their technologies such as turning on lights and playing music.
## Inspiration

Video games evolved when the Xbox Kinect was released in 2010 but for some reason we reverted back to controller based games. We are here to bring back the amazingness of movement controlled games with a new twist- re innovating how mobile games are played!

## What it does

AR.cade uses a body part detection model to track movements that correspond to controls for classic games that are ran through an online browser. The user can choose from a variety of classic games such as temple run, super mario, and play them with their body movements.

## How we built it

* The first step was setting up opencv and importing the a body part tracking model from google mediapipe
* Next, based off the position and angles between the landmarks, we created classification functions that detected specific movements such as when an arm or leg was raised or the user jumped.
* Then we correlated these movement identifications to keybinds on the computer. For example when the user raises their right arm it corresponds to the right arrow key
* We then embedded some online games of our choice into our front and and when the user makes a certain movement which corresponds to a certain key, the respective action would happen
* Finally, we created a visually appealing and interactive frontend/loading page where the user can select which game they want to play

## Challenges we ran into

A large challenge we ran into was embedding the video output window into the front end. We tried passing it through an API and it worked with a basic plane video, however the difficulties arose when we tried to pass the video with the body tracking model overlay on it

## Accomplishments that we're proud of

We are proud of the fact that we are able to have a functioning product in the sense that multiple games can be controlled with body part commands of our specification. Thanks to threading optimization there is little latency between user input and video output which was a fear when starting the project.

## What we learned

We learned that it is possible to embed other websites (such as simple games) into our own local HTML sites.

We learned how to map landmark node positions into meaningful movement classifications considering positions, and angles.

We learned how to resize, move, and give priority to external windows such as the video output window

We learned how to run python files from JavaScript to make automated calls to further processes

## What's next for AR.cade

The next steps for AR.cade are to implement a more accurate body tracking model in order to track more precise parameters. This would allow us to scale our product to more modern games that require more user inputs such as Fortnite or Minecraft.
## Inspiration

We attended an AR workshop and thought it would be interesting to do an AR project with Unity. Initially, we hoped to make an educational tool for Physics classrooms, but later we found the idea hard to implement and changed our idea to making an AR game.

## What it does

LIDAR Marble Due is a 1v1 game where players take turns using tilt control to move the marble from a spawn position to a goal position. But watch out! The game takes into account the terrain of the physical world. So a physical obstacle in real life has a collision size! After each round, players can place various kinds of virtual obstacles (for example, bumpers, spikes, and fans) to increase the difficulty. If the marble touches spikes three times, the player is out. The first player who fails to move the marble to the goal position loses, and the opponent wins.

## How we built it

LIDAR Marble Duel is built with Unity.

## Challenges we ran into

We had difficulty manipulating quaternions while implementing tilt control. Also, we only have one iOS device with LIDAR, which made testing difficult.

## Accomplishments that we're proud of

It's our first time dealing with AR, and we made a functional (and fun!) game!

## What we learned

Never trust Euler angles.

Aside from that, we learned the basics of AR development using Unity and how to deploy a build to an iOS device.

## What's next for LIDAR Marble Duel

We plan to add more features (e.g., more virtual obstacles) and improve the UI of the game before submitting the game to App Store.