Cyborg Ar Hud Smart Helmet

jstarne1

USA

Hello all! My most recent project I started and currently tinkering with is a Smart Helmet. In short it has a Heads Up Display that shows telemetry, information, navigation, music selection and also a couple camera feeds. I would like to use EZ robot for a number of the features in this project. One that I would like to learn is how to make a overlay on video to show information sensors read. ANY help is greatly appreciated as I am on a time crunch to get a working model together. It is a Hackaday challenge as well. Here is the link of what was done so far , but I will copy a bit here as well since it is a EZ robot based project.

https://hackaday.io/project/159547-cyborg-360-ar-hud-app-enabled-motorcycle-helmet

This is a learning experience for me and some features I am not proficient in, Thanks !

By — Last update

ARC Pro

Upgrade to ARC Pro

Experience early access to the latest features and updates. You'll have everything that is needed to unleash your robot's potential.

#2  

So I hollowed out a Gear Vr Headset and the intention is to use this to house the reflector of the lcd screens that create the augmented reality , heads up display.

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

#3  

Hardware so far

Kedei 3.5 inch 800 x 400 screens 267 ppi , 3 of these

Latte Panda x86 Win 10 board

Raspberry Pi + Pi Cam and cables x 3

Ezb iotiny

Red leds x 100

Yellow/ Amber Leds x 100

Samsung Gear VR headset heavily hacked up

I have Automotive style Ultrasonic Sensors that are water proof

#5  

I would love to utilize object recognition on this project for things like Stop Signs or Yield signs and Red/ Yellow/ Green traffic lights

Also I would really like to figure out a way to display these on the heads up screen, I need the background and frames to be black so that I dont cause too much distraction with the lcd. Basically I guess I am talking about a overlay on the video processing, but I dont need to see the actual video feed, that can be black.

#6  

User-inserted image

waterproof automotive style ultras sonic I have I could use for a clean install on this project

#8  

I would like to show a arrow or car icon when a vehicle is close to a blind spot in the AR hud feed.