Cyborg Ar Hud Smart Helmet

jstarne1

USA

Hello all! My most recent project I started and currently tinkering with is a Smart Helmet. In short it has a Heads Up Display that shows telemetry, information, navigation, music selection and also a couple camera feeds. I would like to use EZ robot for a number of the features in this project. One that I would like to learn is how to make a overlay on video to show information sensors read. ANY help is greatly appreciated as I am on a time crunch to get a working model together. It is a Hackaday challenge as well. Here is the link of what was done so far , but I will copy a bit here as well since it is a EZ robot based project.

https://hackaday.io/project/159547-cyborg-360-ar-hud-app-enabled-motorcycle-helmet

This is a learning experience for me and some features I am not proficient in, Thanks !

By — Last update
Jump to end

ARC Pro

Upgrade to ARC Pro

Get access to the latest features and updates before they're released. You'll have everything that's needed to unleash your robot's potential!

#2  

So I hollowed out a Gear Vr Headset and the intention is to use this to house the reflector of the lcd screens that create the augmented reality , heads up display.

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

#3  

Hardware so far

Kedei 3.5 inch 800 x 400 screens 267 ppi , 3 of these

Latte Panda x86 Win 10 board

Raspberry Pi + Pi Cam and cables x 3

Ezb iotiny

Red leds x 100

Yellow/ Amber Leds x 100

Samsung Gear VR headset heavily hacked up

I have Automotive style Ultrasonic Sensors that are water proof

#5  

I would love to utilize object recognition on this project for things like Stop Signs or Yield signs and Red/ Yellow/ Green traffic lights

Also I would really like to figure out a way to display these on the heads up screen, I need the background and frames to be black so that I dont cause too much distraction with the lcd. Basically I guess I am talking about a overlay on the video processing, but I dont need to see the actual video feed, that can be black.

#6  

User-inserted image

waterproof automotive style ultras sonic I have I could use for a clean install on this project

#8  

I would like to show a arrow or car icon when a vehicle is close to a blind spot in the AR hud feed.