Cyborg Ar Hud Smart Helmet

jstarne1

USA

Hello all! My most recent project I started and currently tinkering with is a Smart Helmet. In short it has a Heads Up Display that shows telemetry, information, navigation, music selection and also a couple camera feeds. I would like to use EZ robot for a number of the features in this project. One that I would like to learn is how to make a overlay on video to show information sensors read. ANY help is greatly appreciated as I am on a time crunch to get a working model together. It is a Hackaday challenge as well. Here is the link of what was done so far , but I will copy a bit here as well since it is a EZ robot based project.

https://hackaday.io/project/159547-cyborg-360-ar-hud-app-enabled-motorcycle-helmet

This is a learning experience for me and some features I am not proficient in, Thanks !

By — Last update

ARC Pro

Upgrade to ARC Pro

Unleash your creativity with the power of easy robot programming using Synthiam ARC Pro

#2  

So I hollowed out a Gear Vr Headset and the intention is to use this to house the reflector of the lcd screens that create the augmented reality , heads up display.

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

User-inserted image

#3  

Hardware so far

Kedei 3.5 inch 800 x 400 screens 267 ppi , 3 of these

Latte Panda x86 Win 10 board

Raspberry Pi + Pi Cam and cables x 3

Ezb iotiny

Red leds x 100

Yellow/ Amber Leds x 100

Samsung Gear VR headset heavily hacked up

I have Automotive style Ultrasonic Sensors that are water proof

#5  

I would love to utilize object recognition on this project for things like Stop Signs or Yield signs and Red/ Yellow/ Green traffic lights

Also I would really like to figure out a way to display these on the heads up screen, I need the background and frames to be black so that I dont cause too much distraction with the lcd. Basically I guess I am talking about a overlay on the video processing, but I dont need to see the actual video feed, that can be black.

#6  

User-inserted image

waterproof automotive style ultras sonic I have I could use for a clean install on this project

#8  

I would like to show a arrow or car icon when a vehicle is close to a blind spot in the AR hud feed.

Belgium
#9  

Great post ! Love your work !

#10  

So, you would wear this while riding a motorcycle and it would block your natural vision? Wow, very interesting and ahead of the curve. Kinda unnerving but futuristic and something I'd expect to see in a Bladerunner type movie.

Would you build a failsafe to let the rider see through if there is a problem or power failure? Maybe a button that can be pushed or explosive caps placed to quickly eject the electronics out of the way of the view. eek