Requested

RTMP Camera Stream


Completed
This feature request has been completed. Install the latest ARC Pro to experience the newest features and bug fixes.

Get ARC Pro

It would be pretty awesome to have RTMP camera stream available. There are more and more VR / stereoscopic cameras available on the market that incorporate RTMP servers, which would enable truly powerful telepresence robots.


ARC Pro

Upgrade to ARC Pro

ARC Pro is more than a tool; it's a creative playground for robot enthusiasts, where you can turn your wildest ideas into reality.

PRO
Canada
#1   — Edited

I am quickly learning you need a lot of cameras to do anything useful in robotics.  So being able to add really cheap cameras as well and stream back to ARC would be good. Something like an ESP32 cam that is small and cheap.   This looked interesting but I haven't had a chance to play with it yet. https://synthiam.com/Support/Skills/Camera/Live-Stream-Receiver?id=18696

PRO
Synthiam
#2  

Rtmp stream is a good idea given the device has a low latency buffer. I’ll look into it for ya! Many wifi webcams and such have a few second delay, which makes them impossible to use for robotics. Anything with a delay can’t be used.

but given you have some suggestions that are used for real-time vr, that would be something useful!

nink, the esp32 cam is 1 or 2 frames per second. I don’t think that’s worth supporting. There was a lengthy discussion about it a year ago or so where we determined it’s just too slow

PRO
Synthiam
#3  

Nink. Also if you’re looking to stream your camera view or create telepresence, use exosphere: https://synthiam.com/Support/Skills/Machine-Learning/Exosphere?id=18753

there’s also a tutorial on using exosphere for two way telepresence.

#4  

I just bought a Vuze XR camera. It's really quite excellent quality recording, the preview is ok [4k @ 30fps]. Relatively low latency - .5 - 1 second. It's not perfect, but should work for telepresence humanoid. It's got a built in RTMP server (most the new VR cameras have them). I think it's just a matter of connecting the dots, but this isn't my area of expertise...

PRO
Synthiam
#5  

I’ll see what I can do for ya!

PRO
Canada
#6  

I saw some hacks to get 20 to 25 fps on the ESP.  If I get bored I will have a play.  I have a bunch I ordered from China gathering dust.

#7  

Actually just sent my ESP back on amazon, just couldn't get it to work well.

PRO
Synthiam
#8   — Edited

Yeah, there’s a number of issues with it - mostly the tcp/ip stack was written by a drunk sailor. Did you put the ezb firmware on it?

Ezb firmware: https://synthiam.com/Support/Hardware/DOIT-Esp32-DevKit-v1

#9  

Hahaha I've heard that. I didn't even think about making it into an EZ-B. A little worried about bricking a $400 camera though...

#10  

Brain not working - was mixing up the Vuze XR and the ESP cameras. Too many computer windows open.

PRO
Synthiam
#11  

Ha I hear you. Now it’s my turn to need clarity lol - Did you send back the vuze or the esp?

PRO
Synthiam
#13  

Here you go, check this out: https://synthiam.com/Support/Skills/Camera/Stream-All-The-Video-Sources?id=20279