Hardy Dynamics
USA
Requested
RTMP Camera Stream
Completed
This feature request has been completed. Install the latest ARC Pro to experience the newest features and bug fixes.Get ARC Pro
It would be pretty awesome to have RTMP camera stream available. There are more and more VR / stereoscopic cameras available on the market that incorporate RTMP servers, which would enable truly powerful telepresence robots.
I am quickly learning you need a lot of cameras to do anything useful in robotics. So being able to add really cheap cameras as well and stream back to ARC would be good. Something like an ESP32 cam that is small and cheap. This looked interesting but I haven't had a chance to play with it yet. https://synthiam.com/Support/Skills/Camera/Live-Stream-Receiver?id=18696
Rtmp stream is a good idea given the device has a low latency buffer. I’ll look into it for ya! Many wifi webcams and such have a few second delay, which makes them impossible to use for robotics. Anything with a delay can’t be used.
but given you have some suggestions that are used for real-time vr, that would be something useful!
nink, the esp32 cam is 1 or 2 frames per second. I don’t think that’s worth supporting. There was a lengthy discussion about it a year ago or so where we determined it’s just too slow
Nink. Also if you’re looking to stream your camera view or create telepresence, use exosphere: https://synthiam.com/Support/Skills/Machine-Learning/Exosphere?id=18753
there’s also a tutorial on using exosphere for two way telepresence.
I just bought a Vuze XR camera. It's really quite excellent quality recording, the preview is ok [4k @ 30fps]. Relatively low latency - .5 - 1 second. It's not perfect, but should work for telepresence humanoid. It's got a built in RTMP server (most the new VR cameras have them). I think it's just a matter of connecting the dots, but this isn't my area of expertise...
I’ll see what I can do for ya!
I saw some hacks to get 20 to 25 fps on the ESP. If I get bored I will have a play. I have a bunch I ordered from China gathering dust.
Actually just sent my ESP back on amazon, just couldn't get it to work well.
Yeah, there’s a number of issues with it - mostly the tcp/ip stack was written by a drunk sailor. Did you put the ezb firmware on it?
Ezb firmware: https://synthiam.com/Support/Hardware/DOIT-Esp32-DevKit-v1
Hahaha I've heard that. I didn't even think about making it into an EZ-B. A little worried about bricking a $400 camera though...
Brain not working - was mixing up the Vuze XR and the ESP cameras. Too many computer windows open.
Ha I hear you. Now it’s my turn to need clarity lol - Did you send back the vuze or the esp?
Sent back the ESP - kept the Vuze XR
Here you go, check this out: https://synthiam.com/Support/Skills/Camera/Stream-All-The-Video-Sources?id=20279