Germany
Asked

Brainstorm For Saving Lives

Hey @all, i have a bit of a difficult question. I have a person in my house which is now 98 and i want to help her out. I have this idea for a long time now and I’m working on it when ever I can. i want to take a jd and make it a bit bigger, it should help her when something falls to the ground or when she needs help carrying. But the most important part is the health part. when she falls down or her hart beat gets critical JD has to call/message me. I’ve integrated my house automation so the doors can be unlocked, lights on off, shades up down,... stuff like that. But how could I get information from wearable devices like the Apple Watch (perfekt for older people, really saves life’s!!)? how can I get JD to recognize her falling and laying on the ground? Recognizing blood for example if she hurts when falling?  I got JD to charge itself through inductive charging, so battery is no problem. Also the recognition of face and mouth separately is important if she chokes on something or the breathing is down (choking on tongue for example). I’m building a bigger version so he can carry up to 150 kilo or picking her back up or just pushing her to a stable side. Does anyone have a good idea or maybe a code which I may use or try? I want to save her life in emergency’s and let her feel safer at home. thanks a lot and have a nice week to all!


Related Hardware JD Humanoid

ARC Pro

Upgrade to ARC Pro

Discover the limitless potential of robot programming with Synthiam ARC Pro – where innovation and creativity meet seamlessly.

PRO
USA
#1   — Edited

Quote:

Does anyone have a good idea or maybe a code which I may use or try?
There is no code for that, browse the existent projects, check the tutorials and you will get your conclusions.

Quote:

I want to save her life in emergency’s and let her feel safer at home.
That is not a job for an "Amateur/DIY" robot, is a huge and critical responsibility, basically what you need is a professional Nurse.

Quote:

I’m building a bigger version so he can carry up to 150 kilo or picking her back up or just pushing her to a stable side.
What kind of hardware/motors/mechanics are you using ? I imagined you have an idea of the final hardware cost ?

Quote:

But how could I get information from wearable devices like the Apple Watch
Worst case scenario: you need to develop an iOS apple application, you can read more about the apple developer program:  https://developer.apple.com/programs/

Quote:

how can I get JD to recognize her falling and laying on the ground?
you will need to develop your algorithms, you will need to manipulate images opencv is a good start: https://docs.opencv.org/master/index.html then you will need to train your visual models for recognition using machine learning tools: tensorflow https://www.tensorflow.org/ is a good start. To help the detection you should add a 3D camera for depth, Intel and Orbbec are affordable choices, maybe you should add a body/skeleton track camera new Microsoft Kinect:  https://azure.microsoft.com/en-us/services/kinect-dk/

#2  

Thanks a lot for the info. The nurse/doctor is within 10 minutes here so the robot just has to keep her alive and save her for this time. JD is maybe what a lot of people call a toy but it’s full potential comes from the people who keep developing it and start using it the way they need it. Adding and replacing parts, combining them with other tools and so on. Everything big starts small, but that’s another story.

Thanks so much for the help I’m gonna get a hardware list up in a couple of days so you’ll see what I’m using. The 3D cam is the next step!

Have a great day

PRO
Synthiam
#3  

Your expectations of a robot are aligned with everyone here - so you’re in a good place to discuss thins like this.

The industry is working toward what you have described. However, it takes a community like this to push the limits and break through the barriers with unique approaches that engineers haven’t considered.

My recommendation is always to start small and split your project requirements into smaller components. That means tackling each requirement separately. You can use an ezrobot jd or a robotis bioloid or any capable humanoid that’s compatible with synthiams software platform.

Id recommend using the ezrobot ezb v4 with what ever robot you choose because they have the best, in my opinion, for modularity.

#4  

Hi @Reaper21, Facial / object recognition is a good way to start. If she stays basically in one room she can be tracked. I would consider the commercial services which use a pendant to nofity someone for help. Ron