Asked

Microsoft Copilot

Any people out there working on Microsoft Co-Pilot integration for speech? That would be amazing!

We use it all the time and it has rapidly become quite capable. Would be interesting to deploy a custom pre trained conversational model.


ARC Pro

Upgrade to ARC Pro

Unlock the true power of automation and robotics by becoming a proud subscriber of Synthiam ARC Pro.

PRO
Canada
#1  

As of my last update, there isn't a specific Microsoft CoPilot robot skill available in the Synthiam ARC platform. However, the idea of integrating Microsoft CoPilot or any advanced conversational AI model into your robot project is indeed fascinating and holds great potential for enhancing human-robot interaction.

Given the flexibility of the Synthiam ARC platform and its support for various programming languages (JavaScript or Python, EZ-Script, etc.), there are a few approaches you could consider for integrating Microsoft CoPilot or similar technologies:

  1. API Integration: If Microsoft CoPilot offers an API for accessing its conversational AI capabilities, you could use the HTTP request functions available in ARC's scripting languages to send and receive data from CoPilot. This would involve sending user input to CoPilot via an API call and processing the response within ARC to generate the robot's reply or action.

  2. Custom robot skill Development: For a more seamless integration, you could develop a custom robot skill for ARC that encapsulates the interaction with Microsoft CoPilot. This would require programming knowledge and familiarity with ARC's SDK. The custom skill could handle API communication, response processing, and any specific logic needed to integrate CoPilot's responses into your robot's behavior.

  3. Use Existing Skills as a Bridge: Depending on CoPilot's capabilities and how you intend to use it, you might be able to leverage existing skills like DialogFlow, OpenAI ChatGPT, or Translate as a bridge. For example, you could use these skills to preprocess or postprocess data sent to or received from CoPilot, combining the strengths of multiple AI services to achieve your desired conversational model.

  4. Community Collaboration: Since you mentioned interest from others in integrating CoPilot, consider reaching out to the Synthiam community forums. Collaborating with other developers or users interested in CoPilot could lead to shared development efforts or insights into how best to integrate such a service with ARC.

Remember, integrating third-party AI services like Microsoft CoPilot into ARC projects will require careful consideration of API usage limits, response latency, and how real-time interactions are handled to ensure a smooth and engaging user experience.

If you decide to pursue this integration, please share your progress or any insights you gain with the Synthiam community. It's through innovative projects like yours that the capabilities of personal robotics continue to expand.


I am a customer support GPT-powered AI and still learning. If you have doubts about my response, please use the support documentation to verify my answer.
PRO
Canada
#2   — Edited

You can build an API Proxy from ARC ChatGPT client to Copilot (why they don't all standardize I don't know). You can ask Copilot to write it for you but something like deepseek coder may do a better job.  You could also check with LiteLLM   It has an OpenAI API  to a large number of LLM via their API Proxy server. Not sure if copilot is on list but you could request it.

PRO
Synthiam
#3  

I did a quick search for the copilot API. Copilot isn't marketed well because I'm still unsure what it is. Is it a search engine assistant? Is it a text-to-speech speech-to-text interpreter? Is it a visual studio code suggestion/completion? I'm a bit at a loss as to what it is because I mostly see it in Visual Studio...

PRO
Canada
#4   — Edited

I logged into copilot and asked if had an API.  It said no.  It tried to sell me copilot pro so I asked if copilot pro had an API and it said yes and gave me this link.   https://www.copilot.com/guide/api-documentation

- the link seems to be for something called copilot but has nothing to do with Microsoft copilot.So I asked again and it gave me another link to something else. This tool doesn’t seem very bright.

Played with it some more set to most accurate and it still gave me garbage answers.  Have a play maybe my prompts are terrible.

https://copilot.microsoft.com/

PRO
Synthiam
#5  

@Hardy, can you tell us more about your co-pilot experience and how you're using it?

@Nink, I'm still unsure what it is, even with your link. Maybe it's "typecasted" for me because it's built into Visual Studio as code completion/suggestion in the editor. So, I'm not entirely sure what it is outside of that. I've also seen it appear in the Bing search engine, which confused me because I thought it was a programmer's aid. Now I see a big smiley face "app" in the link you shared. I'm still confused as to what it is.

What is co-pilot? If anyone knows, please share your knowledge with me:).

PRO
Canada
#6  

My two favourite LLMs are Groc because it is fast like 10 times faster than GPT4 it runs at 500+ tokens per second on Mixtral MoE (I get about about 50 on my local rig).   The other one is perplexity this thing is amaizing. It uses OpenAI at backend and pulls videos and sources direct from internet.   Groc Perplexity

#7  

Thank you for all the helpful emails! Lightening fast, as usual. I successfully tuned a GPT model and it solved the problem. Co-pilot is awesome and Hardy Dynamics uses it all the time, but it's better for enterprise business / Microsoft functions and it's pretty new.