Description

I built a small tank bot with camera and remote control. So far it can be controlled by an llm to drive with custom actions using https://github.com/mudler/LocalAGI. What is still missing is voice control and a visual/multimodal model to process the video signal.

Goals

• make it voice controlled
• process video from robot with multimodal llm
• switch custom LocalAGI action to MCP server for being used with other llm frameworks

Resources

https://github.com/a-i-a-d/Tankie
https://github.com/mudler/LocalAGI