Agent Draw - AI agent that draws on tldraw canvas while you talk
Show HN: Agent Draw: An agent draws while you talk, built on TLDraw
Agent Draw is an innovative tool built on the tldraw infinite-canvas SDK that allows an AI agent to draw shapes and diagrams in real-time as you speak. By simply dragging a rectangle on the canvas and describing your vision, the system queues your requests and executes them sequentially, creating visual content without interrupting your presentation flow. Leveraging Mistral's Voxtral for transcription and various LLMs for generation, it transforms spoken instructions into precise geometric compositions or freeform sketches. Perfect for educators, presenters, and developers, it demonstrates the seamless integration of voice commands with collaborative drawing tools, offering a hands-free way to visualize ideas instantly.
Drag a rectangle on the canvas, say what you want inside it, and by the time you look back it's there, drawn by an AI agent while you kept talking.
- ldubinets
This is sick! I built a similar tool at https://shimmerdiagrams.com
I really enjoyed reading your blog post, it was pretty informative about the techniques. I had built mine as a prototype and specifically interested in running all models local and in browser.
Tldraw seems to be a better medium for this that mermaid.
- 3kidsinacoat
A very interesting way of interacting with an AI agent. I tried out the demo for creating mind maps, and it was an interesting experience to see it grow and be able to explore different branches. An interesting concept for exploring AI-supported visual thinking.
- mkolodny
Good idea! It could be fun to try creating an RSA-esque visual explanation video instead of using canvas selection (https://youtu.be/zDZFcDGpL4U).