Screenpipe: Powering AI Agents with Your 24/7 Screen Recording
Launch HN: Screenpipe (YC S26) – Power your agents by your 24/7 screen recording
I built Screenpipe to give AI agents a searchable memory of everything you see, say, and hear on your computer. By recording your screen and audio locally, it helps automate repetitive tasks and build a personal second brain without needing constant micro-management. The tool listens for meaningful events like app switches and typing pauses, ensuring efficient local processing while keeping your data secure and private.
I want AI to know what I'm doing and never lose memory ever again, and I want it to use the same software that humans do, without painful context switches.
- AmazingTurtle
Funny timing. I've been building something similar in my spare time called Daydream. There’s a lot of overlap: local screen/audio capture, OCR and transcription, window and activity context, SQLite, and a searchable memory of what happened.
The main difference is the product direction. Screenpipe seems focused on continuously giving agents context through APIs, MCP, and skills. Daydream is more narrowly built around answering "what did I do today?" through a timeline you can inspect, replay, search, and turn into a daily digest.
I'm also treating deletion as part of the data model. If you cut a sensitive span, its frames, audio, OCR, transcripts, embeddings, and summaries should be deleted or invalidated too.
Mine is still early and Linux-first. I'm open-sourcing it in case anyone wants to contribute, poke around, or use it as a starting point. It’s built with Tauri, a Rust backend, React/TypeScript, SQLite, GStreamer, Whisper, OCR, and VLM processing.
I genuinely didn’t know you were building this when I started. Apparently personal memory capture is becoming a SaaS category too lol.
Code is here:
- subhajeet2107
How are you planing to segregate between professional use and personal use, I dont want any agent or any llm to know all the time what i have been doing on my system, it would be privacy nightmare and most of the time the screencapture is not meaningful. People may use their work laptop or devices to checkout reddit or hackernews occasionally.
- fillskills
Been a user of Screenpipe to build some "Ai-buddies" for me since last year. Core of that is giving AI a look at what is happening in time space. Without Screenpipe this was rather hard to do at the performance screenpipe gives.
- jgalego
I built a similar app last week just for fun https://github.com/JGalego/HiddenSteps WIP will definitely check yours out
- jboss10
How does it run the LLMs? Or does it call a API to llama.cpp/ollama/etc. ?
During normal usage, how often does it try to parse info from the screen capture? Once a minute?