Atuin syncs shell history 32x faster by packing encrypted records client-side

Making Atuin sync 32x faster with packfiles

Atuin syncs shell history 32x faster by packing encrypted records client-side

Atuin's end-to-end encryption meant its servers couldn't compress or bundle history records, so sync slowed badly for power users — 5.4 minutes at the 99th percentile. Release 18.20.0 fixes this with client-built packfiles: records are bundled, compressed with zstd, then encrypted, plus pipelined downloads and batched SQL inserts. Atuin Hub sync is now 32x faster, self-hosted 16x, and the sync protocol version didn't change.

The idea behind Atuin's packfiles is the same: take N plaintext records, bundle them, compress them and then encrypt them.
  1. ashkankiani

    I don't want to be mean, but in my personal experience and projects, I have a kind of rule. If I get a 5% to 50% speedup, then I probably did a good job optimizing. If I get a 2x to 5x speedup then I probably was fixing up a prototype. If I get >10x speedup, I fucked up the first time.

  2. bita_nidir

    OK, I had a laugh at the TP-esque quote

    This is not just a small performance improvement. This is a paradigm shift in how Atuin does sync.

    — lots of numbers on a GPU, August 2026

  3. cowlevel

    > We sync many thousands of records in single-digit seconds.

    Is that meant to be impressive performance? I'd never heard of Atuin but apparent it syncs your shell history between machines using a Blockchain?

More from this day

2026-11-16