Real-Time Encrypted CIFAR-10 Inference in 200ms by Belfort
Homomorphically encrypted CIFAR-10 inference in 200ms
I demonstrate how to run ML models on encrypted data in real-time, achieving CIFAR-10 inference in just 200ms. This So Far demo by Belfort allows image classification without the server ever seeing the actual image, unlocking privacy-preserving applications for finance, healthcare, and government sectors.
Running an ML model on encrypted data in real-time unlocks many applications that require ML combined with privacy!
- Sajarin
They have a bit more info on their announcement blog post[0]
> Belfort today released the "so far" CIFAR demo, an encrypted implementation of ResNet-20, a popular model for image classification. It outperforms recent SOTA by 3x with a total latency of less than 200ms
Not many details on how they've done this, so I'm a bit skeptical. Fast HE is a holy grail.
> Belfort's image classification is built on top of its upcoming GPU library, Cyclops. It comes with several optimizations that make Cyclops extremely fast on Encrypted AI workloads.
Looks like a lead up to an upcoming library release
- rcr-anti
Looked at the network logs and the JS, did some testing, there's a caveat here. For an encryption demo you might expect your secrets to be generated locally, they do the compute on something they can't read, you compare their results to your original plaintext; (imo at least) the point would be that it isn't physically possible for them to cheat.
Here, you literally download client_secret.bin from their server, so they have control over the keys and evaluators. So two things. First, the per user key flow would be several minutes for per user keys, the evaluator bundle would be in the 100s MB to GB realm. Second, there's no way for us to tell the difference between them really doing FHE or decrypting with the key. To be clear, not evidence it's fake, just not total proof it's real. Really hope it's real, been a field I've been following for awhile.
- jszymborski
Big if true! One of the caveats here is that the file size seems to balloon 341 times.
- grg0
> Image classification without the server seeing the image.
Does a given plain image always result in the same encrypted payload?
- digitallawyer
Super interesting work - should become default for sensitive data over time (finance / legal / ...)