Google's New Open-Source Compiler Makes Private AI Practical

Google Is Making Private AI Practical with Homomorphic Encryption

Google has released HEIR, an open-source compiler that lets developers run AI models on encrypted data without decrypting it, enabling private inference for tasks like recommendations and fraud detection. The tool lowers the barrier to homomorphic encryption, which previously required expert cryptographers. Google partnered with hardware accelerators and universities, and demos show single-threaded CPU latency for four applications, including a recommendation model and a hotword detector.