What if Jev spoke Arrow?
TypeSafe's new model Jev turns natural language into typed decisions, but its API only returns JSON. Columnar Technologies built Jevaro, a proxy that batches requests and returns Apache Arrow, achieving 464 states per second and costing $0.20 for 30,000 answers. They argue a native Arrow endpoint would eliminate the JSON tax and unlock probabilistic pipelines.
Jev is a new primitive, and nobody yet knows the full scope of what it will make possible.
- orf
While Jev is fast, using it is hardly bottleknecked by deserializing from JSON.
Using arrow is cool, but grpc seems like a more natural fit than arrow IPC and would give you the same benefits.