Gemini just released Decisions API, and wanted to test it on recycling line ♻️
It's more accurate (and more expensive) compared to other multimodal "System 1" alternatives (Jev/OAI).
Accuracy on this clip; rankings mostly aligned with their own benchmarks:
- Gemini Decision 1: 76%
- OAI Decisions API (GPT-6 Luna): 53%
- Jev 1.14: 72%
Cost [1k imgs] / median Speed:
- Gemini: $0.13 / ~340ms
- OAI: $0.08 / ~270ms
- Jev: $0.08 / ~130ms
@typesafeai 's Jev still has the best performance per price 👍