Kog targets 30x faster LLM inference on existing GPUs

French startup Kog aims to deliver 30x faster LLM inference on standard datacenter GPUs like AMD MI300X and NVIDIA H200. Its demo hit 3,000 tokens per second using the open-sourced Laneformer 2B model. CEO Gaël Delalleau expects first major model at 10x speed by September.