Google Speculative Cascades: Faster LLM Inference
Google Research introduces speculative cascades, a revolutionary technique combining speculative decoding with cascades for better LLM inference.