* migrate the rest * test-thread-safety * rm common_batch_staged
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info: