Concept: Data parallelism

Liger+ dynamically balances latency and throughput in large model inference

Dynamically balancing speed and throughput for serving large AI models across multiple GPUs