leyten/shard: Pipeline-parallel LLM inference across GPUs on separate machines.

Pipeline-parallel LLM inference across GPUs on separate machines.

Read Original

Related