Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference

Neural Information Processing Systems 

Parallelism introduces collective communication that is both expensive and represents a phase when hardware resources are underuti-lized.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found