SHARP, the Scalable Hierarchical Aggregation and Reduction Protocol, is NVIDIA in-network computing that performs collective operations such as all-reduce inside the switches rather than only on endpoints. By aggregating data as it passes through the fabric, it cuts the volume of traffic and the number of hops, accelerating gradient synchronization in large training runs. It is a defining feature of high-end InfiniBand and NVLink switch fabrics.
Category: Network & Connectivity · Subcategory: Data Center Network Architecture · Part of the AIDC Technical Terminology reference.