torchfoo.distributed.all_equal

torchfoo.distributed.all_equal(x)

Check if x is the same on all GPUs

Parameters:

x (Tensor) – a contiguous Tensor on this device

Returns:

True if x is equal across all processes.

Return type:

bool