Horovod

Uber’s open source distributed Deep Learning framework