Glenn Jocher fad27c0046 Update DDP for torch.distributed.run with gloo backend (#3680) ...

* Update DDP for `torch.distributed.run`

* Add LOCAL_RANK

* remove opt.local_rank

* backend="gloo|nccl"

* print

* print

* debug

* debug

* os.getenv

* gloo

* gloo

* gloo

* cleanup

* fix getenv

* cleanup

* cleanup destroy

* try nccl

* return opt

* add --local_rank

* add timeout

* add init_method

* gloo

* move destroy

* move destroy

* move print(opt) under if RANK

* destroy only RANK 0

* move destroy inside train()

* restore destroy outside train()

* update print(opt)

* cleanup

* nccl

* gloo with 60 second timeout

* update namespace printing

2021-06-19 16:30:25 +02:00

..

__init__.py

Start setup for improved W&B integration (#1948)

2021-02-01 21:38:41 -08:00

log_dataset.py

Implement yaml.safe_load() (#2876)

2021-04-21 14:34:45 +02:00

wandb_utils.py

Update DDP for torch.distributed.run with gloo backend (#3680)

2021-06-19 16:30:25 +02:00