Glenn Jocher
fad27c0046
Update DDP for torch.distributed.run with gloo backend (#3680)
* Update DDP for `torch.distributed.run`
* Add LOCAL_RANK
* remove opt.local_rank
* backend="gloo|nccl"
* print
* print
* debug
* debug
* os.getenv
* gloo
* gloo
* gloo
* cleanup
* fix getenv
* cleanup
* cleanup destroy
* try nccl
* return opt
* add --local_rank
* add timeout
* add init_method
* gloo
* move destroy
* move destroy
* move print(opt) under if RANK
* destroy only RANK 0
* move destroy inside train()
* restore destroy outside train()
* update print(opt)
* cleanup
* nccl
* gloo with 60 second timeout
* update namespace printing
2021-06-19 16:30:25 +02:00
..
2021-06-14 13:58:54 +02:00
2021-05-12 18:23:50 +02:00
2021-06-09 21:14:09 +02:00
2021-06-19 16:30:25 +02:00
2020-05-29 17:04:54 -07:00
2021-04-25 22:54:07 +02:00
2021-04-29 21:16:23 +02:00
2021-06-19 16:30:25 +02:00
2021-06-15 13:21:04 +02:00
2021-06-03 18:44:58 +02:00
2021-03-29 18:45:46 +02:00
2021-06-11 11:46:05 +02:00
2021-06-10 13:51:29 +02:00
2021-06-19 16:30:25 +02:00