Ankle/yolov5_birdproject
1
0 Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
2,216 Commits 1 Branch 0 Tags
d3ea0df8b9f923685ce5f2555c303b8eddbf83fd
Commit Graph
48 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ayush Chaurasiapre-commit-ci[bot]Glenn Jocher
 		27d831b6e4 Training reproducibility improvements (#8213) 
* attempt at reproducibility

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* use deterministic algs

* fix everything :)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert dataloader changes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* process_batch as np

* remove newline

* Remove dataloader init fcn

* Update val.py

* Update train.py

* revert additional changes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update train.py

* Add --seed arg

* Update general.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update train.py

* Update train.py

* Update val.py

* Update train.py

* Update general.py

* Update general.py

* Add deterministic argument to init_seeds()

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-07-07 14:39:29 +02:00
Ayush Chaurasiapre-commit-ci[bot]Glenn Jocher
 		4cac1cfc8f Add --noplots flag to suppress figures and images logging (#7534) 
* support nomedia

* support nomedia for validation

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update train.py

* Revert no plot evolve

evolve plots do not contain any images

* Revert plot_results

contains no media

* Update wandb_utils.py

* sync-bn cleanup

* Cleanup

* Rename nomedia -> noplots

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-04-22 15:04:08 -07:00
Ayush Chaurasiapre-commit-ci[bot]Glenn Jocher
 		74aaab3312 Add version warning for wandb (#7385) 
* add version warning

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Cleanup

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update __init__.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-04-12 11:46:56 +02:00
Ayush Chaurasia 96d8f86085 W&B: don't log media in evolve (#6617) 2022-02-12 13:04:50 +01:00
Ayush ChaurasiaandGlenn Jocher 51f7750aad W&B: Improve resume stability (#6611) 
* log best.pt metrics at train end

* update

* Update __init__.py

* flush callbacks when using evolve

* remember batch size on resuming

* Update train.py

* improve stability of resume

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-02-12 13:03:09 +01:00
Ayush ChaurasiaandGlenn Jocher b73c62ebc5 W&B: Remember batchsize on resuming (#6512) 
* log best.pt metrics at train end

* update

* Update __init__.py

* flush callbacks when using evolve

* remember batch size on resuming

* Update train.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-02-03 11:29:52 +01:00
Ayush ChaurasiaandGlenn Jocher 9bcc32a5bf Flush callbacks when on --evolve (#6374) 
* log best.pt metrics at train end

* update

* Update __init__.py

* flush callbacks when using evolve

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2022-01-20 13:22:47 -10:00
Ayush ChaurasiaandGlenn Jocher 9155eb8641 W&B: Log best results after training ends (#6120) 
* log best.pt metrics at train end

* update

* Update __init__.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-12-30 11:43:19 -08:00
Ayush ChaurasiaandGlenn Jocher db6ec66a60 W&B: track batch size after autobatch (#6039) 
* track batch size after autobatch

* remove redundant import

* Update __init__.py

* Update __init__.py

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-12-23 14:23:50 +01:00
Ayush Chaurasia 3f152e5807 Update wandb_utils.py (#5908) 2021-12-07 16:09:11 +01:00
Ayush Chaurasiapre-commit-ci[bot]Glenn Jocher
 		f2ca30a407 W&B: refactor W&B tables (#5737) 
* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* reformat

* Single-line argparser argument

* Update README.md

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update README.md

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-11-25 17:19:21 +01:00
Ayush ChaurasiaandGlenn Jocher 540ef0dd30 W&B refactor, handle exceptions, CI example (#5618) 
* handle exceptions| attempt CI

* update

* Pre-commit manual run

* yaml one-liner

* Update ci-testing.yml

* Comment W&B CI

Leave as example for future separate CI

* Update ci-testing.yml

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-11-14 13:26:53 +01:00
Ayush Chaurasia 620b535f85 Update sweep.py (#5402) 2021-10-29 19:21:59 +02:00
Ayush Chaurasia 692be757b6 W&B: Media panel fix (#5317) 2021-10-25 12:06:12 +02:00
Ayush ChaurasiaandGlenn Jocher 1172ac15fb W&B: DDP fix (#5176) 
* fix dpp with wandb disabled

* PyCharm reformat

* Fix

* fix

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-10-13 20:11:04 -07:00
Ayush ChaurasiaandGlenn Jocher d0bfeb3980 W&B: fix DDP with wandb disabled (#5163) 
* fix dpp with wandb disabled

* PyCharm reformat

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-10-13 16:17:15 -07:00
Ayush Chaurasia 59aae85a7e W&B: Fix dataset check (#4879) 
* evolve fix

* Enable login timeout

* fix pkg

* check rank

* don't relogin

* fix

* reformat
 2021-09-21 20:02:32 +02:00
Ayush Chaurasia 9febea79de W&B: Login only in master processes (#4866) 
* evolve fix

* Enable login timeout

* fix pkg

* check rank

* don't relogin
 2021-09-20 16:19:34 +02:00
Ayush Chaurasia 302a1b0bb0 W&B: Enable login timeout (#4843) 
* evolve fix

* Enable login timeout

* fix pkg
 2021-09-17 18:59:34 +02:00
Ayush Chaurasia 11e7c7b48d W&B: Don't log models in evolve operation (#4611) 2021-08-30 17:07:20 +02:00
Ayush ChaurasiaandGlenn Jocher 7316b78e36 W&B: Refactor the wandb_utils.py file (#4496) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

* Fix

* fix

* refactor constructor

* refactor

* refactor

* refactor

* PyCharm reformat

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-08-23 13:10:07 +02:00
Ayush ChaurasiaandGlenn Jocher a4e4553040 W&B: Fix for 4360 (#4388) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

* Fix

* fix

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-08-11 21:56:25 +02:00
Ayush ChaurasiaandGlenn Jocher 75d323dd8b W&B: Add advanced features tutorial (#4384) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

* Initial readme update

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-08-11 18:35:43 +02:00
Ayush ChaurasiaandGlenn Jocher 621caea53c W&B: Fix sweep bug (#4276) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

* call wandblogger.log instead of wandb.log

* Fix Sweep bug

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-08-02 18:41:52 +02:00
Ayush ChaurasiaandGlenn Jocher cd540d8625 W&B: suppress warnings (#4257) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

* call wandblogger.log instead of wandb.log

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-08-01 12:06:53 +02:00
Ayush ChaurasiaandGlenn Jocher 750465edae W&B: More improvements and refactoring (#4205) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

* Remove redundant try catch

* More refactoring and bug fixes

* retry

* Reformat using pycharm

* respect LOGGERS include list

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-07-28 23:25:15 +02:00
Ayush ChaurasiaandGlenn Jocher e88e8f7a98 W&B: Restructure code to support the new dataset_check() feature (#4197) 
* Improve docstrings and run names

* default wandb login prompt with timeout

* return key

* Update api_key check logic

* Properly support zipped dataset feature

* update docstring

* Revert tuorial change

* extend changes to log_dataset

* add run name

* bug fix

* bug fix

* Update comment

* fix import check

* remove unused import

* Hardcore .yaml file extension

* reduce code

* Reformat using pycharm

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-07-28 17:40:08 +02:00
Ayush Chaurasia 63a1971e31 Improve docstrings and run names (#4174) 2021-07-27 15:13:32 +02:00
Ayush Chaurasia 0cc7c58787 W&B: fix refactor bugs (#4069) 2021-07-19 13:57:13 +02:00
Ayush ChaurasiaandGlenn Jocher 62409eea08 W&B sweeps support (#3938) 
* Add support for W&B Sweeps

* Update and reformat

* Update search space

* reformat

* reformat sweep.py

* Update sweep.py

* Move sweeps files to wandb dir

* Remove print

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-07-14 19:13:02 +02:00
Ayush Chaurasia ffb6e11050 W&B: Update Tables API and comply with new dataset_check (#3772) 
* Update tables API and windows path fix

* update dataset check
 2021-06-25 20:45:33 +02:00
Ayush Chaurasia 75c0ff43af [x]W&B: Don't resume transfer learning runs (#3604) 
* Allow config cahnge

* Allow val change in wandb config

* Don't resume transfer learning runs

* Add entity in log dataset
 2021-06-21 14:00:25 +02:00
Ayush ChaurasiaandGlenn Jocher daab682b06 Suppress wandb images size mismatch warning (#3611) 
* supress wandb images size mismatch warning

* supress wandb images size mismatch warning

* PEP8 reformat and optimize imports

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-06-14 18:54:58 +02:00
Ayush Chaurasia 53d4fc2e26 W&B: Allow changed in config variable #3588 2021-06-11 23:18:57 +02:00
Ayush Chaurasia d2a17289c9 Explicitly convert artifact path to posix_path (#3067) 
* Explicitly convert artifact path to posix_path

* Remove redudant str() casting
 2021-05-07 19:53:56 +02:00
Ayush Chaurasia b18ca31ff5 use check_file for --data (#3035) 2021-05-05 14:28:19 +02:00
Ayush Chaurasia 801b469878 Improve performance of dataset Logger (#2943) 
* Improve performance of Dataset Logger

* Fix scaling bug
 2021-04-30 21:54:26 +02:00
Ayush Chaurasia 3067429307 Add support for list-of-directory data format for wandb (#2719) 2021-04-06 16:57:13 +02:00
Ayush Chaurasia 514ebcdf33 Fix: #2674 (#2683) 
* Set resume flag to false

* Check existance of val dataset
 2021-04-02 11:54:50 +02:00
Ayush Chaurasia 2a28ef374b Set resume flag to false (#2657) 2021-03-31 13:47:54 +02:00
Ayush Chaurasia 518c09578e W&B resume ddp from run link fix (#2579) 
* W&B resume ddp from run link fix

* Native DDP W&B support for training, resuming
 2021-03-28 16:11:36 +02:00
Ayush Chaurasia dc51e80b00 Fix: evolve with wandb (#2634) 2021-03-28 16:09:35 +02:00
Ayush Chaurasia 8f6e447729 Fix Indentation in test.py (#2614) 
* Fix Indentation in test.py

* CI fix

* Comply with PEP8: 80 characters per line
 2021-03-26 20:47:11 +01:00
Ayush Chaurasia 1bf9365280 W&B DDP fix (#2574) 2021-03-23 16:54:34 +01:00
Ayush ChaurasiaandGlenn Jocher e8fc97aa38 Improved W&B integration (#2125) 
* Init Commit

* new wandb integration

* Update

* Use data_dict in test

* Updates

* Update: scope of log_img

* Update: scope of log_img

* Update

* Update: Fix logging conditions

* Add tqdm bar, support for .txt dataset format

* Improve Result table Logger

* Init Commit

* new wandb integration

* Update

* Use data_dict in test

* Updates

* Update: scope of log_img

* Update: scope of log_img

* Update

* Update: Fix logging conditions

* Add tqdm bar, support for .txt dataset format

* Improve Result table Logger

* Add dataset creation in training script

* Change scope: self.wandb_run

* Add wandb-artifact:// natively

you can now use --resume with wandb run links

* Add suuport for logging dataset while training

* Cleanup

* Fix: Merge conflict

* Fix: CI tests

* Automatically use wandb config

* Fix: Resume

* Fix: CI

* Enhance: Using val_table

* More resume enhancement

* FIX : CI

* Add alias

* Get useful opt config data

* train.py cleanup

* Cleanup train.py

* more cleanup

* Cleanup| CI fix

* Reformat using PEP8

* FIX:CI

* rebase

* remove uneccesary changes

* remove uneccesary changes

* remove uneccesary changes

* remove unecessary chage from test.py

* FIX: resume from local checkpoint

* FIX:resume

* FIX:resume

* Reformat

* Performance improvement

* Fix local resume

* Fix local resume

* FIX:CI

* Fix: CI

* Imporve image logging

* (:(:Redo CI tests:):)

* Remember epochs when resuming

* Remember epochs when resuming

* Update DDP location

Potential fix for #2405

* PEP8 reformat

* 0.25 confidence threshold

* reset train.py plots syntax to previous

* reset epochs completed syntax to previous

* reset space to previous

* remove brackets

* reset comment to previous

* Update: is_coco check, remove unused code

* Remove redundant print statement

* Remove wandb imports

* remove dsviz logger from test.py

* Remove redundant change from test.py

* remove redundant changes from train.py

* reformat and improvements

* Fix typo

* Add tqdm tqdm progress when scanning files, naming improvements

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-03-23 00:44:50 +01:00
Ayush ChaurasiaandGlenn Jocher 73a0669930 Start setup for improved W&B integration (#1948) 
* Add helper functions for wandb and artifacts

* cleanup

* Reorganize files

* Update wandb_utils.py

* Update log_dataset.py

We can remove this code, as the giou hyp has been deprecated for a while now.

* Reorganize and update dataloader call

* yaml.SafeLoader

* PEP8 reformat

* remove redundant checks

* Add helper functions for wandb and artifacts

* cleanup

* Reorganize files

* Update wandb_utils.py

* Update log_dataset.py

We can remove this code, as the giou hyp has been deprecated for a while now.

* Reorganize and update dataloader call

* yaml.SafeLoader

* PEP8 reformat

* remove redundant checks

* Update util files

* Update wandb_utils.py

* Remove word size

* Change path of labels.zip

* remove unused imports

* remove --rect

* log_dataset.py cleanup

* log_dataset.py cleanup2

* wandb_utils.py cleanup

* remove redundant id_count

* wandb_utils.py cleanup2

* rename cls

* use pathlib for zip

* rename dataloader to dataset

* Change import order

* Remove redundant code

* remove unused import

* remove unused imports

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2021-02-01 21:38:41 -08:00
Ayush ChaurasiaandGlenn Jocher 96fcde40b8 W&B feature improvements (#1258) 
* W&B feature improvements

This PR add:
* Class to id labels. Now, the caption of bounding boxes will display the class name and the class confidence score.
* The project name is set to "Yolov5" and the run name will be set to opt.logdir

* cleanup

* remove parenthesis on caption

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2020-11-01 20:54:29 +01:00
Ayush ChaurasiaandGlenn Jocher ca290dca24 Weights & Biases (W&B) Feature Addition (#1235) 
* Add wandb metric logging and bounding box debugging

* Improve formatting, readability

* Remove mutliple path for init, improve formatting

* Add wandb params

* Remove typecasting in bbox coordinates and reformat

* Cleanup

* add wandb to requirements.txt

* minor updates to test.py

* general reorg

* reduce --log-imgs to 10

* clean wandb import

* reverse wandb import assert

* add except AssertionError to try import

* move wandb init to all global ranks

* replace print() with logger.info()

* replace print() with logger.info()

* move wandb.init() bug fix

* project PosixPath to basename bug fix

Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
 2020-10-31 20:16:35 +01:00