64e0757edf
[Classify]: Allow inference on dirs and videos ( #9003 )
...
* allow image dirs
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update predict.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update dataloaders.py
* Update predict.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update predict.py
* Update predict.py
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-08-17 22:41:43 +02:00
27d831b6e4
Training reproducibility improvements ( #8213 )
...
* attempt at reproducibility
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* use deterministic algs
* fix everything :)
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* revert dataloader changes
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* process_batch as np
* remove newline
* Remove dataloader init fcn
* Update val.py
* Update train.py
* revert additional changes
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update train.py
* Add --seed arg
* Update general.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update train.py
* Update train.py
* Update val.py
* Update train.py
* Update general.py
* Update general.py
* Add deterministic argument to init_seeds()
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-07-07 14:39:29 +02:00
4cac1cfc8f
Add --noplots flag to suppress figures and images logging ( #7534 )
...
* support nomedia
* support nomedia for validation
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update train.py
* Revert no plot evolve
evolve plots do not contain any images
* Revert plot_results
contains no media
* Update wandb_utils.py
* sync-bn cleanup
* Cleanup
* Rename nomedia -> noplots
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-04-22 15:04:08 -07:00
74aaab3312
Add version warning for wandb ( #7385 )
...
* add version warning
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Cleanup
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update __init__.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-04-12 11:46:56 +02:00
Ayush Chaurasia
96d8f86085
W&B: don't log media in evolve ( #6617 )
2022-02-12 13:04:50 +01:00
Ayush Chaurasia and Glenn Jocher
51f7750aad
W&B: Improve resume stability ( #6611 )
...
* log best.pt metrics at train end
* update
* Update __init__.py
* flush callbacks when using evolve
* remember batch size on resuming
* Update train.py
* improve stability of resume
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-02-12 13:03:09 +01:00
Ayush Chaurasia and Glenn Jocher
b73c62ebc5
W&B: Remember batchsize on resuming ( #6512 )
...
* log best.pt metrics at train end
* update
* Update __init__.py
* flush callbacks when using evolve
* remember batch size on resuming
* Update train.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-02-03 11:29:52 +01:00
Ayush Chaurasia and Glenn Jocher
9bcc32a5bf
Flush callbacks when on --evolve ( #6374 )
...
* log best.pt metrics at train end
* update
* Update __init__.py
* flush callbacks when using evolve
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2022-01-20 13:22:47 -10:00
Ayush Chaurasia and Glenn Jocher
9155eb8641
W&B: Log best results after training ends ( #6120 )
...
* log best.pt metrics at train end
* update
* Update __init__.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-12-30 11:43:19 -08:00
Ayush Chaurasia and Glenn Jocher
db6ec66a60
W&B: track batch size after autobatch ( #6039 )
...
* track batch size after autobatch
* remove redundant import
* Update __init__.py
* Update __init__.py
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-12-23 14:23:50 +01:00
Ayush Chaurasia
3f152e5807
Update wandb_utils.py ( #5908 )
2021-12-07 16:09:11 +01:00
f2ca30a407
W&B: refactor W&B tables ( #5737 )
...
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* reformat
* Single-line argparser argument
* Update README.md
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update README.md
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-11-25 17:19:21 +01:00
Ayush Chaurasia and Glenn Jocher
540ef0dd30
W&B refactor, handle exceptions, CI example ( #5618 )
...
* handle exceptions| attempt CI
* update
* Pre-commit manual run
* yaml one-liner
* Update ci-testing.yml
* Comment W&B CI
Leave as example for future separate CI
* Update ci-testing.yml
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-11-14 13:26:53 +01:00
Ayush Chaurasia
620b535f85
Update sweep.py ( #5402 )
2021-10-29 19:21:59 +02:00
Ayush Chaurasia
692be757b6
W&B: Media panel fix ( #5317 )
2021-10-25 12:06:12 +02:00
Ayush Chaurasia and Glenn Jocher
1172ac15fb
W&B: DDP fix ( #5176 )
...
* fix dpp with wandb disabled
* PyCharm reformat
* Fix
* fix
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-10-13 20:11:04 -07:00
Ayush Chaurasia and Glenn Jocher
d0bfeb3980
W&B: fix DDP with wandb disabled ( #5163 )
...
* fix dpp with wandb disabled
* PyCharm reformat
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-10-13 16:17:15 -07:00
Ayush Chaurasia
59aae85a7e
W&B: Fix dataset check ( #4879 )
...
* evolve fix
* Enable login timeout
* fix pkg
* check rank
* don't relogin
* fix
* reformat
2021-09-21 20:02:32 +02:00
Ayush Chaurasia
9febea79de
W&B: Login only in master processes ( #4866 )
...
* evolve fix
* Enable login timeout
* fix pkg
* check rank
* don't relogin
2021-09-20 16:19:34 +02:00
Ayush Chaurasia
302a1b0bb0
W&B: Enable login timeout ( #4843 )
...
* evolve fix
* Enable login timeout
* fix pkg
2021-09-17 18:59:34 +02:00
Ayush Chaurasia
11e7c7b48d
W&B: Don't log models in evolve operation ( #4611 )
2021-08-30 17:07:20 +02:00
Ayush Chaurasia and Glenn Jocher
7316b78e36
W&B: Refactor the wandb_utils.py file ( #4496 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* Fix
* fix
* refactor constructor
* refactor
* refactor
* refactor
* PyCharm reformat
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-08-23 13:10:07 +02:00
Ayush Chaurasia and Glenn Jocher
a4e4553040
W&B: Fix for 4360 ( #4388 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* Fix
* fix
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-08-11 21:56:25 +02:00
Ayush Chaurasia and Glenn Jocher
75d323dd8b
W&B: Add advanced features tutorial ( #4384 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* Initial readme update
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-08-11 18:35:43 +02:00
Ayush Chaurasia and Glenn Jocher
621caea53c
W&B: Fix sweep bug ( #4276 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* call wandblogger.log instead of wandb.log
* Fix Sweep bug
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-08-02 18:41:52 +02:00
Ayush Chaurasia and Glenn Jocher
cd540d8625
W&B: suppress warnings ( #4257 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* call wandblogger.log instead of wandb.log
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-08-01 12:06:53 +02:00
Ayush Chaurasia and Glenn Jocher
750465edae
W&B: More improvements and refactoring ( #4205 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-07-28 23:25:15 +02:00
Ayush Chaurasia and Glenn Jocher
e88e8f7a98
W&B: Restructure code to support the new dataset_check() feature ( #4197 )
...
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-07-28 17:40:08 +02:00
Ayush Chaurasia
63a1971e31
Improve docstrings and run names ( #4174 )
2021-07-27 15:13:32 +02:00
Ayush Chaurasia
0cc7c58787
W&B: fix refactor bugs ( #4069 )
2021-07-19 13:57:13 +02:00
Ayush Chaurasia and Glenn Jocher
62409eea08
W&B sweeps support ( #3938 )
...
* Add support for W&B Sweeps
* Update and reformat
* Update search space
* reformat
* reformat sweep.py
* Update sweep.py
* Move sweeps files to wandb dir
* Remove print
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-07-14 19:13:02 +02:00
Ayush Chaurasia
ffb6e11050
W&B: Update Tables API and comply with new dataset_check ( #3772 )
...
* Update tables API and windows path fix
* update dataset check
2021-06-25 20:45:33 +02:00
Ayush Chaurasia
75c0ff43af
[x]W&B: Don't resume transfer learning runs ( #3604 )
...
* Allow config cahnge
* Allow val change in wandb config
* Don't resume transfer learning runs
* Add entity in log dataset
2021-06-21 14:00:25 +02:00
Ayush Chaurasia and Glenn Jocher
daab682b06
Suppress wandb images size mismatch warning ( #3611 )
...
* supress wandb images size mismatch warning
* supress wandb images size mismatch warning
* PEP8 reformat and optimize imports
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-06-14 18:54:58 +02:00
Ayush Chaurasia
53d4fc2e26
W&B: Allow changed in config variable #3588
2021-06-11 23:18:57 +02:00
Ayush Chaurasia
d2a17289c9
Explicitly convert artifact path to posix_path ( #3067 )
...
* Explicitly convert artifact path to posix_path
* Remove redudant str() casting
2021-05-07 19:53:56 +02:00
Ayush Chaurasia
b18ca31ff5
use check_file for --data ( #3035 )
2021-05-05 14:28:19 +02:00
Ayush Chaurasia
801b469878
Improve performance of dataset Logger ( #2943 )
...
* Improve performance of Dataset Logger
* Fix scaling bug
2021-04-30 21:54:26 +02:00
Ayush Chaurasia
3067429307
Add support for list-of-directory data format for wandb ( #2719 )
2021-04-06 16:57:13 +02:00
Ayush Chaurasia
514ebcdf33
Fix : #2674 ( #2683 )
...
* Set resume flag to false
* Check existance of val dataset
2021-04-02 11:54:50 +02:00
Ayush Chaurasia
2a28ef374b
Set resume flag to false ( #2657 )
2021-03-31 13:47:54 +02:00
Ayush Chaurasia
518c09578e
W&B resume ddp from run link fix ( #2579 )
...
* W&B resume ddp from run link fix
* Native DDP W&B support for training, resuming
2021-03-28 16:11:36 +02:00
Ayush Chaurasia
dc51e80b00
Fix: evolve with wandb ( #2634 )
2021-03-28 16:09:35 +02:00
Ayush Chaurasia
8f6e447729
Fix Indentation in test.py ( #2614 )
...
* Fix Indentation in test.py
* CI fix
* Comply with PEP8: 80 characters per line
2021-03-26 20:47:11 +01:00
Ayush Chaurasia
1bf9365280
W&B DDP fix ( #2574 )
2021-03-23 16:54:34 +01:00
Ayush Chaurasia and Glenn Jocher
e8fc97aa38
Improved W&B integration ( #2125 )
...
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Add dataset creation in training script
* Change scope: self.wandb_run
* Add wandb-artifact:// natively
you can now use --resume with wandb run links
* Add suuport for logging dataset while training
* Cleanup
* Fix: Merge conflict
* Fix: CI tests
* Automatically use wandb config
* Fix: Resume
* Fix: CI
* Enhance: Using val_table
* More resume enhancement
* FIX : CI
* Add alias
* Get useful opt config data
* train.py cleanup
* Cleanup train.py
* more cleanup
* Cleanup| CI fix
* Reformat using PEP8
* FIX:CI
* rebase
* remove uneccesary changes
* remove uneccesary changes
* remove uneccesary changes
* remove unecessary chage from test.py
* FIX: resume from local checkpoint
* FIX:resume
* FIX:resume
* Reformat
* Performance improvement
* Fix local resume
* Fix local resume
* FIX:CI
* Fix: CI
* Imporve image logging
* (:(:Redo CI tests:):)
* Remember epochs when resuming
* Remember epochs when resuming
* Update DDP location
Potential fix for #2405
* PEP8 reformat
* 0.25 confidence threshold
* reset train.py plots syntax to previous
* reset epochs completed syntax to previous
* reset space to previous
* remove brackets
* reset comment to previous
* Update: is_coco check, remove unused code
* Remove redundant print statement
* Remove wandb imports
* remove dsviz logger from test.py
* Remove redundant change from test.py
* remove redundant changes from train.py
* reformat and improvements
* Fix typo
* Add tqdm tqdm progress when scanning files, naming improvements
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-03-23 00:44:50 +01:00
Ayush Chaurasia and Glenn Jocher
73a0669930
Start setup for improved W&B integration ( #1948 )
...
* Add helper functions for wandb and artifacts
* cleanup
* Reorganize files
* Update wandb_utils.py
* Update log_dataset.py
We can remove this code, as the giou hyp has been deprecated for a while now.
* Reorganize and update dataloader call
* yaml.SafeLoader
* PEP8 reformat
* remove redundant checks
* Add helper functions for wandb and artifacts
* cleanup
* Reorganize files
* Update wandb_utils.py
* Update log_dataset.py
We can remove this code, as the giou hyp has been deprecated for a while now.
* Reorganize and update dataloader call
* yaml.SafeLoader
* PEP8 reformat
* remove redundant checks
* Update util files
* Update wandb_utils.py
* Remove word size
* Change path of labels.zip
* remove unused imports
* remove --rect
* log_dataset.py cleanup
* log_dataset.py cleanup2
* wandb_utils.py cleanup
* remove redundant id_count
* wandb_utils.py cleanup2
* rename cls
* use pathlib for zip
* rename dataloader to dataset
* Change import order
* Remove redundant code
* remove unused import
* remove unused imports
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2021-02-01 21:38:41 -08:00
Ayush Chaurasia and Glenn Jocher
96fcde40b8
W&B feature improvements ( #1258 )
...
* W&B feature improvements
This PR add:
* Class to id labels. Now, the caption of bounding boxes will display the class name and the class confidence score.
* The project name is set to "Yolov5" and the run name will be set to opt.logdir
* cleanup
* remove parenthesis on caption
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2020-11-01 20:54:29 +01:00
Ayush Chaurasia and Glenn Jocher
ca290dca24
Weights & Biases (W&B) Feature Addition ( #1235 )
...
* Add wandb metric logging and bounding box debugging
* Improve formatting, readability
* Remove mutliple path for init, improve formatting
* Add wandb params
* Remove typecasting in bbox coordinates and reformat
* Cleanup
* add wandb to requirements.txt
* minor updates to test.py
* general reorg
* reduce --log-imgs to 10
* clean wandb import
* reverse wandb import assert
* add except AssertionError to try import
* move wandb init to all global ranks
* replace print() with logger.info()
* replace print() with logger.info()
* move wandb.init() bug fix
* project PosixPath to basename bug fix
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com >
2020-10-31 20:16:35 +01:00