d669a74623
* update coco128-seg comments * Enables detect.py to use Triton for inference Triton Inference Server is an open source inference serving software that streamlines AI inferencing. https://github.com/triton-inference-server/server The user can now provide a "--triton-url" argument to detect.py to use a local or remote Triton server for inference. For e.g., http://localhost:8000 will use http over port 8000 and grpc://localhost:8001 will use grpc over port 8001. Note, it is not necessary to specify a weights file to use Triton. A Triton container can be created by first exporting the Yolov5 model to a Triton supported runtime. Onnx, Torchscript, TensorRT are supported by both Triton and the export.py script. The exported model can then be containerized via the OctoML CLI. See https://github.com/octoml/octo-cli#getting-started for a guide. * added triton client to requirements * fixed support for TFSavedModels in Triton * reverted change * Test CoreML update Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update ci-testing.yml Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Use pathlib Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Refacto DetectMultiBackend to directly accept triton url as --weights http://... Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Deploy category Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update detect.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update common.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update common.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update predict.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update predict.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update predict.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update triton.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * Update triton.py Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add printout and requirements check * Cleanup Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> * triton fixes * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fixed triton model query over grpc * Update check_requirements('tritonclient[all]') * group imports * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix likely remote URL bug * update comment * Update is_url() * Fix 2x download attempt on http://path/to/model.pt Signed-off-by: Glenn Jocher <glenn.jocher@ultralytics.com> Co-authored-by: glennjocher <glenn.jocher@ultralytics.com> Co-authored-by: Gaz Iqbal <giqbal@octoml.ai> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
48 lines
1.2 KiB
Plaintext
48 lines
1.2 KiB
Plaintext
# YOLOv5 requirements
|
|
# Usage: pip install -r requirements.txt
|
|
|
|
# Base ----------------------------------------
|
|
matplotlib>=3.2.2
|
|
numpy>=1.18.5
|
|
opencv-python>=4.1.1
|
|
Pillow>=7.1.2
|
|
PyYAML>=5.3.1
|
|
requests>=2.23.0
|
|
scipy>=1.4.1
|
|
torch>=1.7.0
|
|
torchvision>=0.8.1
|
|
tqdm>=4.64.0
|
|
# protobuf<=3.20.1 # https://github.com/ultralytics/yolov5/issues/8012
|
|
|
|
# Logging -------------------------------------
|
|
tensorboard>=2.4.1
|
|
# wandb
|
|
# clearml
|
|
|
|
# Plotting ------------------------------------
|
|
pandas>=1.1.4
|
|
seaborn>=0.11.0
|
|
|
|
# Export --------------------------------------
|
|
# coremltools>=6.0 # CoreML export
|
|
# onnx>=1.9.0 # ONNX export
|
|
# onnx-simplifier>=0.4.1 # ONNX simplifier
|
|
# nvidia-pyindex # TensorRT export
|
|
# nvidia-tensorrt # TensorRT export
|
|
# scikit-learn<=1.1.2 # CoreML quantization
|
|
# tensorflow>=2.4.1 # TF exports (-cpu, -aarch64, -macos)
|
|
# tensorflowjs>=3.9.0 # TF.js export
|
|
# openvino-dev # OpenVINO export
|
|
|
|
# Deploy --------------------------------------
|
|
# tritonclient[all]~=2.24.0
|
|
|
|
# Extras --------------------------------------
|
|
ipython # interactive notebook
|
|
psutil # system utilization
|
|
thop>=0.1.1 # FLOPs computation
|
|
# mss # screenshots
|
|
# albumentations>=1.0.3
|
|
# pycocotools>=2.0 # COCO mAP
|
|
# roboflow
|