← Back to catalog

SERVICE DETAILS

YOLOv8n ONNX KServe Inference Service

AsynchronousModel Serving

Overview

OSCAR service that deploys two services; a YOLOv8n object detection model (exported to ONNX) as a KServe InferenceService and a traditional OSCAR asynchronous service to pre-process inputs and post-process outputs through MinIO buckets. When an image is uploaded to the input bucket, the script preprocesses it, calls the KServe v2 inference endpoint, applies confidence filtering and non-maximum suppression, and writes the annotated results back to MinIO.

Deployment requirements

Memory
3 GiB
Processors
2 vCPU

Files & artifacts

Usage & acceptance tests

Asynchronous YOLOv8n ONNX KServe acceptance test

Upload the supplied image, and verify that the inference produces summary and annotated-image outputs.

  1. Upload input.png to the configured MinIO input path and wait for the asynchronous inference to finish.

    oscar-cli service put-file yolov8n-onnx-kserve {source}
  2. Wait for the remote inference to produce detection outputs.

    Time required: PT20S
  3. Download the latest annotated JPEG; inspect the summary separately as documented in the README.

    oscar-cli service get-file yolov8n-onnx-kserve --download-latest-into {destination}

RO-Crate metadata