Skip to content

BentoML Mock (ailab-ml)

What It Is

A lightweight mock of BentoML's serving API. It exposes service metadata, health, OpenAPI docs, Prometheus metrics, and a prediction endpoint.


Surface

Endpoint Purpose
GET / Service info (name, version, bento_version)
GET /healthz Health check
GET /docs.json OpenAPI specification
GET /metrics Prometheus metrics (request count, duration)
POST /predict Mock inference (label, confidence, model)

Port & Unit

Parameter Value
Host 172.16.50.20
Port 3333
Unit bentoml-mock.service
Runtime python3 server.py

What aipostex Finds

  • BentoML fingerprint via / service info
  • OpenAPI spec exposing all routes via /docs.json
  • Prometheus metrics via /metrics