biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950)

Browse Source 
Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.

Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
This commit is contained in:
Mark McLoughlin
2026-02-23 15:01:07 +00:00
committed by GitHub
parent b95bb6927f
commit 5cc7c4452e
5 changed files with 109 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/mkdocs/hooks/generate_metrics.py
View File

@@ -22,6 +22,7 @@ METRIC_SOURCE_FILES = [
"path": "vllm/distributed/kv_transfer/kv_connector/v1/nixl_connector.py",
"output": "nixl_connector.inc.md",
},
{"path": "vllm/v1/metrics/perf.py", "output": "perf.inc.md"},
]