omerpaz95 7227d06156 [Metrics] [KVConnector] Add Offloading Connector metrics (#27942) ...

Added queries and hits metrics for the Offloading Connector.

Also added timing metrics for store and load operations, which take the
average time it takes to load/store, per-token.

The metrics are available from Prometheus and from the StatLogger.

Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Omer Paz <Omer.Paz@ibm.com>

2026-01-27 13:34:49 +00:00

..

test_cpu_gpu.py

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942)

2026-01-27 13:34:49 +00:00

test_cpu_manager.py

Implement ARC KV cache eviction policy for CPU offloader (#27039)

2025-11-12 09:51:39 -08:00

test_cpu_offloading.py

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00

test_worker.py

[KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870)

2026-01-11 08:05:36 +00:00