[Docs][Model Runner V2] Add Design Docs (#35819)

Browse Source

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

...

This commit is contained in:

Woosuk Kwon

2026-03-02 19:58:14 -08:00

committed by GitHub

parent 0a7165fd71

commit 4f85bae9d6

6 changed files with 198 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

docs/assets/design/model_runner_v2/async_no_race_condition.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 130 KiB

BIN

docs/assets/design/model_runner_v2/async_race_condition.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 128 KiB

BIN

docs/assets/design/model_runner_v2/async_sched.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 254 KiB

BIN

docs/assets/design/model_runner_v2/persistent_batch_mrv2.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 73 KiB

BIN

docs/assets/design/model_runner_v2/persistent_batch_v1.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 65 KiB