biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
master
nvfp4-megamoe-kernel/reference/official_inference/__init__.py

2 lines
60 B
Python
Raw Permalink Normal View History

Add reference/ dir: vLLM tokenizers, reasoning parsers, tool parsers, official inference - reference/vllm/tokenizers/ — official DSV4 tokenizer + encoding (read-only) - reference/vllm/reasoning/ — thinking mode parsers (DeepSeekR1 style ) - reference/vllm/tool_parsers/ — DSML tool call parsers (V3.2 base, V4 variant) - reference/official_inference/ — original weight's generate.py, model.py, kernel.py - reference/README.md documents the layout and which files matter for our pipeline - These are read-only references for cross-checking, not imported by production code
2026-06-03 10:25:23 +00:00
# Official inference reference — read only, do not modify
Reference in New Issue Copy Permalink