biondizzle/deepseek-v4-quant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

ba fongol again

Browse Source
This commit is contained in:
biondizzle
2026-05-12 21:46:42 +00:00
parent 02decb486e
commit 52cf3f2e25
2 changed files with 1 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.env
View File

@@ -4,13 +4,11 @@ USER=root
PASSWORD=6)Jr)B@dcX[mN?dx
# B200 Paths
DOCKER_COMPOSE=/root/nvidia-meeting/docker-compose.yml
WEIGHTS=/root/nvidia-meeting/DeepSeek-V4-Pro-NVFP4
REPO=/root/nvidia-meeting/deepseek-v4-quant
# Docker
IMAGE=atl.vultrcr.com/vllm/vllm-dsv4-nvfp4:latest
CONTAINER_NAME=nvidia-meeting-vllm-1
# Remotes
REPO_URL=https://sweetapi.com/biondizzle/deepseek-v4-quant.git

11
.gitignore vendored
View File

@@ -1,10 +1 @@
# Dequantized BF16 weights (3TB)
DeepSeek-V4-Pro-BF16/
# Calibration state (huge, not for git)
*.pt
# Python
__pycache__/
*.pyc
.venv/
.env