biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[core][torch.compile] discard the compile for profiling (#7796)

Browse Source
This commit is contained in:
youkaichao
2024-08-26 21:33:58 -07:00
committed by GitHub
parent 39178c7fbc
commit 64cc644425
4 changed files with 43 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.buildkite/run-tpu-test.sh
View File

@@ -12,5 +12,4 @@ remove_docker_container
# For HF_TOKEN.
source /etc/environment
# Run a simple end-to-end example.
docker run --privileged --net host --shm-size=16G -it -e HF_TOKEN=$HF_TOKEN --name tpu-test vllm-tpu \
python3 /workspace/vllm/examples/offline_inference_tpu.py
docker run --privileged --net host --shm-size=16G -it -e HF_TOKEN=$HF_TOKEN --name tpu-test vllm-tpu /bin/bash -c "python3 -m pip install git+https://github.com/thuml/depyf.git && python3 /workspace/vllm/tests/tpu/test_compilation.py && python3 /workspace/vllm/examples/offline_inference_tpu.py"