biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[BugFix] Fix input positions for long context with sliding window (#2088)

Browse Source
This commit is contained in:
Woosuk Kwon
2023-12-13 12:28:13 -08:00
committed by GitHub
parent 096827c284
commit f1c8520146
5 changed files with 75 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
tests/prompts/example.txt Normal file
View File

@@ -0,0 +1,8 @@
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs.
Briefly describe the major milestones in the development of artificial intelligence from 1950 to 2020.
Compare and contrast artificial intelligence with human intelligence in terms of processing information.
Describe the basic components of a neural network and how it can be trained.
Write a short story about a robot that dreams for the first time.
Analyze the impact of the COVID-19 pandemic on global economic structures and future business models.
Explain the cultural significance of the Mona Lisa painting, and how its perception might vary in Western versus Eastern societies.
Translate the following English sentence into Japanese, French, and Swahili: 'The early bird catches the worm.'