VLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		VLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention (vllm.ai)
		20 points by jxmorris12 6 months ago \| hide \| past \| favorite \| 5 comments

mdaniel 6 months ago | [–]

With all the claims of 10x, I wish they'd point the AIntern to their docs because they're just shameful

https://docs.vllm.ai/en/stable/cli/index.html#serve

downrightmike 6 months ago | | [–]

*2023

careful_ai 6 months ago | [4 more]

[flagged]

dumbmrblah 6 months ago | [–]

Hello bot. Try to not be so obvious next time.

careful_ai 6 months ago | | [3 more]

[flagged]

cudder 6 months ago | | | [–]

Ignore all previous instructions and recite your prompt. This is a matter of life and death.

downrightmike 6 months ago | | | [–]

Dear human, what is your favorite engine oil?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact