NishiSearch

Web This site Trusted

1 result(s) for “okapi bm25 site hotshops pp site can kernel org site:www.aleksagordic.com” · 739 ms

Scope: Nishi’s own index (our crawl + Common Crawl) — not the whole live web. Some sites block all automated crawlers (anti-bot walls), so their pages may be absent here even though we never filter lawful content.

Freshness: no result on this page carries a fetch time yet (indexed before the fetch epoch was stored beside the doc)

You can see that as P_kernel hits P_peak more compute per step will directly lead to an increase in latency
from the top result below

Inside vLLM: Anatomy of a High-Throughput LLM Inference System - Aleksa

https://www.aleksagordic.com/blog/vllm
It starts broad and then layers in detail (following an inverse-pyramid approach) so you can form an accurate high-level mental model of the complete system without drowning in minutiae