Search results

[CONTRIBUTION]: Router: Idea, Track historic kv cache blocks active in last 120s as part of scheduling

backend::vllmRelates to the vllm backendRelates to the vllm backend

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

External Contribution

kvbm

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10697 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 13, 2026

[CONTRIBUTION]: Broadly restore and expose the per concurrency per dp rank

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

Status: Open.

#10696 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 13, 2026

[BUG]: Persistent vLLM cache not reused for torch.compile, causing slow startup

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

deployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetes

language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python code

pythonPull requests that update python codePull requests that update python code

Status: Open.

#10695 In ai-dynamo/dynamo;

· treydock opened on Jun 13, 2026

fix(runtime): reinitialize network bindings after CRIU restore

backend::vllmRelates to the vllm backendRelates to the vllm backend

deployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetes

deployment::natsRelated to nats.io / nats-server / jetstreamRelated to nats.io / nats-server / jetstream

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

Status: Open.

#10693 In ai-dynamo/dynamo;

· walkoss opened on Jun 13, 2026

[CONTRIBUTION]: Metrics: Add env var / const set of labels to all important metrics

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

metrics

observabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, logging

Status: Open.

#10683 In ai-dynamo/dynamo;

· michaelfeil opened on Jun 12, 2026

[BUG]: UCX errors in 1.3.0 dev images but not 1.2.0

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

deployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetes

kvbm

nixlRelates to NIXLRelates to NIXL

Status: Open.

#10671 In ai-dynamo/dynamo;

· treydock opened on Jun 12, 2026

[BUG] System health server (port 9090) does not rebind after CRIU restore, causing startup probe failure (pod stuck at 1/2)

backend::vllmRelates to the vllm backendRelates to the vllm backend

deployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetes

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

Status: Open.

#10665 In ai-dynamo/dynamo;

· walkoss opened on Jun 12, 2026

[BUG] NATS reconnection fails with EAFNOSUPPORT after CRIU restore on IPv6-disabled Kubernetes pods

deployment::natsRelated to nats.io / nats-server / jetstreamRelated to nats.io / nats-server / jetstream

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

QA Bug

Status: Open.

#10664 In ai-dynamo/dynamo;

· walkoss opened on Jun 12, 2026

[BUG]: Update vLLM KV events API guard for map encoding

backend::vllmRelates to the vllm backendRelates to the vllm backend

pythonPull requests that update python codePull requests that update python code

Status: Open.

#10660 In ai-dynamo/dynamo;

· yankay opened on Jun 12, 2026

[CONTRIBUTION]: fix(sglang): skip Dynamo model prefetch for object storage paths

backend::sglangRelates to the sglang backendRelates to the sglang backend

bugSomething isn't workingSomething isn't working

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python code

pythonPull requests that update python codePull requests that update python code

Status: Open.

#10655 In ai-dynamo/dynamo;

· Cirilus opened on Jun 12, 2026

Track vLLM source install dependency pitfalls around NIXL CUDA wheels

backend::vllmRelates to the vllm backendRelates to the vllm backend

documentationImprovements or additions to documentationImprovements or additions to documentation

nixlRelates to NIXLRelates to NIXL

Status: Open.

#10654 In ai-dynamo/dynamo;

· carlory opened on Jun 12, 2026

Refactor PrefillRouter to use the shared routing admission lifecycle

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

fault tolerance

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

refactor

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#10642 In ai-dynamo/dynamo;

· PeaBrane opened on Jun 12, 2026