…-project#30)

…ce_artifacts

Revert "Produce artifacts for bare metal installation in Dockerfile.openvino"

This PR logs all errors during validation or generation
for a request like TGIS does. 

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

…ensions

Dockerfile.ubi: get rid of prebuilt-wheel stage

…um_wa

WA: Disable cumsum in HPU _prepare_prompt

fix the model loading fp8

Some PR for plugin support is not merged by vllm yet. This PR add monkey
patch to vllm-ascend to make vllm-ascend work with vllm directly.

This patch code should be removed once the related function is supported
by vllm originally.

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <xmo@berkeley.edu>

Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <xmo@berkeley.edu>

…cache

[NIXL] fix unify kv cache spec

New Industry Use Cases (vllm-project#21-30):
- vllm-project#21 Game Development: AI game testing + balance tuning
- vllm-project#22 Construction: Vision AI safety inspection
- vllm-project#23 Agriculture/Smart Farm: Crop monitoring + pest detection
- vllm-project#24 Government/Public: Document automation + citizen services
- vllm-project#25 Energy/Utilities: Grid monitoring + anomaly detection
- vllm-project#26 Environment/Sustainability: Carbon tracking + ESG reporting
- vllm-project#27 Fashion/Apparel: Trend analysis + inventory optimization
- vllm-project#28 Sports/Fitness: Performance analytics + tactical analysis
- vllm-project#29 Automotive/Mobility: Autonomous driving simulation
- vllm-project#30 Space/Aerospace: Satellite image analysis

Advanced Architecture Patterns:
1. Event-Driven Pattern: Webhook → Event Bus → Agent triggers
2. Streaming Pattern: Large dataset processing with chunking
3. Batch Processing Pattern: Celery-based parallel processing
4. Circuit Breaker Pattern: Fault tolerance + auto recovery
5. CQRS + Event Sourcing: Command/Query separation
6. Saga Pattern: Distributed transaction management

Guide now covers:
- 30+ industry-specific MCP implementations
- 6 production-ready architecture patterns
- Real-world scalability solutions
- Enterprise integration strategies
- Total: 8,672 lines (from 7,249)

* add implementation

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* add impl

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* add flashinfer

* fix tp

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* Temporary change for ViT

* fix workspace_buffer device.

* change max_seqlen to 128k.

* remove duplicate multiplier.

* fix accuracy and refactor

* more fix

* change dockerfile

* format

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* fix version

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change python version

* remove qwen25 transformer support

* change dockerfile

* add build versions

* chagne version

* change version

* change

* change

* change

* change

* change

* build image

* change back

* change to 10.0f

* fix fi import

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change to build in dev image

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change location

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change location

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change cubin and jitcache to wheels

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* change

Signed-off-by: Max Hu <hyoung2991@gmail.com>

* add comment

Signed-off-by: Max Hu <hyoung2991@gmail.com>

---------

Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Anerudhan Gopal <agopal@nvidia.com>
Co-authored-by: Baorun Mu <bmu@nvidia.com>

add multistream and core limitation of communication stream