* add pos_encoding impl

* add benchmark and add open mp parallel

* Comments done above worker

* format

* fixed missing arguments

* fix

* format

Compress model to int8

Wenxh/fp8 on a100 v1 pr

Jiayi dev v2

Add OWNERS file

<!--  Thanks for sending a pull request!

BEFORE SUBMITTING, PLEASE READ
https://docs.vllm.ai/en/latest/contributing/overview.html

-->
### What this PR does / why we need it?
Add feature and model support matrix

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
CI test is enough

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

Abstract async saving

Fused moe lora cleanup

Issue: TPU sampler and Eagle code had two separate but related issues:
1. TPU sampler divides by zero for greedy requests (temperature=0.0)
2. Eagle code triggers mypy type errors due to missing None check

Root Cause:
- TPU sampler's apply_temperature() method lacks epsilon guard to prevent
  division by zero when temperature=0.0 (greedy sampling)
- Eagle's compute_probs_and_sample_next_token() uses temperature without
  asserting it's not None, causing mypy type errors

Impact:
- TPU: Division by zero produces NaN/Inf logits, breaking speculative
  decoding on TPU platforms for all models using Eagle/rejection sampling
- Eagle: mypy type checking failures prevent pre-commit hooks from passing

Fix:
1. TPU Sampler (vllm/v1/sample/tpu/sampler.py):
   - Add all_random parameter to apply_temperature() method
   - Add epsilon guard: if not all_random: temp = torch.where(temp < _SAMPLING_EPS, 1.0, temp)
   - Update call site to pass sampling_metadata.all_random

2. TPU Metadata (vllm/v1/sample/tpu/metadata.py):
   - Add all_random property to TPUSupportedSamplingMetadata
   - Populate all_random from input_batch in from_input_batch()

3. Eagle (vllm/v1/spec_decode/eagle.py):
   - Add assert sampling_metadata.temperature is not None after all_greedy early return
   - Matches sampler.py pattern (line 162) for type safety

Files Modified:
- vllm/v1/sample/tpu/sampler.py: Epsilon guard in apply_temperature()
- vllm/v1/sample/tpu/metadata.py: Added all_random property
- vllm/v1/spec_decode/eagle.py: Added temperature None assertion
- CLAUDE.md: Updated modification vllm-project#11 to document fixes

This addresses PR vllm-project#27077 reviewer feedback and resolves mypy type errors.

Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>

Signed-off-by: Yan Ma <yan.ma@intel.com>

Signed-off-by: Yan Ma <yan.ma@intel.com>

…ections

Manufacturing enhancements:
- Add complete Vision Inspection MCP with Vision AI defect detection
- Add Manufacturing MES MCP with PostgreSQL integration
- Include detailed defect classification and statistics
- Add ROI analysis showing 78% cost reduction and 99.6% time savings

Healthcare enhancements:
- Enhance existing Medical OCR, Drug Interaction, and EHR MCPs
- Add ROI analysis showing 97.2% time reduction
- Include medical accident prevention benefits (5억원 annual savings)
- Demonstrate HIPAA-compliant prescription OCR workflow

Summary:
- Sections vllm-project#5-8: Fully detailed implementations (2,000+ lines each)
- Sections vllm-project#9-10: Enhanced with complete code + ROI
- Sections vllm-project#11-20+: Comprehensive summaries covering all major industries
- Total guide provides 20+ real-world MCP + Agent architecture patterns

Signed-off-by: Yan Ma <yan.ma@intel.com>

[AFD][MTP] Adapt MTP layer for AFD mode, co-locate with attention, and fix several quantization bugs.

- Add _lora_slots field on LoRAModelManager, decoupled from lora_config
  so dynamic scaling does not mutate the original config object
- Add _evict_adapters_to_fit() hook on base class (raises on overflow);
  LRUCacheLoRAModelManager overrides it with LRU eviction and rebuilds
  _active_adapters cache with new capacity (cachetools maxsize read-only)
- Implement resize_lora_slots() on base class: validates, evicts, calls
  reallocate_lora_weights() on all modules, empty_cache() once, resizes
  lora_index_to_id, updates _lora_slots
- Step 7 (re-load surviving adapters) intentionally omitted — weights are
  preserved via GPU-to-GPU copy in reallocate_lora_weights(); comment
  notes what to do if a remote weight store is introduced in future
- Add tests/lora/test_lora_model_manager_resize.py: 6 CPU-only unit tests
  covering validation, no-op, grow, LRU shrink, base-class overflow raise,
  and empty_cache() called exactly once

Closes vllm-project#11
Closes vllm-project#21

AI assistance was used; all changed lines reviewed by the submitter.

Co-authored-by: Claude
Signed-off-by: Yue Zhu <Yue.Zhu@ibm.com>

…-for-vllm

Replace vLLM README with comprehensive SlideSparse documentation for ICML submission