vLLM v0.32.0New POST /v1/systemone endpoint answers choice, noul and score questions over a structured state, served by ...

vLLM v0.32.0New POST /v1/systemone endpoint answers choice, noul and score questions over a structured state, served by default; New hf tool parser (--tool-call-parser hf) and hf reasoning parser (--reasoning-parser hf) that read the checkpoint's response_template, in both the Python and Rust frontends; NVFP4…https://whatsnew.fyi/product/vllm/releases/v0.32.0#vLLM #AI

Read Original

Related