If you see The process was terminated due to an internal error in the .NET Runtime, Exit code 80131506, Event ID 1023, follow ...
Today we only have SyncPeriod on the cache.Option struct. Accordingly the SyncPeriod is set globally for the entire cache. I would be nice to be able to configure it per object, i.e. add the ...
vllm serve /home/model/Qwen3-Next-80B-A3B-Instruct --port 22 --host 0.0.0.0 --served-model-name qwen3_next_mtp_0 --tensor-parallel-size 4 --max-model-len 32000 --gpu ...