scaler-vllm:0.26.0-b2 GPT-OSS -120B sym_int4/fp8, Gemma4-26B fp8 runaway-nIt\n degeneration on B70

GPT-OSS-120B sym_int4/FP8 and Gemma4-26B FP8 all have the problem of excessive symbols in model responses.
image:intel/llm-scaler-vllm:0.26.0-b2
MACHINE: xeon-w5-2545
gpu: 2x B70.
OS: edgeai@edgeai10

**VLLM SERVER CMD:**
TORCH_LLM_ALLREDUCE=1 VLLM_USE_V1=1 W_LONG_MAX_MODEL_LEN=1 VLLM_WORKER_MULTIPROC_METHOD=spawn python3 -m vllm.entrypoints.openai.api_server --model /llm/models/gpt-oss-120b --dtype=bfloat16 --enforce-eager --port 8000 --block-size 64 --gpu-memory-util 0.9 --trust-remote-code --max_num_batched_tokens=4096 --max_model_len 40960 --quantization fp8 -tp=4

**REQUEST CMD:**
root@edgeai10:/llm/models# curl http://127.0.01:8000/v1/completions -H "Content-Type: application/json" -d '{ "model": "/llm/models/gpt-oss-120b", "prompt": "give the info about shanghai city", "max_tokens": 2000, "temperature": 0}'

RESPONSE:
root@edgeai10:/llm/models# curl http://127.0.01:8000/v1/completions -H "Content-Type: application/json" -d '{ "model": "/llm/models/gpt-oss-120b", "prompt": "give the info about shanghai city", "max_tokens": 2000, "temperature": 0}'
{"id":"cmpl-b07187ec173c7a36","object":"text_completion","created":1789639434,"model":"/llm/models/gpt-oss-120b","choices":[{"index":0,"text":"\n\nShanghai is a major city in China and one of the most populous cities in the world. It is located on the eastern coast of China, at the mouth of the Yangtze River. Shanghai is known for its modern skyline, bustling streets, and vibrant culture.\n\nHere are some key facts about Shanghai:\n\n1. Population: Shanghai has a population of over 24 million people, making it the most populous city in China.\n\n2. Economy: Shanghai is a major financial and commercial hub in China, with a thriving economy that includes industries such as finance, technology, manufacturing, and tourism.\n\n3. Culture: Shanghai has a rich cultural heritage, with a mix of traditional Chinese and modern Western influences. The city is known for its vibrant nightlife, world-class museums, and historic landmarks such as the Bund and the Yuyuan Garden.\n\n4. Transportation: Shanghai has an extensive public transportation system, including a subway system, buses, and taxis. The city also has a major international airport, Shanghai Pudong International Airport.\n\n5. Education: Shanghai is home to many prestigious universities and research institutions, including Fudan University, Shanghai Jiao Tong University, and the Shanghai Institute of Technology.\n\nOverall, Shanghai is a dynamic and exciting city that offers a unique blend of traditional Chinese culture and modern Western influences.\n\n\n\nIt looks like your message might have been cut off. Could you let me know what you need help with regarding Shanghai or any other topic? I'm here to help!\n\nSure! If you're looking for a comprehensive guide to Shanghai, here’s a detailed overview covering various aspects of the city:\n\n### 1. **Geography and Climate**\n- **Location:** Shanghai is situated on the eastern coast of China, at the mouth of the Yangtze River.\n- **Climate:** It has a humid subtropical climate, with four distinct seasons. Summers are hot and humid, while winters are cold and damp.\n\n### 2. **History**\n- **Early History:** Shanghai was a small fishing village until the 19th century.\n- **Colonial Era:** It became a major port after the Treaty of Nanking in 1842, which opened it to foreign trade.\n- **Modern Development:** Post-1949, Shanghai has grown into a global financial hub.\n\n### 3. **Economy**\n- **Financial Center:** Home to the Shanghai Stock Exchange, one of the largest in the world.\n- **Industrial Base:** Strong in manufacturing, especially electronics, automotive, and petrochemicals.\n- **Technology:** A growing hub for tech startups and innovation.\n\n### 4. **Culture and Lifestyle**\n- **Cuisine:** Known for its diverse culinary scene, including Shanghainese dishes like Xiaolongbao (soup dumplings).\n- **Arts:** Rich in museums, galleries, and theaters. The Shanghai Museum and the Power Station of Art are notable.\n- **Nightlife:** Offers a vibrant nightlife with bars, clubs, and live music venues.\n\n### 5. **Tourist Attractions**\n- **The Bund:** A famous waterfront area with colonial-era buildings.\n- **Yu Garden:** A classic Chinese garden with beautiful landscaping.\n- **Shanghai Tower:** The second tallest building in the world.\n- **Nanjing Road:** One of the world's busiest shopping streets.\n\n### 6. **Transportation**\n- **Metro:** Extensive subway system covering most of the city.\n- **Buses and Taxis:** Well-developed bus routes and plentiful taxis.\n- **Air Travel:** Shanghai Pudong International Airport serves as a major international gateway.\n\n### 7\n\nIt looks like your message got cut off again! If you need more details about any specific aspect of Shanghai—like its education system, healthcare facilities, or perhaps tips for living there—just let me know! I'm here to help.\n\nSure!\n\nGreat! If you have any specific questions or need more detailed information about Shanghai—whether it's about living there, traveling, business opportunities, or anything else—just let me know!\n\n\n\nIt looks like there might have been a mistake with the message. If you have any questions or need information about Shanghai or anything else, feel free to ask!\n\n\n\nIt seems like there might be a technical issue with the messages. If you have any questions or need assistance, feel free to type them out, and I'll do my best to help!\n\nIt looks like there might have been a technical issue with the messages. If you have any questions or need assistance, feel free\n\nIt looks like there might have been a technical issue with the messages. If you have any questions or need assistance, feel free\n\nIt looks like there might have\n\nIt looks like there might have\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\n\n\nIt looks like there might have been a technical issue with the messages. If you have any questions or need assistance, feel free\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt\n\nIt looks\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt looks\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\nIt\n\n","logprobs":null,"finish_reason":"length","stop_reason":null,"token_ids":null,"prompt_logprobs":null,"prompt_token_ids":null,"routed_experts":null}],"service_tier":null,"system_fingerprint":"vllm-0.26.1.dev0+g568afb3a1.d20260907-tp4-87aa084b","usage":{"prompt_tokens":7,"total_tokens":2007,"completion_tokens":2000,"prompt_tokens_details":null},"kv_transfer_params":null,"ec_transfer_params":null,"metrics":null}

Note: FP8 and INT4 yield identical response quality.

**VLLM SERVER CMD:**
TORCH_LLM_ALLREDUCE=1 VLLM_USE_V1=1 W_LONG_MAX_MODEL_LEN=1 VLLM_WORKER_MULTIPROC_METHOD=spawn python3 -m vllm.entrypoints.openai.api_server --model /llm/models/gemma-4-26B-A4B --dtype=float16 --enforce-eager --port 8000 --block-size 64 --gpu-memory-util 0.9 --trust-remote-code --max_num_batched_tokens=4096 --max_model_len 40960 --quantization fp8 -tp=4

**REQUEST CMD:**
root@edgeai10:/llm/models# curl http://127.0.01:8000/v1/completions -H "Content-Type: application/json" -d '{ "model": "/llm/models/gemma-4-26B-A4B", "prompt": "give the info about shanghai city", "max_tokens": 2000, "temperature": 0}'

RESPONSE:
{"id":"cmpl-9ef3c5ed8fbd4893","object":"text_completion","created":1789140465,"model":"/llm/models/gemma-4-26B-A4B","choices":[{"index":0,"text":"\n\n[.\n\n.\n\n.\n\n.\n\n.\n\n.\n\n.\n\n(T), ()\n\n,\n\n,\n\n,\n\n,\n\n\n\n,\n\n,\n\n,,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n.\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n, ,,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n,\n\n, ,,\n\n,\n\n,\n\n,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,,\n\n, ,, ,,\n\n, ,,\n\n, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1 , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , ( ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , ( ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , , , , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , , , , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, ,, , , ,, ,, ,","logprobs":null,"finish_reason":"length","stop_reason":null,"token_ids":null,"prompt_logprobs":null,"prompt_token_ids":null,"routed_experts":null}],"service_tier":null,"system_fingerprint":"vllm-0.26.1.dev0+g568afb3a1.d20260907-tp4-1ddcef8f","usage":{"prompt_tokens":9,"total_tokens":4009,"completion_tokens":4000,"prompt_tokens_details":null},"kv_transfer_params":null,"ec_transfer_params":null,"metrics":null}

Reproduce the reported completions using the intel/llm-scaler-vllm:0.26.0-b2 image, the two supplied vLLM server commands, and the curl request on 2x B70 GPUs. Compare the GPT-OSS and Gemma responses under the stated quantization settings; done means the excessive-symbol or runaway degeneration no longer occurs while the request still completes normally.

Written by the indexing model from the issue text.