ROCm / ROCm/FastFlowLM

FLM 0.9.45 + Qwen3.6-35B-A3B @ debian trixie/linux 7.0.12: no context

Open
#614 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
1.9k
Forks
152
Avg merge
4h 14m
Merged PRs (30d)
11

Description

On my AMD Ryzen™ AI 7 350 w/ Radeon™ 860M × 16 - debian trixie/linux 7.0.12 with 128GB RAM
Qwen3.6-35B-A3B seems to loose it's context after every interaction:

/verbose

Hi, what should I do if it's raining?

[FLM] Prefill chunk 1/1 with 19 tokens
[FLM] Creating checkpoint at context length 19, general_token_idx 19
What you do when it’s raining largely depends on your immediate situation and personal preferences, but here are a few ideas categorized by different scenarios:

🏠 If You’re Indoors
  • Cozy Up: Make a warm drink (tea, coffee, hot chocolate), grab a blanket, and read a book or watch a movie. Rainy days are perfect for slowing down.
  • Catch Up on Tasks: Use the quiet time to organize your space, catch up on emails, or tackle small projects you’ve been putting off.
  • Listen to the Rain: Play ambient rain sounds or lo-fi music if it’s too dry outside to hear the natural patter.
☂️ If You’re Outdoors
  • Gear Up: Grab an umbrella, wear a raincoat, and put on waterproof shoes. Layering helps if the rain brings cooler temperatures.
  • Embrace It: Some people find walking in the rain refreshing or meditative. Just stay safe and avoid flooded areas.
  • Seek Shelter: If the rain is heavy, find a café, museum, library, or mall to wait it out.
🚗 If You’re Driving
  • Slow Down: Wet roads reduce traction. Increase following distance and brake gently.
  • Use Lights: Turn on headlights (not high beams) to improve visibility.
  • Avoid Hydroplaning: Keep a firm grip on the wheel and avoid sudden movements.
🌧️ General Tips
  • Check the Forecast: See if the rain will pass quickly or last all day so you can plan accordingly.
  • Stay Dry: Keep electronics protected and change out of wet clothes promptly to avoid catching a chill.

What’s your situation? Are you stuck outside, planning an indoor day, or just curious? 😊
[FLM] Model RAW Output:
What you do when it’s raining largely depends on your immediate situation and personal preferences, but here are a few ideas categorized by different scenarios:

🏠 If You’re Indoors
  • Cozy Up: Make a warm drink (tea, coffee, hot chocolate), grab a blanket, and read a book or watch a movie. Rainy days are perfect for slowing down.
  • Catch Up on Tasks: Use the quiet time to organize your space, catch up on emails, or tackle small projects you’ve been putting off.
  • Listen to the Rain: Play ambient rain sounds or lo-fi music if it’s too dry outside to hear the natural patter.
☂️ If You’re Outdoors
  • Gear Up: Grab an umbrella, wear a raincoat, and put on waterproof shoes. Layering helps if the rain brings cooler temperatures.
  • Embrace It: Some people find walking in the rain refreshing or meditative. Just stay safe and avoid flooded areas.
  • Seek Shelter: If the rain is heavy, find a café, museum, library, or mall to wait it out.
🚗 If You’re Driving
  • Slow Down: Wet roads reduce traction. Increase following distance and brake gently.
  • Use Lights: Turn on headlights (not high beams) to improve visibility.
  • Avoid Hydroplaning: Keep a firm grip on the wheel and avoid sudden movements.
🌧️ General Tips
  • Check the Forecast: See if the rain will pass quickly or last all day so you can plan accordingly.
  • Stay Dry: Keep electronics protected and change out of wet clothes promptly to avoid catching a chill.

What’s your situation? Are you stuck outside, planning an indoor day, or just curious? 😊

Verbose:
Total tokens: 395 (0.31%)
TTFT: 3.27 s
Prefill speed: 5.94 tokens/s
Decoding speed: 12.99 tokens/s

/status

Statistics:
Total tokens: 395 (399)
Total time: 32.7866 s
Decoding time: 29.1092 s
Prefill time: 3.19955 s
Average decoding speed: 12.9856 tokens/s
Average prefill speed: 5.93834 tokens/s

/history

History:
<|im_start|>user
Hi, what should I do if it's raining?<|im_end|>
<|im_start|>assistant

you do when it’s raining largely depends on your immediate situation and personal preferences, but here are a few ideas categorized by different scenarios:

🏠 If You’re Indoors
  • Cozy Up: Make a warm drink (tea, coffee, hot chocolate), grab a blanket, and read a book or watch a movie. Rainy days are perfect for slowing down.
  • Catch Up on Tasks: Use the quiet time to organize your space, catch up on emails, or tackle small projects you’ve been putting off.
  • Listen to the Rain: Play ambient rain sounds or lo-fi music if it’s too dry outside to hear the natural patter.
☂️ If You’re Outdoors
  • Gear Up: Grab an umbrella, wear a raincoat, and put on waterproof shoes. Layering helps if the rain brings cooler temperatures.
  • Embrace It: Some people find walking in the rain refreshing or meditative. Just stay safe and avoid flooded areas.
  • Seek Shelter: If the rain is heavy, find a café, museum, library, or mall to wait it out.
🚗 If You’re Driving
  • Slow Down: Wet roads reduce traction. Increase following distance and brake gently.
  • Use Lights: Turn on headlights (not high beams) to improve visibility.
  • Avoid Hydroplaning: Keep a firm grip on the wheel and avoid sudden movements.
🌧️ General Tips
  • Check the Forecast: See if the rain will pass quickly or last all day so you can plan accordingly.
  • Stay Dry: Keep electronics protected and change out of wet clothes promptly to avoid catching a chill.

What’s your situation? Are you stuck outside, planning an indoor day, or just curious? 😊<|im_end|>
Tokens: 398
248045 846 198 12675 11 1092 1220 353 635 413 424 579 80381 30 248046 198 248045 74455 198 248068 271 248069 271 488 635 948 424 725 80381 13375 13402 383 678 13522 6331 321 4204 18738 11 694 1532 513 264 2342 6498 68471 539 2086 24481 25 271 13962 10838 237 254 1368 1394 3029 73290 1052 198 12 2972 7108 4107 3038 92217 7170 264 7948 6808 318 78781 11 10482 11 3882 17395 681 11298 264 36781 11 321 1301 264 2236 466 3609 264 5522 13 21235 88 2756 513 4574 364 45732 1441 13 198 12 2972 55823 3038 383 44920 92217 5272 279 11012 854 310 29249 678 3433 11 2213 685 383 13888 11 466 20747 2526 6859 488 3849 978 10371 974 13 198 12 2972 37432 310 279 21235 92217 6834 33056 10849 10054 466 750 35418 4477 413 424 725 2166 8785 4732 310 6512 279 5629 88823 13 271 13962 24329 224 29545 1368 1394 3029 4230 26422 198 12 2972 79927 3038 92217 34997 449 46299 11 9558 264 10849 65137 11 321 2113 383 44873 14850 13 22028 286 8346 413 279 10849 12077 34635 19274 13 198 12 2972 2196 30212 1049 92217 4188 1208 1423 11107 303 279 10849 34728 466 1711 20657 13 4450 4565 5902 321 5471 47154 5493 13 198 12 2972 38049 72274 92217 1368 279 10849 369 8545 11 1423 264 50203 11 23223 11 6522 11 466 32150 310 3655 424 680 13 271 13962 10838 248 245 1368 1394 3029 50499 198 12 2972 56328 6087 92217 43362 18660 7698 45290 13 38321 2614 5821 321 33473 28314 13 198 12 2972 9947 33040 92217 11658 383 84599 318 1856 1496 48264 8 310 7042 22437 13 198 12 2972 50366 38195 10083 286 92217 13262 264 7239 23898 383 279 12899 321 5471 10647 18456 13 271 13962 10838 234 100 29545 3146 24886 198 12 2972 3840 279 53806 92217 3382 413 279 10849 668 1440 5964 466 1483 660 1834 748 488 628 3019 26211 13 198 12 2972 36842 29831 92217 13262 29496 2530 321 2222 680 314 13988 14656 38117 310 5471 31973 264 35101 13 271 3710 725 678 6331 30 8448 488 15239 4732 11 8842 449 28557 1834 11 466 1066 21520 30 25677 232 248046

Summarize the current conversation!

[FLM] Prefill chunk 1/1 with 15 tokens
[FLM] Creating checkpoint at context length 15, general_token_idx 15
There is no previous conversation to summarize, as this is the start of our interaction. How can I help you today?
[FLM] Model RAW Output:
There is no previous conversation to summarize, as this is the start of our interaction. How can I help you today?

Verbose:
Total tokens: 40 (0.03%)
TTFT: 3.00 s
Prefill speed: 5.02 tokens/s
Decoding speed: 13.25 tokens/s

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue with the shown /verbose, /status, /history, and summarization sequence on the reported Debian/Linux setup. Start by tracing how the displayed history and checkpoint context are handled; done means a follow-up request retains the prior conversation and summarization no longer reports an empty interaction.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, debian, linux
Domain
ai, operating-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.