microsoft / microsoft/foundry-local

foundry local spitting out garbage regardless of which model being used

Open
#869 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.6k
Forks
369
Avg merge
2d 17h
Merged PRs (30d)
39

Description

Image

Image

So I am taking a summer class on agentic AI, and I am fairly new to Foundry Local. Our first assignment was to create our own simple AI chatbot using a video our professor made. The code runs on my professor's all-AMD desktop and my laptop, but not on my all-AMD desktop. Any help pointing me in the right direction to figure out why?
pc specs:
cpu: ryzen 7 9800x3d
gpu: RX 6800
32 gbs ddr5 6000MT/s

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the chatbot on the Ryzen 7 9800X3D/RX 6800 system and compare its output with the working AMD machines. Gather the model name, commands, runtime and device details, plus complete logs and the expected-versus-actual responses; done means identifying a reproducible cause and confirming corrected chatbot output.

Written by the indexing model from the issue text.

Assessment

Domain
ai, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.