intel / intel/AI-Playground

Unable to run LLM in AI Playground

Open
#138 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
979
Forks
132
Avg merge
9h 23m
Merged PRs (30d)
8

Description

## Describe the bug

Unable to run Microsofts Phi4:14.7B model in AI Playground.

## To Reproduce

Steps to reproduce the behavior:
1. Download NyxKrage/Microsoft_Phi-4
2. Enter prompt
3. Press enter
4. "An unknown error occurred. failed to generate from model."

## Expected behavior

I expected the LLM to receive my message and get an answer back.

## Screenshots

![AI_Playground_WuLKKVdVPj](https://github.com/user-attachments/assets/24c3958a-8b1f-4f6a-b7b4-300b18bc1e98)

## Environment (please complete the following information):

- OS: Windows 11 Pro
- GPU: Intel Arc B580 12GB
- CPU: Intel Core i9-14900KS
- Version: v2.0.0-alpha-prev

## Additional context

Downloaded a model from Huggingface.co, but it doesnt work in AI Playground.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.