microsoft / microsoft/WindowsAppSDK

Phi-Silica: JSON Mode, Function calling

Open
#5,164 4 comments 4 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

area-WCR
Dominant language
C++
Stars
4.7k
Forks
471
Avg merge
3d 13h
Merged PRs (30d)
28

Description

Over the past weekend, I played around with Phi-Silica on experimental WindowsApp SDK. It's very promising and impresses with it's efficiency and speed, running on the local NPU.

This would be great for small NLP tasks (sentiment, decision making etc.) but I also have some feedback:

- No JSON mode: Difficult the adhere the model to a particular JSON format
- Support for function calling: Is there any potential here?
- Knowledge Cut-off: The internal knowledge seems to be quite outdated.
- Potentially bigger context window?

Finally, are there any plans to have more models available (model catalog) or allow developers to bring their own models?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified. First clarify whether JSON mode, function calling, context size, knowledge updates, model catalog, or custom-model support is in scope; done would require an agreed request and implementation plan.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
ai, desktop
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.