openvinotoolkit / openvinotoolkit/model_server

How to run model_server on an arm64 machine

Open
#2,227 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
C++
Stars
931
Forks
277
Avg merge
2d 13h
Merged PRs (30d)
68

Description

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

  1. Steps to prepare models repository '...'
  2. OVMS launch command '....'
  3. Client command (additionally client code if not using official client or demo) '....'
  4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Logs
Logs from OVMS, ideally with --log_level DEBUG. Logs from client.

Configuration

  1. OVMS version
  2. OVMS config.json file
  3. CPU, accelerator's versions if applicable
  4. Model repository directory structure
  5. Model or publicly available similar model that reproduces the issue

Additional context
Add any other context about the problem here.
How to run model_server on an arm64 machine

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No source files, tests, commands, logs, OVMS version, or ARM64 environment details are provided. Start by collecting the missing reproduction information from the issue template, then inspect the project’s ARM64 build and launch documentation or entry points. Done should be a verified, reproducible way to run model_server on ARM64.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
backend, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.