microsoft / microsoft/pai

When running inference job using blob, some lines in output file is missing values

Open
#4,784 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

DRI raised by customer
Dominant language
JavaScript
Stars
2.7k
Forks
554
Avg merge
20h 42m
Merged PRs (30d)
14

Description

Raised by customer:
When running large inference, few lines in output file is missing some results.
Not sure if it cause by azure blob or other errors.

We may need to find a way to collect blobfuse logs to track such error.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names large inference jobs, output files, Azure Blob, and blobfuse logs but does not identify a source file, test, or entry point. Begin by reproducing the missing-value behavior and determining whether the loss occurs during inference or blobfuse output handling; done means identifying the cause and adding a way to collect the relevant logs.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.