microsoft / microsoft/aurora

Tensor of input and output dimesionality different

Open
#49 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1k
Forks
174
PR merge metrics
No merged PRs in 30d

Description

Hello, I am attempting to fine tune the Aurora model, when I came across a dimensionality issue when using the predicted data for loss. Here is what the input tensor dimension looks for me:
batch.surf_vars['10u'].size()
torch.Size([1, 2, 721, 1440])
However with the predicted output by Aurora, I noticed the tensors are now dimension of
torch.Size([1, 1, 720, 1440])

I was wondering if this in part by design for the model, and If it is, how you finetuned Aurora when considering the different dimensions?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the fine-tuning case using batch.surf_vars['10u'] and compare its torch.Size([1, 2, 721, 1440]) shape with the predicted torch.Size([1, 1, 720, 1440]) shape. Trace the Aurora input and output tensors to determine whether the mismatch is intentional; done means the expected dimensionality and a compatible loss path are established.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.