CliMA / CliMA/ParameterEstimocean.jl

Large forward maps make Julia crash

Open
#84 16 comments 0 reactions 0 assignees View on GitHub
❓ question 🚑 help wanted
Dominant language
Julia
Stars
22
Forks
6
PR merge metrics
No merged PRs in 30d

Description

When trying to calibrate to LESbrary simulations, the forward map typically has over half a million elements, making it impossible to store a covariance matrix for EKI. How do you guys want to handle this? We could

1. Look into using sparse matrices.
2. Store fewer time steps in `observations`. This would make it harder to animate the solution downstream.
3. Add a `time_range` attribute to `ConcatenatedOutputMap` that specifies which time steps to track--defaults to all time steps.
4. Delete `OceanTurbulenceParameterEstimation.jl` and sip guava juice from Costco while brainstorming alternative research topics.

@glwagner @navidcy What do you guys think?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the issue's discussion and inspecting ConcatenatedOutputMap, observations, and OceanTurbulenceParameterEstimation.jl. Compare the listed approaches for handling large forward maps, then confirm the maintainers' decision before implementing anything. Done means an agreed approach prevents the Julia crash while preserving the required downstream behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
machine-learning, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.