SYCL failures for fluids example on SunSpot
- Dominant language
- C
- Stars
- 265
- Forks
- 78
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 11
Description
I've seen some failures on SunSpot with the fluids examples. The general behavior is:
- `/gpu/sycl/ref` passes fine everytime
- `/gpu/sycl/shared` fails about 90% of the time
- `/gpu/sycl/gen` fails about 10% of the time
The failures are only present on a few tests (SunSpot is down for maintenance today, so I can't confirm which ones exactly right now, but I'm fairly certain the Gaussian wave tests are one of them), but the above behavior is pretty consistent. This is observed using the `oneapi/release/2024.04.15.001`.
The failure specifically is a non-linear solver divergence:
```
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: TSStep has failed due to DIVERGED_NONLINEAR_SOLVE, increase -ts_max_snes_failures or make negative to attempt recovery
```
Given the relationships between the backends, I'm guessing the error is probably in the shared functions between the `shared` and `gen` backends.
Tagging @kris-rowe @uumesh
Contributor guide
Assessment
This issue has not been assessed yet.