RadioAstronomySoftwareGroup / RadioAstronomySoftwareGroup/pyuvdata

Utils performance for Nants > 2,147,483,648

Open
#1,354 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

noncritical technical debt
Dominant language
Python
Stars
102
Forks
35
Avg merge
1d 20h
Merged PRs (30d)
14

Description

In the largest antennas configuration there is a performance degradation compared to the other utils functions.

This is most likely from the python interactions in the large Nants utility functions.
image

I've tried messing with the cython compiler directives like cdivision but it does not seem to fix this issue.

I first noticed this when toying with writing the utilites in rust and noticed the factor of ~10 slow down
image
compared to the 2048 implementation (and 256)

image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the large-Nants utility functions and comparing their execution with the 2048 and 256 implementations mentioned in the issue. Profile the Python interactions and investigate why configurations above 2,147,483,648 antennas are about ten times slower. Done means identifying and correcting the degradation, then confirming comparable performance with benchmarks.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.