desihub / desihub/tutorials

NERSC vs. NOIRLab DB interoperation

Open
#107 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
61
Forks
25
PR merge metrics
No merged PRs in 30d

Description

Do we have a recipe for one someone could write database query code that could be used interchangeably between NERSC and NOIRLab with minimal modification, ideally with a starting if/then block to identify location and then allow everything else to be the same?

It appears that NOIRLab requires access through the datalab [dl.queryClient.query](https://github.com/astro-datalab/datalab) interface specific to the NOIRLab DBs, while the DESI NERSC database supports direct access via psycopg2 or the schema-specific [specprod-db](https://github.com/desihub/specprod-db) . But I don't see an obvious way to write database query code that could work at either location, despite both locations having very similar DESI databases. Or maybe NOIRLab does allow direct psycopg2 connections, it just isn't the documented/recommended way if working entirely within the NOIRLab ecosystem?

Detail: They also use different schema names (e.g. `desi_edr` vs. `fuji`) but if that was the only difference I think it could be easily handled at the top of a script.

@weaverba137 @stephjuneau ?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.