cdisc-org / cdisc-org/cdisc-rules-engine

Add a category of lazy attributes in dataset builders.

Open
#1,716 0 comments 0 reactions 0 assignees View on GitHub
large datasets/performance
Dominant language
Python
Stars
113
Forks
43
Avg merge
14h 51m
Merged PRs (30d)
14

Description

### Feature Description

Currently variable_max_size attribute is loaded only if required by a rule. Extend this functionality to allow specifying a list of attributes to check if they are needed. This will allow to load some "expensive" attributes only for rules, which actually require them (like variable_has_empty_values, variable_is_empty).

Contributor guide

Open the contributing guide

Research direction

Start by locating the dataset builders and tracing how variable_max_size is currently loaded only when required by a rule. Identify the rule handling for variable_has_empty_values and variable_is_empty, then determine how a configurable list of lazy attributes should be checked. Done means expensive attributes are loaded only for rules that require them without changing existing variable_max_size behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.