cdisc-org / cdisc-org/cdisc-rules-engine

Benchmark baseline testing - Reports and test data

Open
#881 1 comment 0 reactions 1 assignee Claimed by @RamilCDISC View on GitHub
large datasets/performance testing
Dominant language
Python
Stars
113
Forks
43
Avg merge
14h 51m
Merged PRs (30d)
14

Description

### Reporting
For each of the following, we want `type`, `name`, `number of calls`, `cumulative time`, `mean time`, `median time`, `min time`, `max time`
- [x] #905
- [x] #906

| Rule # | Dataset | Time (s) |
| --- | --- | --- |
| CORE-00001 | LB | 5.1 |

- [x] #907

| Rule # | # of Calls | Cumulative Time (s) | Mean Time | Median Time | Min Time | Max Time |
| --- | --- | --- | ---| --- | --- | --- |
| CORE-00001 | 5 | 5.1 | 1.1 | 1.0 | .5 | 8 |

- [x] #908
- [x] #909
https://github.com/cdisc-org/cdisc-rules-engine/blob/68017ec16192d2c931e4a97d6085fab8ec1c6c02/cdisc_rules_engine/rules_engine.py#L334-L339
- [x] #910
Refer to https://github.com/cdisc-org/cdisc-rules-engine/pull/898 - dataframe_operators.py has a new wrapper that can be used
- [x] #911
https://github.com/cdisc-org/cdisc-rules-engine/blob/68017ec16192d2c931e4a97d6085fab8ec1c6c02/cdisc_rules_engine/operations/base_operation.py#L47
- [x] #912
https://github.com/cdisc-org/cdisc-rules-engine/blob/68017ec16192d2c931e4a97d6085fab8ec1c6c02/cdisc_rules_engine/rules_engine.py#L236-L300
- [x] #913
- [x] #914
- Need to ensure that these reports do not have any data or proprietary information

- [x] #915
Test data should include:
- A set of small datasets and define-xml (Nick's certification data)
- A set containing at least one large (~1GB) dataset
- All currently published rules, given as list of rules

- [x] #916
- JSON will be the primary output
- JSON converted to Excel

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.