gvegayon / gvegayon/parallel

parallel append: suppress generation of "dta_source" variable

Open
#116 1 comment 0 reactions 0 assignees View on GitHub
enhancement question
Dominant language
Stata
Stars
134
Forks
27
Avg merge
39m
Merged PRs (30d)
1

Description

Hello! Is there a way to suppress the generation of "dta_source" during a run of parallel append? This would be a useful feature when parallel is being used under memory constraints: "dta_source", because it is a file path and file name, is an arbitrarily long string. It can easily double the file size.

Thanks for all your work on the package!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the parallel append implementation and the code that creates the dta_source variable. Determine how generation can be suppressed without changing the append result or parallel execution, then verify that a run with the option leaves dta_source absent and avoids storing the file path.

Written by the indexing model from the issue text.

Assessment

Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.