AdobeDocs / AdobeDocs/experience-platform.en

Dataflow - "Load incremental data by" unclear description

Open
#229 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
11
Forks
148
PR merge metrics
No merged PRs in 30d

Description

Within [Create a dataflow using a database source in the UI](https://github.com/AdobeDocs/experience-platform.en/blob/main/help/sources/tutorials/ui/dataflow/databases.md) page it states:

`An option with a filtered set of source schema fields of type, date, or time. The field that you select for [!UICONTROL Load incremental data by] must have its date-time values in UTC timezone in order to correctly load incremental data. All table-based batch sources pick incremental data by comparing a delta column time stamp value to the corresponding flow run window UTC time, and then copying the data from the source, if any new data is found within the UTC time window.`

It is unclear what `comparing a delta column time stamp value to the corresponding flow run window UTC time`, does this mean that the delta column timestamp much match the flow run window UTC time or just that the date must be after the last time the flow was run?

Can this document be updated to help clarify this point?

Contributor guide

Open the contributing guide

Research direction

Open help/sources/tutorials/ui/dataflow/databases.md and locate the “Load incremental data by” description quoted in the issue. Clarify what comparing the delta column timestamp with the flow run window means, including whether values must match the window or only follow the previous run. Done when the documentation answers that distinction directly.

Written by the indexing model from the issue text.

Assessment

Domain
documentation
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.