MeltanoLabs / MeltanoLabs/Singer-Working-Group

Documented goals/objectives of team

Open
#18 0 comments 4 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Proposal Type::Self Governance
Dominant language
No language data
Stars
15
Forks
4
PR merge metrics
No merged PRs in 30d

Description

There are many directions we can evolve the Singer spec in.

  • Performance: Focus on a standard that makes data extraction/load tasks very high performing.
  • Versatility: Provide a standard that produces Taps that can handle many pocket cases and have lots of optional features
  • Reliability: Focus on self-healing features, error handling, reporting, observability. Features that make integrations more dependable and less likely to throw off errors.
  • Compatibility: Update the specification to stay current with the ecosystem (i.e. JSON schema updates, Python version updates)
  • Accessibility: To grow the community we need to put effort into making the specification accessible to less technically savvy users. For example, catalog.json current throws off new users. Some of this is addressed through tools/SDKs but should we evolve the standard itself to be easier to learn?

Clearly, these areas of focus will compete with each other for time and attention, and may actually require compromising between these objectives. If we can score the interest of the community in developing these aspects of Singer, we can help prioritize development efforts. One proposal would be for the leaders to force-rank these priorities to facilitate a conversation around where to focus.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the Singer specification and the catalog.json example mentioned in the issue, along with any relevant tools or SDKs. The issue does not name files or tests; done would require an agreed, community-backed prioritization of the proposed objectives and a documented direction for future specification work.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.