singer-io / singer-io/tap-github

Github Key Field for Issue_Milestones, Events, Projects_Tables are Floats (Won't work with BigQuery)

Open
#99 0 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
76
Forks
86
PR merge metrics
No merged PRs in 30d

Description

Big query cannot handle floats as key fields. Tap-github converts id's to floats due to length of the number of digits on to the key fields in the new project management tables (events, issue_milestones...). "6066309.0" for example. This needs to be converted to a string in cases like these before it could be ingested by big query.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the extraction and field-conversion logic for the issue_milestones, events, and projects tables in tap-github. Reproduce the reported value such as 6066309.0, then verify that these key fields are emitted as strings and can be ingested by BigQuery.

Written by the indexing model from the issue text.

Assessment

Tech stack
github, google-cloud, python
Domain
data-engineering, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.