airbytehq / airbytehq/airbyte

source-hubspot: `marketing_emails.testing.isAbVariation` and `owners.teams[].primary` are returned by the API but absent from the schemas, so V2 destinations drop them silently

已關閉
#82,771 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
autoteam community connectors/source/hubspot hyd-prove hyd-review team/use
主要語言
Python
星號
22.1k
分支
5.4k
平均合併
5 小時
30 天內合併 PR
671

描述

### Connector Name

source-hubspot

### Connector Version

6.7.0

### What step the error happened?

During the sync

### Relevant information

Two properties are returned by the HubSpot API but not declared in the stream schemas:

| Stream | Property | Endpoint |
|---|---|---|
| `marketing_emails` | `testing.isAbVariation` | `/marketing/v3/emails` |
| `owners` | `teams[].primary` | Owners API |

This used to be harmless. The older S3/GCS Avro writers collected undeclared properties into an `_airbyte_additional_properties` catch-all, so the values still reached the warehouse.

That is no longer true on V2 destinations. Per the [S3 migration guide](https://docs.airbyte.com/integrations/destinations/s3-migrations), which made the file destinations "isomorphic to our V2 certified database destinations", "undocumented fields in object with schemas are silently dropped" and "`_airbyte_additional_properties` is dropped entirely". Nothing signals it either — "dropped fields will not appear in `_airbyte_meta.changes[]`".

So on any V2 destination both values disappear without a trace, and the only clue is a column that quietly stops being populated.

Observed on a production connection:

- `testing.isAbVariation` was present on 787 of 6 745 `marketing_emails` records before the destination upgrade, and on 0 after.
- `teams[].primary` sits in the `owners` catch-all; `teams[]` declares only `id`, `name` and `membership`.

The same migration guide notes that a schemaless object "usually indicates an upstream source is failing to report its schema properly", which is exactly the situation here: the fix belongs in the source schema.

### Relevant log output

_No response_

### Contribute

- [x] Yes, I want to contribute

Fixed by #82769.

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/13166

貢獻指南

開啟貢獻指南

研究方向

Locate the source-hubspot schema definitions for the marketing_emails and owners streams, starting with the fields returned by /marketing/v3/emails and the Owners API. Confirm that testing.isAbVariation and teams[].primary are declared and that schema or connector checks preserve them for V2 destinations; the issue notes that this work was fixed by #82769.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
python
領域
api, data-engineering
Issue 類型
缺陷
難度
2/5
預估耗時
1-3 小時
活躍度
停滯
描述清晰度
描述清楚
新手友好度
25/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。