source-hubspot: `marketing_emails.testing.isAbVariation` and `owners.teams[].primary` are returned by the API but absent from the schemas, so V2 destinations drop them silently
- 主要語言
- Python
- 星號
- 22.1k
- 分支
- 5.4k
- 平均合併
- 5 小時
- 30 天內合併 PR
- 671
描述
### Connector Name
source-hubspot
### Connector Version
6.7.0
### What step the error happened?
During the sync
### Relevant information
Two properties are returned by the HubSpot API but not declared in the stream schemas:
| Stream | Property | Endpoint |
|---|---|---|
| `marketing_emails` | `testing.isAbVariation` | `/marketing/v3/emails` |
| `owners` | `teams[].primary` | Owners API |
This used to be harmless. The older S3/GCS Avro writers collected undeclared properties into an `_airbyte_additional_properties` catch-all, so the values still reached the warehouse.
That is no longer true on V2 destinations. Per the [S3 migration guide](https://docs.airbyte.com/integrations/destinations/s3-migrations), which made the file destinations "isomorphic to our V2 certified database destinations", "undocumented fields in object with schemas are silently dropped" and "`_airbyte_additional_properties` is dropped entirely". Nothing signals it either — "dropped fields will not appear in `_airbyte_meta.changes[]`".
So on any V2 destination both values disappear without a trace, and the only clue is a column that quietly stops being populated.
Observed on a production connection:
- `testing.isAbVariation` was present on 787 of 6 745 `marketing_emails` records before the destination upgrade, and on 0 after.
- `teams[].primary` sits in the `owners` catch-all; `teams[]` declares only `id`, `name` and `membership`.
The same migration guide notes that a schemaless object "usually indicates an upstream source is failing to report its schema properly", which is exactly the situation here: the fix belongs in the source schema.
### Relevant log output
_No response_
### Contribute
- [x] Yes, I want to contribute
Fixed by #82769.
---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/13166
貢獻指南
研究方向
Locate the source-hubspot schema definitions for the marketing_emails and owners streams, starting with the fields returned by /marketing/v3/emails and the Owners API. Confirm that testing.isAbVariation and teams[].primary are declared and that schema or connector checks preserve them for V2 destinations; the issue notes that this work was fixed by #82769.
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- python
- 領域
- api, data-engineering
- Issue 類型
- 缺陷
- 難度
- 2/5
- 預估耗時
- 1-3 小時
- 活躍度
- 停滯
- 描述清晰度
- 描述清楚
- 新手友好度
- 25/100