airbytehq / airbytehq/airbyte

Adding official connector as custom connector not working

未关闭
#69,351 3 条评论 3 个 reaction 已指派 0 人 在 GitHub 查看
ai-assist area/connector-builder autoteam community needs-triage team/use type/bug
主要语言
Python
星标
22.1k
派生
5.3k
PR 合并指标
PR 指标待抓取

描述

### Connector Documentation URL

https://docs.airbyte.com/integrations/custom-connectors

### What error are you seeing?

`Caused by: java.lang.NullPointerException`

Full error stack trace:
```
2025-11-17 12:36:29 destination ERROR main i.a.c.AirbyteConnectorRunnable(run):38 Failed connector operation initialization. io.airbyte.cdk.ConfigErrorException: Failed to initialize connector operation
at io.airbyte.cdk.AirbyteConnectorRunnable.run(AirbyteConnectorRunnable.kt:33) [io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-base-0.1.35.jar:?]
at picocli.CommandLine.executeUserObject(CommandLine.java:2030) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine.access$1500(CommandLine.java:148) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2465) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine$RunLast.handle(CommandLine.java:2457) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine$RunLast.handle(CommandLine.java:2419) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2277) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine$RunLast.execute(CommandLine.java:2421) [picocli-4.7.6.jar:4.7.6]
at picocli.CommandLine.execute(CommandLine.java:2174) [picocli-4.7.6.jar:4.7.6]
at io.airbyte.cdk.AirbyteDestinationRunner$Companion.run(AirbyteConnectorRunner.kt:289) [io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-base-0.1.35.jar:?]
at io.airbyte.cdk.AirbyteDestinationRunner$Companion.run$default(AirbyteConnectorRunner.kt:75) [io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-base-0.1.35.jar:?]
at io.airbyte.integrations.destination.mssql.v2.MSSQLDestination.main(MSSQLDestination.kt:12) [io.airbyte.airbyte-integrations.connectors-destination-fabric.jar:?]
Caused by: io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type [io.airbyte.cdk.load.message.DestinationMessageFactory]

Path Taken: new WriteOperation(DestinationTaskLauncher taskLauncher,SyncManager syncManager,WriteOpOverride writeOpOverride) --> new WriteOperation([DestinationTaskLauncher taskLauncher],SyncManager syncManager,WriteOpOverride writeOpOverride) --> new DestinationTaskLauncher(TaskScopeProvider taskScopeProvider,DestinationCatalog catalog,DestinationConfiguration config,SyncManager syncManager,[InputConsumerTask inputConsumerTask],HeartbeatTask heartbeatTask,UpdateBatchStateTaskFactory updateBatchTask,StatsEmitter statsEmitter,SetupTaskFactory setupTaskFactory,OpenStreamTask openStreamTask,CloseStreamTaskFactory closeStreamTaskFactory,TeardownTaskFactory teardownTaskFactory,LoadPipeline loadPipeline,UpdateCheckpointsTask updateCheckpointsTask,FailStreamTaskFactory failStreamTaskFactory,FailSyncTaskFactory failSyncTaskFactory,MessageQueue openStreamQueue,AtomicBoolean hasThrown) --> DataChannelBeanFactory.stdioInputConsumerTask([ReservingDeserializingInputFlow inputFlow],PartitionedQueue T> pipelineInputQueue,InputPartitioner partitioner,PipelineEventBookkeepingRouter pipelineEventBookkeepingRouter) --> new ReservingDeserializingInputFlow(DestinationConfiguration config,[ProtocolMessageDeserializer deserializer],ReservationManager memoryManager,InputStream inputStream,long logPerNRecords) --> new ProtocolMessageDeserializer([DestinationMessageFactory destinationMessageFactory]) --> new DestinationMessageFactory([DestinationCatalog catalog],boolean fileTransferEnabled,boolean requireCheckpointIdOnRecordAndKeyOnState,NamespaceMapper namespaceMapper,UUIDGenerator uuidGenerator)
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2349) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.message.$DestinationMessageFactory$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.message.$ProtocolMessageDeserializer$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.task.internal.$ReservingDeserializingInputFlow$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.config.$DataChannelBeanFactory$StdioInputConsumerTask12$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findBean(DefaultBeanContext.java:1808) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.findBean(AbstractBeanResolutionContext.java:112) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2186) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.task.$DestinationTaskLauncher$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.load.write.$WriteOperation$Definition.instantiate(Unknown Source) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2334) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2304) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2316) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3127) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3029) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2990) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2756) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1745) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.micronaut.inject.provider.JakartaProviderBeanDefinition.lambda$buildProvider$0(JakartaProviderBeanDefinition.java:65) ~[micronaut-inject-4.7.12.jar:4.7.12]
at io.airbyte.cdk.AirbyteConnectorRunnable.run(AirbyteConnectorRunnable.kt:31) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-base-0.1.35.jar:?]
... 11 more
Caused by: java.lang.NullPointerException
at io.airbyte.cdk.load.command.DestinationStreamFactory.make(DestinationStream.kt:202) ~[io.airbyte.airbyte-cdk.bulk.core-bulk-cdk-core-load-0.1.35.jar:?]
at io.airbyte.cdk.load.command.Def…
Stack Trace: io.airbyte.cdk.ConfigErrorException: Failed to initialize connector operation
at io.airbyte.cdk.AirbyteConnectorRunnable.run(AirbyteConnectorRunnable.kt:33)
at picocli.CommandLine.executeUserObject(CommandLine.java:2030)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2465)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2457)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2419)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2277)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2421)
at picocli.CommandLine.execute(CommandLine.java:2174)
at io.airbyte.cdk.AirbyteDestinationRunner$Companion.run(AirbyteConnectorRunner.kt:289)
at io.airbyte.cdk.AirbyteDestinationRunner$Companion.run$default(AirbyteConnectorRunner.kt:75)
at io.airbyte.integrations.destination.mssql.v2.MSSQLDestination.main(MSSQLDestination.kt:12)
Caused by: io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type [io.airbyte.cdk.load.message.DestinationMessageFactory]
```

### How to replicate

1. Airbytes UI portal (airbytes version: `1.8.2`)
2. Settings > Destinations > New connector
3. image: `airbyte/destination-mssql` version: `2.2.13`
4. Create new destination > Test Connection will pass
5. While running a sync (connection) job it will throw NPE error

### What do you expect to happen?

Upon investigation, the issue is [stream.syncId](https://github.com/airbytehq/airbyte/issues) being null, and when i printed [catalog](https://github.com/airbytehq/airbyte/blob/master/airbyte-cdk/bulk/core/load/src/main/kotlin/io/airbyte/cdk/load/command/DestinationCatalog.kt#L132) variable

```
ConfiguredAirbyteCatalog: io.airbyte.protocol.models.v0.ConfiguredAirbyteCatalog@5f6b53ed[streams=[io.airbyte.protocol.models.v0.ConfiguredAirbyteStream@20cdb152[stream=io.airbyte.protocol.models.v0.AirbyteStream@4cffd3fd[name=ll_std,jsonSchema={"type":"object","$schema":"http://json-schema.org/schema#","properties":{"id":{"type":"string"},"age":{"type":"number"},"name":{"type":"string"}},"additionalProperties":true},supportedSyncModes=[full_refresh],sourceDefinedCursor=false,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,isResumable=,isFileBased=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,destinationObjectName=,primaryKey=[],generationId=,minimumGenerationId=,syncId=,includeFiles=false,additionalProperties={}]],additionalProperties={}]
```

If i run sync job with official connector then it's works fine, so it should work find as custom connector as well, that's my understanding and expectation.

Q: Why i'm using official connector as custom connector ?
A: my end goal is not to use official connector as custom connector but want to modify exciting connector and produce new connector, which i tried and got same error and when i narrow down the issue it wasn't changes i did or the way i produce connector image but it was more of how airbytes custom connector integration works, so current issue is narrow down issue.

### Is this in the Alpha Release?

- [ ] Yes, the issue is in the AI Assist Alpha Release.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。