kestra-io / kestra-io/plugin-jdbc

Add a Snowflake PUT task to load data from internal storage

Open
#138 5 comments 0 reactions 0 assignees View on GitHub
area/plugin good first issue
Dominant language
Java
Stars
24
Forks
38
Avg merge
2d 3h
Merged PRs (30d)
22

Description

### Issue description

Reproducible example:

```yaml
id: snowflakeTutorial
namespace: dev

tasks:
- id: createDB
type: io.kestra.plugin.jdbc.snowflake.Query
sql: CREATE OR REPLACE DATABASE KESTRA;

- id: createTable
type: io.kestra.plugin.jdbc.snowflake.Query
sql: |
CREATE OR REPLACE TABLE KESTRA.PUBLIC.EMPLOYEES (
first_name STRING ,
last_name STRING ,
email STRING ,
streetaddress STRING ,
city STRING ,
start_date DATE
);

- id: extract
type: io.kestra.plugin.fs.http.Download
uri: https://raw.githubusercontent.com/kestra-io/examples/main/datasets/employees01.csv

- id: load
type: io.kestra.plugin.jdbc.snowflake.Query
sql: put file://{{outputs.extract.uri}} @kestra.public.%employees

taskDefaults:
- type: io.kestra.plugin.jdbc.snowflake.Query
values:
url: jdbc:snowflake://accountid.snowflakecomputing.com?warehouse=DEMO
username: ANNA
password: 'password'
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the reproducible YAML example, especially the io.kestra.plugin.jdbc.snowflake.Query task using a PUT statement and the preceding io.kestra.plugin.fs.http.Download task. Identify how Snowflake tasks are organized and add the requested PUT task for loading downloaded data from internal storage; the example should work without using a generic Query task.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, sql
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.