kestra-io / kestra-io/plugin-jdbc
Add a Snowflake PUT task to load data from internal storage
- Dominant language
- Java
- Stars
- 24
- Forks
- 38
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 22
Description
### Issue description
Reproducible example:
```yaml
id: snowflakeTutorial
namespace: dev
tasks:
- id: createDB
type: io.kestra.plugin.jdbc.snowflake.Query
sql: CREATE OR REPLACE DATABASE KESTRA;
- id: createTable
type: io.kestra.plugin.jdbc.snowflake.Query
sql: |
CREATE OR REPLACE TABLE KESTRA.PUBLIC.EMPLOYEES (
first_name STRING ,
last_name STRING ,
email STRING ,
streetaddress STRING ,
city STRING ,
start_date DATE
);
- id: extract
type: io.kestra.plugin.fs.http.Download
uri: https://raw.githubusercontent.com/kestra-io/examples/main/datasets/employees01.csv
- id: load
type: io.kestra.plugin.jdbc.snowflake.Query
sql: put file://{{outputs.extract.uri}} @kestra.public.%employees
taskDefaults:
- type: io.kestra.plugin.jdbc.snowflake.Query
values:
url: jdbc:snowflake://accountid.snowflakecomputing.com?warehouse=DEMO
username: ANNA
password: 'password'
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the reproducible YAML example, especially the io.kestra.plugin.jdbc.snowflake.Query task using a PUT statement and the preceding io.kestra.plugin.fs.http.Download task. Identify how Snowflake tasks are organized and add the requested PUT task for loading downloaded data from internal storage; the example should work without using a generic Query task.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, sql
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100