apache / apache/seatunnel

[Bug] [SFTP] 抽取速度变为0,并且任务一直不结束

Open
#9,258 13 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 13h
Merged PRs (30d)
203

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

### What happened

Image

Image
我使用的seatunnel版本是2.3.9,json文件如上,任务跑着跑着速度就将为了0,任务一直处于运行状态,这种情况偶尔出现,不知道是什么原因导致的

### SeaTunnel Version

2.3.9

### SeaTunnel Config

```conf
{
"env" : {
"jobMode" : "BATCH",
"parallelism" : 1
},
"sink" : [
{
"data_save_mode" : "DROP_DATA",
"enable_header_write" : true,
"field_delimiter" : "\u0001",
"file_format_type" : "text",
"host" : "192.168.0.139",
"password" : "******",
"path" : "/tmp/seatunnel//iceberg_catl_test/78_TEST_BATCH_COMMON/20250430/000007/1745980859764",
"plugin_input" : "sftp_reader_output",
"plugin_name" : "SftpFile",
"port" : "22",
"tmp_path" : "/tmp/seatunnel/",
"user" : "root"
}
],
"source" : [
{
"field_delimiter" : "\u0001",
"file_format_type" : "text",
"host" : "192.168.0.159",
"password" : "******",
"path" : "/tmp/seatunnel//iceberg_catl_test/78_TEST_BATCH_COMMON/20250430/000007/1745979721170",
"plugin_name" : "SftpFile",
"plugin_output" : "sftp_reader_output",
"port" : "22",
"schema" : {
"fields" : {
"AGE" : "STRING",
"ID" : "STRING",
"NAME" : "STRING",
"SEX" : "STRING"
}
},
"skip_header_row_number" : 1,
"user" : "root"
}
],
"transform" : []
}
```

### Running Command

```shell
seatunnel --config sftp.json
```

### Error Exception

```log
没有异常信息,任务一直在运行,目前看最长的运行了20多个小时,但是从第一次出现速度为0开始,后面的速度就没有变过
```

### Zeta or Flink or Spark Version

zeta

### Java or Scala Version

_No response_

### Screenshots

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Research direction

The report names sftp.json and the `seatunnel --config sftp.json` entry point; start by reproducing the SFTPFile batch job with the shown SeaTunnel 2.3.9 and Zeta configuration. Observe the runtime state when throughput reaches zero; done means identifying why the job does not terminate and providing a verified fix or diagnostic result.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.