alibaba / alibaba/otter

国内时一些delete操作会报错 pool error Timeout waiting for idle object

Open
#830 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
8.1k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

白天稳定运行,晚上0点14分开始报错,请问如何解决?
```
Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error Timeout waiting for idle object
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80)

2019-09-12 07:38:23.261 [DubboServerHandler-127.0.0.1:2380-thread-50] WARN com.alibaba.otter.node.etl.load.LoadTask - WARN ## Task future processId[460759] canceled
```

因每天夜里0点10分会清理数据库中7天访问日志sql如下
```sql
delete from `logs_house_hits_hot` where created_at < '2019-09-03'
```
然后在node row_select会持续出现
```sql
delete from `logs_house_hits_hot` where `id` = ?
- PairId: 3 , TableId: 12 , EventType : D , Time : 1568218204000
- Consistency : , Mode :
```
Channel配置如下
![image](https://user-images.githubusercontent.com/10531946/64748911-527f1d00-d546-11e9-9d21-80300560c0af.png)
Pipeline配置如下
![image](https://user-images.githubusercontent.com/10531946/64749047-c3bed000-d546-11e9-8cab-374a544bd5a6.png)
![image](https://user-images.githubusercontent.com/10531946/64749062-d0dbbf00-d546-11e9-91a0-a5bb0b3ee17a.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the reported Spring JDBC/DBCP stack trace, the scheduled SQL cleanup, and the node row_select delete events; review the Channel and Pipeline configurations shown in the issue. Done means identifying why the pool times out during nightly log deletion and documenting a verified fix or configuration change.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spring, sql
Domain
backend, database, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.