UDF Failed in PyHive
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
Try to run the SQL like this:
(task1.py existed , the SQL ran without issue by hive client)
```sql
add file ./etl/path1/task1.py;
....
from (select transform(m.*)
using 'python task1.py'
as (user_id,
.....
```
It failed:
```java
Exception:TExecuteStatementResp(status=TStatus(errorCode=1,
errorMessage=u'Error while processing statement: null',
sqlState=None,
infoMessages=[u'*org.apache.hive.service.cli.HiveSQLException:Error while processing statement: null:16:15',
u'org.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:324',
u'org.apache.hive.service.cli.operation.HiveCommandOperation:runInternal:HiveCommandOperation.java:108',
u'org.apache.hive.service.cli.operation.Operation:run:Operation.java:264',
u'org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:479',
u'org.apache.hive.service.cli.session.HiveSessionImpl:executeStatement:HiveSessionImpl.java:454',
u'org.apache.hive.service.cli.CLIService:executeStatement:CLIService.java:285',
u'org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:510',
u'org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1377',
u'org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1362',
u'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39',
u'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39',
u'org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:562',
u'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286',
u'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142',
u'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617',
u'java.lang.Thread:run:Thread.java:745'],
statusCode=3),
operationHandle=None)
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.