Fails when insert a record includ an invalid XML character
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
I am trying to use pyhive to insert a record includ an invalid XML character to a hive table and it fails, but is ok when i use pyhive to query a record includ an invalid XML character
```
>>>from pyhive import hive
>>>cursor = hive.connect('localhost').cursor()
>>>cursor.execute("select * from demo where bar='\x1a'")
>>>cursor.execute("insert into demo values('bug', '\x1a')")
Traceback (most recent call last):
File "/Users/liyatao/github/PyHive/venv/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3331, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "", line 3, in
cursor.execute("insert into demo values('bug', '\x1a')")
File "/Users/liyatao/github/PyHive/pyhive/hive.py", line 368, in execute
_check_status(response)
File "/Users/liyatao/github/PyHive/pyhive/hive.py", line 518, in _check_status
raise OperationalError(response)
pyhive.exc.OperationalError: TExecuteStatementResp(status=TStatus(statusCode=3, infoMessages=['*org.apache.hive.service.cli.HiveSQLException:Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. org.xml.sax.SAXParseException; systemId: file:/tmp/hadoop-root/mapred/staging/root698919480/.staging/job_local698919480_0012/job.xml; lineNumber: 1311; columnNumber: 86; Character reference "" is an invalid XML character.:17:16', 'org.apache.hive.service.cli.operation.Operation:toSQLException:Operation.java:380', 'org.apache.hive.service.cli.operation.SQLOperation:runQuery:SQLOperation.java:257', 'org.apache.hive.service.cli.operation.SQLOperation:runInternal:SQLOperation.java:293', 'org.apache.hive.service.cli.operation.Operation:run:Operation.java:320', 'org.apache.hive.service.cli.session.HiveSessionImpl:executeStatementInternal:HiveSessionImpl.java:530', 'org.apache.hive.service.cli.session.HiveSessionImpl:executeStatement:HiveSessionImpl.java:506', 'org.apache.hive.service.cli.CLIService:executeStatement:CLIService.java:280', 'org.apache.hive.service.cli.thrift.ThriftCLIService:ExecuteStatement:ThriftCLIService.java:531', 'org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1437', 'org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement:getResult:TCLIService.java:1422', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617', 'java.lang.Thread:run:Thread.java:748', '*java.lang.RuntimeException:org.xml.sax.SAXParseException; systemId: file:/tmp/hadoop-root/mapred/staging/root698919480/.staging/job_local698919480_0012/job.xml; lineNumber: 1311; columnNumber: 86; Character reference "" is an invalid XML character.:47:31', 'org.apache.hadoop.conf.Configuration:loadResource:Configuration.java:2647', 'org.apache.hadoop.conf.Configuration:loadResources:Configuration.java:2504', 'org.apache.hadoop.conf.Configuration:getProps:Configuration.java:2407', 'org.apache.hadoop.conf.Configuration:get:Configuration.java:981', 'org.apache.hadoop.mapred.JobConf:checkAndWarnDeprecation:JobConf.java:2007', 'org.apache.hadoop.mapred.JobConf::JobConf.java:479', 'org.apache.hadoop.mapred.LocalJobRunner$Job::LocalJobRunner.java:153', 'org.apache.hadoop.mapred.LocalJobRunner:submitJob:LocalJobRunner.java:731', 'org.apache.hadoop.mapreduce.JobSubmitter:submitJobInternal:JobSubmitter.java:240', 'org.apache.hadoop.mapreduce.Job$10:run:Job.java:1290', 'org.apache.hadoop.mapreduce.Job$10:run:Job.java:1287', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:422', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1746', 'org.apache.hadoop.mapreduce.Job:submit:Job.java:1287', 'org.apache.hadoop.mapred.JobClient$1:run:JobClient.java:575', 'org.apache.hadoop.mapred.JobClient$1:run:JobClient.java:570', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:422', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1746', 'org.apache.hadoop.mapred.JobClient:submitJobInternal:JobClient.java:570', 'org.apache.hadoop.mapred.JobClient:submitJob:JobClient.java:561', 'org.apache.hadoop.hive.ql.exec.mr.ExecDriver:execute:ExecDriver.java:411', 'org.apache.hadoop.hive.ql.exec.mr.MapRedTask:execute:MapRedTask.java:151', 'org.apache.hadoop.hive.ql.exec.Task:executeTask:Task.java:199', 'org.apache.hadoop.hive.ql.exec.TaskRunner:runSequential:TaskRunner.java:100', 'org.apache.hadoop.hive.ql.Driver:launchTask:Driver.java:2183', 'org.apache.hadoop.hive.ql.Driver:execute:Driver.java:1839', 'org.apache.hadoop.hive.ql.Driver:runInternal:Driver.java:1526', 'org.apache.hadoop.hive.ql.Driver:run:Driver.java:1237', 'org.apache.hadoop.hive.ql.Driver:run:Driver.java:1232', 'org.apache.hive.service.cli.operation.SQLOperation:runQuery:SQLOperation.java:255', '*org.xml.sax.SAXParseException:Character reference "" is an invalid XML character.:51:4', 'org.apache.xerces.parsers.DOMParser:parse::-1', 'org.apache.xerces.jaxp.DocumentBuilderImpl:parse::-1', 'javax.xml.parsers.DocumentBuilder:parse:DocumentBuilder.java:150', 'org.apache.hadoop.conf.Configuration:parse:Configuration.java:2482', 'org.apache.hadoop.conf.Configuration:loadResource:Configuration.java:2551'], sqlState='08S01', errorCode=1, errorMessage='Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. org.xml.sax.SAXParseException; systemId: file:/tmp/hadoop-root/mapred/staging/root698919480/.staging/job_local698919480_0012/job.xml; lineNumber: 1311; columnNumber: 86; Character reference "" is an invalid XML character.'), operationHandle=None)
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.