Menu
support@authoritypapers.com
+1(805) 568 7317

why is my hive experiencing syntax errors here 39 s the syntax errors hive gt select 5151886

Why is my Hive experiencing syntax errors

here's the syntax errors:

hive> SELECT TRANSFORM (p_partkey, p_name, p_mfgr, p_category, p_brand1, p_color, p_type, p_size, p_container) USING 'colSwitcher.py' AS (p_name, p_partkey, p_category, p_mfgr, p_color, p_brand1, p_size, p_type, p_container) FROM part;

WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or us ing Hive 1.X releases.
Query ID = ec2-user_20190616164624_9d0bfb7f-5a2d-444f-9740-11ab29df98eb
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1560702655443_0001, Tracking URL = http://ip-172-31-19-46.us- east-2.compute.internal:8088/proxy/application_1560702655443_0001/
Kill Command = /home/ec2-user/hadoop-2.6.4/bin/hadoop job -kill job_15607026554 43_0001
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2019-06-16 16:46:31,901 Stage-1 map = 0%, reduce = 0%
2019-06-16 16:46:50,695 Stage-1 map = 100%, reduce = 0%
Ended Job = job_1560702655443_0001 with errors
Error during job, obtaining debugging information…
Examining task ID: task_1560702655443_0001_m_000000 (and more) from job job_1560 702655443_0001

Task with the most failures(4):
—–
Task ID:
task_1560702655443_0001_m_000000

URL:
http://ip-172-31-19-46.us-east-2.compute.internal:8088/taskdetails.jsp?jobid=j ob_1560702655443_0001&tipid=task_1560702655443_0001_m_000000
—–
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveExcept ion: Hive Runtime Error while processing row {“p_partkey”:299,”p_name”:”salmon d im”,”p_mfgr”:”MFGR#4″,”p_category”:”MFGR#42″,”p_brand1″:”MFGR#425″,”p_color”:”ch artreuse”,”p_type”:”STANDARD ANODIZED COPPER”,”p_size”:26,”p_container”:”WRAP PK G”}
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:168)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma tion.java:1656)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {“p_partkey”:299,”p_name”:”salmon dim”,”p_mfgr”:”MFGR#4″,”p _category”:”MFGR#42″,”p_brand1″:”MFGR#425″,”p_color”:”chartreuse”,”p_type”:”STAN DARD ANODIZED COPPER”,”p_size”:26,”p_container”:”WRAP PKG”}
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:5 74)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:159)
… 8 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: [Error 20001]: An e rror occurred while reading or writing to your custom script. It may have crashe d with an error.
at org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator. java:483)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator. java:97)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOpe rator.java:128)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperat or.java:170)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:5 64)
… 9 more
Caused by: java.io.IOException: Stream closed
at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:4 33)
at java.io.OutputStream.write(OutputStream.java:116)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82 )
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82 )
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at java.io.DataOutputStream.write(DataOutputStream.java:107)
at org.apache.hadoop.hive.ql.exec.TextRecordWriter.write(TextRecordWrite r.java:53)
at org.apache.hadoop.hive.ql.exec.ScriptOperator.process(ScriptOperator. java:452)
… 15 more

FAILED: Execution Error, return code 20001 from org.apache.hadoop.hive.ql.exec.m r.MapRedTask. An error occurred while reading or writing to your custom script. It may have crashed with an error.
MapReduce Jobs Launched:
Stage-Stage-1: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec

"Order a similar paper and get 15% discount on your first order with us
Use the following coupon
"GET15"

Order Now