hive getting Hang after setting ACID property in HortonWorks

This is for Hadoop eco system like HDFS, Map reduce, Hive, Hbase, Pig, sqoop,sqoop2, Avro, solr, hcatalog, impala, Oozie, Zoo Keeper and Hadoop distribution like Cloudera, Hortonwork etc.
sachin23
Posts: 25
Joined: Sat Jan 27, 2018 4:05 am
Contact:

hive getting Hang after setting ACID property in HortonWorks

Postby sachin23 » Sat Mar 03, 2018 12:57 am

I am using HDP 2.6.1

While i set ACID property hive getting Hang, and i forced to do ctl+c

I have created a table with the following command:

hive > SET hive.support.concurrency=true; SET hive.enforce.bucketing=true; SET hive.exec.dynamic.partition.mode=nonstrict; SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.compactor.initiator.on=true; SET hive.compactor.worker.threads=1; set hive.optimize.sort.dynamic.partition=false;

hive> create table testuser (x int, y string) clustered by (x) into 2 buckets stored as ORC tblproperties ("transactional" = "true");

above query get hang after setting ACID property. I also try to set it in AMBARI and got same hive hanging problem. After removing ACID property hive works fine.


Hive CLI shell is getting hung and I have to run Ctrl + C command to get out of the shell. I am not able to understand why is this happening ?

Any help to resolve this problem will be very helpful.


ramverma
Posts: 435
Joined: Sat Aug 23, 2014 5:34 pm
Contact:

Re: hive getting Hang after setting ACID property in HortonWorks

Postby ramverma » Mon Mar 05, 2018 1:28 am

I am getting Below error while trying to insert data in ACID property table.

0: jdbc:hive2:/localhost:10000/>set hive.support.concurrency=true; set hive.enforce.bucketing=true; set hive.exec.dynamic.partition.mode=nonstrict; set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; set hive.compactor.initiator.on=true; set hive.compactor.worker.threads=1;
0: jdbc:hive2://localhost:10000/>CREATE TABLE students (name VARCHAR(64), age INT, gpa DECIMAL(3, 2)) CLUSTERED BY (age) INTO 2 BUCKETS STORED AS ORC TBLPROPERTIES ('transactional'='true');

0: jdbc:hive2://localhost:10000/> INSERT INTO TABLE students VALUES ('AA', 23, 1.28), ('BB', 32, 2.32);

Error: Error while processing statement: FAILED: Error in acquiring locks: Error communicating with the metastore (state=42000,code=10)

sachin23
Posts: 25
Joined: Sat Jan 27, 2018 4:05 am
Contact:

Re: hive getting Hang after setting ACID property in HortonWorks

Postby sachin23 » Mon Mar 05, 2018 1:33 am

set below property it will be fine.

SET hive.support.concurrency=false

ramverma
Posts: 435
Joined: Sat Aug 23, 2014 5:34 pm
Contact:

Re: hive getting Hang after setting ACID property in HortonWorks

Postby ramverma » Mon Mar 05, 2018 1:35 am

I think we should look for below property instead of setting concurrency false.

hive.lock.numretries

hive.unlock.numretries

hive.lock.sleep.between.retries



Return to “Hadoop and Big Data”

Who is online

Users browsing this forum: No registered users and 0 guests