Jump to content

Help - Hadoop/hive admins


Recommended Posts

Posted

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

Posted

Due to some reasons indulo only MR engine and hive 1.0 version ey vaadali .. fyi..

Anduli em configs chesthe work avuthundo selava ivandi punyam untadi.. google chesthe kuda doriki saavatla

Posted
6 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

Ask admins to change # ofsessions in users profile 

Posted
8 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

Try to increase the container size bhayya....and hive server heap size increase cheyadaniki try chey...

Posted

What is the cluster size?.. May be there are no more vcores left on the Custer. Check yarn UI

Posted

Cluster 5 node .. nothings runs on the cluster.. no admins .. adi EMR cluster.

 

Posted
2 hours ago, Piscina said:

Ask admins to change # ofsessions in users profile 

Bro hive config file lo em param o telsa.. ?

Posted
13 minutes ago, WeBeliveInTigerman said:

What is the cluster size?.. May be there are no more vcores left on the Custer. Check yarn UI

Em run katle cluster paina

Posted
1 hour ago, nako_job_kavali said:

Try to increase the container size bhayya....and hive server heap size increase cheyadaniki try chey...

Im trying to run couple of small jobs .. antha resource use cheyavu.. just want to check if i can run them concurrently..

CLI lo hive commands submit chesthe concurrent run kaava

Posted
28 minutes ago, mettastar said:

Im trying to run couple of small jobs .. antha resource use cheyavu.. just want to check if i can run them concurrently..

CLI lo hive commands submit chesthe concurrent run kaava

Avuthay....kaani check if the heap size is low...heap size is mainly for the process to start or initialize....so oka query run avutundaga inko query initialize avvadaniki enuf memory ledhu....

Posted
9 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

 

9 hours ago, mettastar said:

Due to some reasons indulo only MR engine and hive 1.0 version ey vaadali .. fyi..

Anduli em configs chesthe work avuthundo selava ivandi punyam untadi.. google chesthe kuda doriki saavatla

 

config file lo idi set chesi try cheyyi  ...  hive.exec.parallel to true

 

<property>  

<name>hive.exec.parallel</name>  

<value>true</value>

<description>Whether to execute jobs in parallel</description>

</property>

 

<property>  

<name>hive.exec.parallel.thread.number</name>  

<value>8</value>

<description>How many jobs at most can be executed in parallel</description>

</property>

 

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...