Client daggara Spark Sahayam kavali.... urgent

[powerking]

Hi, 

Urgent ga Spark sahayam kavali client daggara unna.... stuck with some serious issues... help or refer me anyone who does this kind of stuff..

will Pay Too....

[vendetta]

1 hour ago, powerking said:

Hi, 

Urgent ga Spark sahayam kavali client daggara unna.... stuck with some serious issues... help or refer me anyone who does this kind of stuff..

will Pay Too....

Spark lo em use chestunav which tool/language 

linkedin itversity group lo Chudu man help dorkachu

ekda stuck ayyav aa query ikda veyyi it would be helpful

[Bhai]

1 minute ago, vendetta said:

Spark lo em use chestunav which tool/language 

spark lo plug using

[vendetta]

Just now, Bhai said:

spark lo plug using

Poyi pakka Kelli aduko

[Bhai]

Just now, vendetta said:

Poyi pakka Kelli aduko

sare andi

[powerking]

9 minutes ago, vendetta said:

Spark lo em use chestunav which tool/language 

linkedin itversity group lo Chudu man help dorkachu

ekda stuck ayyav aa query ikda veyyi it would be helpful

Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... 

My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... 

I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me 

I'll be heading to Linkedin anyway.... Thanks for the response 

Please do let me know if anyone worked on the scenario mentioned above...

Peace Out !

[TelugodNene]

26 minutes ago, Bhai said:

spark lo plug using

Which plug red or blue, red plug I can support 

[Bhai]

11 minutes ago, TelugodNene said:

Which plug red or blue, red plug I can support 

[vendetta]

1 hour ago, powerking said:

Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... 

My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... 

I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me 

I'll be heading to Linkedin anyway.... Thanks for the response 

Please do let me know if anyone worked on the scenario mentioned above...

Peace Out !

first create table in Hive (Managed or External ---depends on ur requirement):

Sample code:

create table tab_name(

column1 int,

column2 string....)

row format delimited fields terminated by '\t';

use the above sample code and create a table for all 100 columns.

Then,  load data from hdfs to hive by below code:

load data inpath "hdfs:///user/....." into table tab_name;

-------------------------------------------------------------------------------------

Pyspark analytics ki sample data cheppu...I will try to write query

 

[vendetta]

Note: If you use Managed table like I said in above sample code, the hdfs data will be moved from hdfs to hive. so there won't be any data in hdfs after u move to hive. Anyways check according to your requirements. I would suggest you to use external table like below. 

Sample code:

create external table tab_name(

column1 int,

column2 string....)

row format delimited fields terminated by '\t'

LOCATION /user/...... ;

 

 

 

[TelugodNene]

10 hours ago, Bhai said:

 

 

[vendetta]

@powerking dorkinda support?

[yankees]

9 minutes ago, vendetta said:

@powerking dorkinda support?

U WORK IN BIG DATA (HADOOP)

[Bhai]

30 minutes ago, yankees said:

U WORK IN BIG DATA (HADOOP)

he is data scientist

[yankees]

15 minutes ago, Bhai said:

he is data scientist

i thought it is shee