vendetta Posted August 3, 2017 Report Posted August 3, 2017 1 hour ago, Bhai said: he is data scientist Joke bagundi 😂😂😂 Quote
yankees Posted August 4, 2017 Report Posted August 4, 2017 15 hours ago, vendetta said: Joke bagundi 😂😂😂 i did not get the answer from u Quote
kasi Posted August 4, 2017 Report Posted August 4, 2017 On 8/3/2017 at 0:09 AM, powerking said: Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me I'll be heading to Linkedin anyway.... Thanks for the response Please do let me know if anyone worked on the scenario mentioned above... Peace Out ! check your PM,,,,, Quote
kasi Posted August 4, 2017 Report Posted August 4, 2017 On 8/3/2017 at 0:09 AM, powerking said: Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me I'll be heading to Linkedin anyway.... Thanks for the response Please do let me know if anyone worked on the scenario mentioned above... Peace Out ! does you file have a header??? Quote
Bhai Posted August 4, 2017 Report Posted August 4, 2017 59 minutes ago, yankees said: i did not get the answer from u Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.