Jump to content

Chat thread


vendettaa

Recommended Posts

1 minute ago, vendettaa said:

Data engineering -> Hadoop, spark, kafka, cassandra briefly

Okasari mee ofc lo data flow ela untundo cheppava? Raw data ekkada nunchu vastundi? Hive or Sql ? ETL tools endi? Mapreduce ela vadatharu etc..just curious. Also, may I know what kind of client is urs? I mean telecom or retail etc?

  • Like 1
Link to comment
Share on other sites

5 minutes ago, LastManStanding said:

Okasari mee ofc lo data flow ela untundo cheppava? Raw data ekkada nunchu vastundi? Hive or Sql ? ETL tools endi? Mapreduce ela vadatharu etc..just curious. Also, may I know what kind of client is urs? I mean telecom or retail etc?

streaming and batch untay , streaming is live data coming from kafka , kafka topic(dbs too) -> spark streaming(saving to hive too) -> cassandra -> saving to hive 

  • Upvote 1
Link to comment
Share on other sites

2 minutes ago, vendettaa said:

streaming and batch untay , streaming is live data coming from kafka , kafka topic(dbs too) -> spark streaming(saving to hive too) -> cassandra -> saving to hive 

apart from all, ee tech matters lo quick rply isthav, #4H#

Link to comment
Share on other sites

2 minutes ago, vendettaa said:

streaming and batch untay , streaming is live data coming from kafka , kafka topic(dbs too) -> spark streaming(saving to hive too) -> cassandra -> saving to hive 

Cool, thanks. Hive nunchi DS data tiskoni process aina data ni back hive lo pedathara ? Deployment ki em vadatharu? Git and Jira ye na ? 

Link to comment
Share on other sites

8 minutes ago, jefferson1 said:

Monna vere annav diff thread lo 

btw...summer plans enti..anything new 

data engineer role chestunna present , building pipelines and datasciences kuda chestanu( anta oka project lone )

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...