Jump to content

AWS knowledge unnavalli or experts come here.. small question


Doravaru

Recommended Posts

  • Replies 46
  • Created
  • Last Reply

Top Posters In This Topic

  • Selfgoal

    10

  • mettastar

    9

  • Doravaru

    7

  • Quickgun_murugan

    6

6 hours ago, budamkayabalraj said:

 

Leader node/ Worker node concept gurinch konni lines cheppava ?

 

Heard that, all the data is stored in worker nodes and all external processes will be connecting to leader node.

Inkemina points unte cheppu bhayya...

 

@mettastar

Link to comment
Share on other sites

9 hours ago, budamkayabalraj said:

 

Leader node/ Worker node concept gurinch konni lines cheppava ?

 

Heard that, all the data is stored in worker nodes and all external processes will be connecting to leader node.

Inkemina points unte cheppu bhayya...

 

Idea ledu bro intha depth architecture .. nenu kuda chadavali .. recently started uzing

Link to comment
Share on other sites

10 hours ago, budamkayabalraj said:

 

Leader node/ Worker node concept gurinch konni lines cheppava ?

 

Heard that, all the data is stored in worker nodes and all external processes will be connecting to leader node.

Inkemina points unte cheppu bhayya...

 

Do you mean Leader Node andCompute Nodes bro ? 

Link to comment
Share on other sites

@budamkayabalraj

Hope this helps - 

The leader node manages communications with client programs and all communication with compute nodes. It parses and develops execution plans to carry out database operations, in particular, the series of steps necessary to obtain results for complex queries.

The leader node compiles code for individual elements of the execution plan and assigns the code to individual compute nodes. The compute nodes execute the compiled code and send intermediate results back to the leader node for final aggregation.

Core component of Redshit is Cluster, A cluster is composed of one or more compute nodes. If a cluster is provisioned with two or more compute nodes, an additional leader node coordinates the compute nodes and handles external communication

 

 

@iPhoneX

Link to comment
Share on other sites

14 hours ago, mettastar said:

Queries super fast run avuthayi compared to spark/hive as long as you distribute and sort the data right... billions of records meda kuda sub second or seconds lo run avuthayi queries.. 

Scalable 

Disadvantage is it only supports upto 20 concurrent sessions at a time anukunta.. 

Advantage.. u can store data on s3 and use redshift spectrum to create external tables and query the data with similar performance.. 

Inka emanna gurthosthey estha

Itta okka 10-12 lines rasi pm cheyi baa data side anni topics meda... next week interview undi

Link to comment
Share on other sites

4 minutes ago, k2s said:

Itta okka 10-12 lines rasi pm cheyi baa data side anni topics meda... next week interview undi

Satya tho godava aindha endi..

Link to comment
Share on other sites

5 hours ago, Selfgoal said:

@budamkayabalraj

Hope this helps - 

The leader node manages communications with client programs and all communication with compute nodes. It parses and develops execution plans to carry out database operations, in particular, the series of steps necessary to obtain results for complex queries.

The leader node compiles code for individual elements of the execution plan and assigns the code to individual compute nodes. The compute nodes execute the compiled code and send intermediate results back to the leader node for final aggregation.

Core component of Redshit is Cluster, A cluster is composed of one or more compute nodes. If a cluster is provisioned with two or more compute nodes, an additional leader node coordinates the compute nodes and handles external communication

 

 

@iPhoneX

thanks vaa

Link to comment
Share on other sites

5 hours ago, k2s said:

Itta okka 10-12 lines rasi pm cheyi baa data side anni topics meda... next week interview undi

Neeku interview evadu conduct chestunnadu..? Nuvvey hiring manager kada? Papam young opt lanu hiring couch perutho vadukuntunnavani monna Seattle Times lo esaru 

Link to comment
Share on other sites

9 hours ago, k2s said:

Itta okka 10-12 lines rasi pm cheyi baa data side anni topics meda... next week interview undi

Relocate aithava thata? Ma Team lo Position undi 

Link to comment
Share on other sites

22 hours ago, Doravaru said:

can you elaborate on this one bro? looks like this is pretty much similar we are trying to implement...

antey business process ni konchem cheppu em exact ga chestaro meeru? and why?

 

@Muzic 

 

We got many projects with different architectures... in most of them we use Redshift for the final result to store. Redshift is easy to manage which can scale-up as per requirement storage. Clients will connect with different BI tools like Qlickview/Tableau/Aginity for querying.. 

Need requirement chepthe if any thing fit ante can suggest.. 

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...