Love da lo lolli

[ThedaSingh]

??

[ThedaSingh]

ltt

[vendettaa]

DAG a finite direct graph with no directed cycles. There are finitely many vertices and edges, where each edge directed from one vertex to another. It contains a sequence of vertices such that every edge is directed from earlier to later in the sequence. 

In spark there is this RDD(resilent distributed dataset) concept where each RDD is a vertex and the operation that is going tobe applied on this rdd is edge. 

Rdd is created from another rdd, so its a sequence of transformations and is represented as this DAG(directed acyclic graph).once action is perform on this rdd then this dag is submitted to a dag scheduler and this dagschedular splits the job into stages and again this stages are passed to task scheduler and this tasks are executed on the executors on several worker nodes and this worker nodes anni kalpite danni cluster antaru . Ala workout avtadi 

[vendettaa]

There is again a vertex iconcept in hive (hadoop)

naku telidu dini gurinchi , all know about spark running on hadoop

[tacobell fan]

naku endhuko question nuvve adigi answer kuda nuvvu cheppinattu undi. 

[vendettaa]

Apache Tez models data processing as a dataflow graph, with the vertices in the graph representing processing of data and edges representing movement of data between the processing. Thus user logic, that analyses and modifies the data, sits in the vertices. Edges determine the consumer of the data, how the data is transferred and the dependency between the producer and consumer vertices. This model concisely captures the logical definition of the computation. When the Tez job executes on the cluster, it expands this logical graph into a physical graph by adding parallelism at the vertices to scale to the data size being processed. Multiple tasks are created per logical vertex to perform the computation in parallel.

[MuPaGuNa]

ee vignaana pradarshanale vaddu anedi db prajaanikam............

[vendettaa]

1 minute ago, tacobell fan said:

naku endhuko question nuvve adigi answer kuda nuvvu cheppinattu undi. 

ante TS nenu okate antunava

em anumanalu ra babu

[ThedaSingh]

4 minutes ago, vendettaa said:

There is again a vertex iconcept in hive (hadoop)

naku telidu dini gurinchi , all know about spark running on hadoop

Hive lo de adigindi..

[vendettaa]

any how thanks to TS

brush up cheskuntunna ni valla , apache tez  gurinchi reading

[ThedaSingh]

2 minutes ago, tacobell fan said:

naku endhuko question nuvve adigi answer kuda nuvvu cheppinattu undi. 

 

Just now, MuPaGuNa said:

ee vignaana pradarshanale vaddu anedi db prajaanikam............

ayyo mahaprabho.. nenu meeru anukuntunna candidate kadu... 

naa gender male kavalante pm chesta 

[ThedaSingh]

8 minutes ago, vendettaa said:

DAG a finite direct graph with no directed cycles. There are finitely many vertices and edges, where each edge directed from one vertex to another. It contains a sequence of vertices such that every edge is directed from earlier to later in the sequence. 

In spark there is this RDD(resilent distributed dataset) concept where each RDD is a vertex and the operation that is going tobe applied on this rdd is edge. 

Rdd is created from another rdd, so its a sequence of transformations and is represented as this DAG(directed acyclic graph).once action is perform on this rdd then this dag is submitted to a dag scheduler and this dagschedular splits the job into stages and again this stages are passed to task scheduler and this tasks are executed on the executors on several worker nodes and this worker nodes anni kalpite danni cluster antaru . Ala workout avtadi 

aak paak annattun undi idhi.. google lo dorakatle.

i want exact definition.. dorikite veyyandi ikkada.

[tacobell fan]

Just now, vendettaa said:

ante TS nenu okate antunava

em anumanalu ra babu

ee DB lo antha Hadoop lolli evadiki ledu. Unna they know where to discuss. Sync avvatledu. Moreover chinna question ki nuvvu paragraph post chestunte inka ekkuva doubt ga undi. Just check this 

 

6 minutes ago, vendettaa said:

There is again a vertex iconcept in hive (hadoop)

naku telidu dini gurinchi , all know about spark running on hadoop

 

1 minute ago, ThedaSingh said:

Hive lo de adigindi..

 

[vendettaa]

Just now, ThedaSingh said:

Hive lo de adigindi..

usually hive query cluster lo execute chesnapdu map reduce run avtu untadi which takes more time to process

ade Tez engine property set chesi execute cheste fast ga process avtadi data 

tez lo unay e concepts

[MuPaGuNa]

chi deenamma jeevitham...

deeni self dabba thagaleyya...evadanna oka sepraasi post anna ippinchandi vaa...

ee chendalam soodalekapothunna naa love da lo di