data engineers o paali itu randi

[mettastar]

1 hour ago, phoeniix said:

elastic search enduku vadutunnaru....reports kosama kibana through generate cheyadam kosam

Reporting layer ey but we dont use kibana

[meri_zindagi]

3 minutes ago, mettastar said:

Reporting layer ey but we dont use kibana

What you are using then ?

[reality]

ThoughtSpot BI chudu.. it comes with its own db... highly scalable.... and Fast.

[Spartan]

Just now, reality said:

ThoughtSpot BI chudu.. it comes with its own db... highly scalable.... and Fast.

vallak only AWS lo ve vadali.

[Spartan]

@mettastar  are u from Dallaspuram.

[phoeniix]

43 minutes ago, mettastar said:

Volume ey size lo untadi bro? And size of cluster? Query latency? Does it support ansi sql? 

Size of cluster your infrastructure team has to decide. Its a cluster based distributed dbms , highly scalable and no point of falilure. ansi sql -NO, joins -NO. But you can use  joins during spark processing and push the data to cassandra.Cassandra has datastructures as data types too. Cassandra CQL is almost similar to sql.But it doesnot have joins.

[phoeniix]

12 minutes ago, Spartan said:

vallak only AWS lo ve vadali.

He is using elastic search and it does not belong to AWS , even Thoughtspot can be considered as replacement for elastic search and Thoughspot is perfect to be a consumption layer

[reality]

26 minutes ago, Spartan said:

vallak only AWS lo ve vadali.

13 minutes ago, phoeniix said:

He is using elastic search and it does not belong to AWS , even Thoughtspot can be considered as replacement for elastic search and Thoughspot is perfect to be a consumption layer

 

[Spartan]

1 hour ago, phoeniix said:

He is using elastic search and it does not belong to AWS , even Thoughtspot can be considered as replacement for elastic search and Thoughspot is perfect to be a consumption layer

 

1 hour ago, reality said:

 

https://aws.amazon.com/elasticsearch-service/

[mettastar]

11 minutes ago, Spartan said:

 

https://aws.amazon.com/elasticsearch-service/

Yes we are using this.

[mettastar]

Aws advantage entante they are managed services .. operational head ache takkuva

[mettastar]

2 hours ago, phoeniix said:

Size of cluster your infrastructure team has to decide. Its a cluster based distributed dbms , highly scalable and no point of falilure. ansi sql -NO, joins -NO. But you can use  joins during spark processing and push the data to cassandra.Cassandra has datastructures as data types too. Cassandra CQL is almost similar to sql.But it doesnot have joins.

Infra team ledu bongu ledu .. we have to do everything. Ma dantlo konni adhoc queries type kuda untayi bro .. without joins workout kaadhu .. at least some reports need join capability 

[mettastar]

2 hours ago, Spartan said:

@mettastar  are u from Dallaspuram.

No

[mettastar]

2 hours ago, reality said:

ThoughtSpot BI chudu.. it comes with its own db... highly scalable.... and Fast.

Chustha bro

[Spartan]

2 hours ago, phoeniix said:

He is using elastic search and it does not belong to AWS , even Thoughtspot can be considered as replacement for elastic search and Thoughspot is perfect to be a consumption layer

 

3 minutes ago, mettastar said:

Yes we are using this.

 

2 minutes ago, mettastar said:

Aws advantage entante they are managed services .. operational head ache takkuva