Health checks on spark jar

[MuPaGuNa]

[vendettaa]

2 hours ago, Kalam_Youtheman said:

odiniyaavaaa .    u know what jmeter is used for ?  its purely for load testing

 

basics telskoni ask questions baaalu

load testing spark application mida kuda chestaru , might not be jmeter but yes untay

 

@Kalam_Youtheman  sarvagyani  refer below link

https://community.hortonworks.com/articles/138300/spark-loadperformance-testing-using-gatling-part-i.html

[vendettaa]

2 hours ago, Kalam_Youtheman said:

basic illlaaa balayya ki 

avnu mari bavilo kappalu ila balayya illa ani comments cheydam tappa em vachu

[vendettaa]

1 hour ago, WeBeliveInTigerman said:

Use JVM profiler n Spark Metrics..spark metrics give more than info for spark apps

Thank you man finally one sensible reply

[soodhilodaaram]

8 hours ago, vendettaa said:

Is there any tool like jmeter to do health checks on spark jar

manishi health ke dikku ledu.. jar file ki eeda untadi..

[vendettaa]

@tacobell fan @Kalam_Youtheman uncles

https://www.supergloo.com/fieldnotes/apache-spark-thrift-server-load-testing-example/

 

exactly this is what am looking but inkemaina tools unte suggest chestarani but ikda mahanubhavulu topic ni divert chesi navvukuntunaru

APACHE SPARK THRIFT SERVER LOAD TESTING EXAMPLE OVERVIEW

How do simulate anticipated load on our Apache Spark Thrift Server?  In this post, we are going to use an open source tool called Gatling.  Check out the References section at the bottom of this post for links to Gatling.

 

At a high level, this Spark Thrift with Gatling tutorial will run through all the following steps:

 

1. Confirm our environment (Spark, Cassandra, Thrift Server)
2. Compile our Gatling based load testing code
3. Run a sample Spark Thrift load test

[Kalam_Youtheman]

11 hours ago, WeBeliveInTigerman said:

Use JVM profiler n Spark Metrics..spark metrics give more than info for spark apps

jmeter laaanti tool kavalanta.. ROFL..

time bokka

[mettastar]

Hey vendetta.. i dont know answer to your question but .. spark standalone ante interesting ga undi .. can you explain your use case ? Why preferred only spark .. without resource manager and distributed storage? Any advantages stand alone tho?

[tacobell fan]

Health check ki Load Test ki difference ledu ani argue chestunnav. Good luck. 

[Mitron]

are you ok?

[Aakupaccha_caradu]

[vendettaa]

7 hours ago, mettastar said:

Hey vendetta.. i dont know answer to your question but .. spark standalone ante interesting ga undi .. can you explain your use case ? Why preferred only spark .. without resource manager and distributed storage? Any advantages stand alone tho?

spark 2.4.0 ->structured  streaming application ki ,prastutaniki poc's nadustunay

built pipeline between kafka spark stttreaming caassandra , alage batch too 

present standalone ,  then shifting to Kubernetes anta dockers containers mayam

 

[vendettaa]

7 hours ago, Kalam_Youtheman said:

jmeter laaanti tool kavalanta.. ROFL..

time bokka

jmeter lantide kavali but for scala

[AdaviRamudu]

2 minutes ago, vendettaa said:

jmeter lantide kavali but for scala

Bangaram vachesindhi.......

[vendettaa]

Looking to schedule jobs that run on spark scheduler .Oozie is not better option so what are best options to schedule jobs?

Dont say cron jobs