Health checks on spark jar

[vendettaa]

Is there any tool like jmeter to do health checks on spark jar

[tacobell fan]

If the application is part of hadoop Cluster where Yarn is enabled you should be checking all these as part of it kada. No?

[vendettaa]

22 minutes ago, tacobell fan said:

If the application is part of hadoop Cluster where Yarn is enabled you should be checking all these as part of it kada. No?

Its not hadoop cluster

Its Spark Standalone cluster

[tacobell fan]

30 minutes ago, vendettaa said:

Its not hadoop cluster

Its Spark Standalone cluster

Where did you install Spark? Not in Hadoop cluster? Hadoop meed you can install any auto-scaling applications like Spark, H20, Hive, etc... how are you controlling & allocate the resources without it? 

[vendettaa]

3 minutes ago, tacobell fan said:

Where did you install Spark? Not in Hadoop cluster? Hadoop meed you can install any auto-scaling applications like Spark, H20, Hive, etc... how are you controlling & allocate the resources without it? 

Lol spark doesn’t need Hadoop 

cheppaga spark standalone cluster

jar is running on standalone cluster 

standalone mode prastutaniki

 

[tacobell fan]

2 minutes ago, vendettaa said:

Lol spark doesn’t need Hadoop 

cheppaga spark standalone cluster

jar is running on standalone cluster 

I'm not saying it need Hadoop but it typically installs on Big Data clusters so that you can get the standard monitoring tools as part of it. Standalone lo spark ki intha hadavudi endhuku. Just install standard tools. Mee org wide server health montior tool untadhi ask your system admins. Like perceiver 

[vendettaa]

57 minutes ago, tacobell fan said:

If the application is part of hadoop Cluster where Yarn is enabled you should be checking all these as part of it kada. No?

health check annanu , code chesettu  undali not monitoring through UI

[vendettaa]

1 minute ago, tacobell fan said:

I'm not saying it need Hadoop but it typically installs on Big Data clusters so that you can get the standard monitoring tools as part of it. Standalone lo spark ki intha hadavudi endhuku. Just install standard tools. Mee org wide server health montior tool untadhi ask your system admins. Like perceiver 

I am looking for something like jmeter not monitoring tools , meme suggest cheyali ipdu , anni pocs avtunay

[panipoori]

8 minutes ago, vendettaa said:

I am looking for something like jmeter not monitoring tools , meme suggest cheyali ipdu , anni pocs avtunay

aunty billing rate enta cheppaedu inka spark ki

[vendettaa]

6 minutes ago, panipoori said:

aunty billing rate enta cheppaedu inka spark ki

uncle tamaru spamming apandi ikda

[panipoori]

13 minutes ago, vendettaa said:

uncle tamaru spamming apandi ikda

M serious ehe not spammming trying to shift

[tacobell fan]

27 minutes ago, vendettaa said:

I am looking for something like jmeter not monitoring tools , meme suggest cheyali ipdu , anni pocs avtunay

Application health not only just rely on the specific app. You know it need to rely on system resources, so vmstat, iostat, cpu, memory plays vital role. If the application shares with another java apps they may consume resources. You can always run the script in nohup and collect the stats. 

[panipoori]

3 minutes ago, tacobell fan said:

Application health not only just rely on the specific app. You know it need to rely on system resources, so vmstat, iostat, cpu, memory plays vital role. If the application shares with another java apps they may consume resources. You can always run the script in nohup and collect the stats. 

Nuvanna cheppu billing rate ...tela teeddam ankuntunna

[vendettaa]

9 minutes ago, tacobell fan said:

Application health not only just rely on the specific app. You know it need to rely on system resources, so vmstat, iostat, cpu, memory plays vital role. If the application shares with another java apps they may consume resources. You can always run the script in nohup and collect the stats. 

my manager wants me to use something like jmeter to test the jar

[vendettaa]

i have one more question , does process id of the job-name is going to kill the spark job on standalone cluster