D a t a S c i e n c e gurinchi info kavali urgent

[LastManStanding]

19 minutes ago, vendettaa said:

eda kosame stats use chesedi , then dimensional reduction vatiki PCA use chestaru then machine learning algorithms knowledge undali to build model ,main EDA 

Ardamkala why did u tell me this? Nenu EDA, PCA, VIF and basic regression 10 years back ye chesevadini na job lo....Advanced ML ye idea ledu..changed my path and now back to it. Nenu kothallo e TS la chala untundi anukunna ikkada chala posts chusi..after being interviewed in lots of companies and started to work..I came to know how the overflow of software engineers are changing the dimensions in DS. 

[vendettaa]

4 minutes ago, LastManStanding said:

Ardamkala why did u tell me this? Nenu EDA, PCA, VIF and basic regression 10 years back ye chesevadini na job lo....Advanced ML ye idea ledu..changed my path and now back to it. Nenu kothallo e TS la chala untundi anukunna ikkada chala posts chusi..after being interviewed in lots of companies and started to work..I came to know how the overflow of software engineers are changing the dimensions in DS. 

Ipdu na role ni emantaru ,managers ki anni vachi unnollu kavali

[LastManStanding]

Just now, vendettaa said:

Ipdu na role ni emantaru ,managers ki anni vachi unnollu kavali

Emo mari. Machine Learning Engineer role ye undi ekkuva nuvvu cheppina danilo...Managers ante ye company ko mari..manchi companies lo aite chala clear ga unnai boundaries..nenu last 6 months lo chala companies lo chusa ippudu ide jarugutundi..they are mixing everything! Some of them are  clear..research companies lo aite ML/DL/AI especially NLP with.tools like R,Python, Azure ML, Cloud, Spark - Sparkly,Pyspark ala and not Scala etc, PowerBI,Tableau,GGplot2,hive,pig,terdata,oracle ilane adugutunnaru and of course..company specific elago untai in servers, visualizations, algorithms based on their domain. 

  Tuglaq companies ye ETL/MLE panulu cheyistunnai..java kuda kavali anta konni aite..comedy kakapote

[vendettaa]

4 minutes ago, LastManStanding said:

Emo mari. Machine Learning Engineer role ye undi ekkuva nuvvu cheppina danilo...Managers ante ye company ko mari..manchi companies lo aite chala clear ga unnai boundaries..nenu last 6 months lo chala companies lo chusa ippudu ide jarugutundi..they are mixing everything! Some of them are  clear..research companies lo aite ML/DL/AI especially NLP with.tools like R,Python, Azure ML, Cloud, Spark - Sparkly,Pyspark ala and not Scala etc, PowerBI,Tableau,GGplot2,hive,pig,terdata,oracle ilane adugutunnaru and of course..company specific elago untai in servers, visualizations, algorithms based on their domain. 

  Tuglaq companies ye ETL/MLE panulu cheyistunnai..java kuda kavali anta konni aite..comedy kakapote

Spark  application developing with scala currently 

u write spark code either in scala or python or java

moreover spark is developed with scala

we are using spark for processing data because we are going to use spark mlib in future 

Madi Artificial neural networks project so nlp untundi further going ,I can’t disclose more .Currently am doing more of big data engineer role 

[LastManStanding]

4 minutes ago, vendettaa said:

Spark  application developing with scala currently 

u write spark code either in scala or python or java

moreover spark is developed with scala

we are using spark for processing data because we are going to use spark mlib in future 

Ade..you have better skills than many DS but core DS technology miss avutav...still DE/MLE ki chala future undi...good for you tbh..company might be making a lot of money on you! 

[vendettaa]

Just now, LastManStanding said:

Ade..you have better skills than many DS...mamuku DS ki basic rdd concepts chalu kadha..good for you tbh..company might be making a lot of money on you! 

Actually rdds ipdu use cheyatledu they r slow,we r using datasets,dataframes

rdd lo logics raydam tough ,ade dataframe is similar to sql(exactlykadu) and temp tables concept undi adi inka easy but performance slow avtadi 

[vendettaa]

6 minutes ago, Veeraveera said:

Vaunty. What's up. Ela unnav

Am good uncle

how r u

[rocky420]

@vendettaa ML lo masters cheste manchi job vastada? 100k+ in a city like Atlanta?

[LastManStanding]

1 minute ago, vendettaa said:

Actually rdds ipdu use cheyatledu they r slow,we r using datasets,dataframes

rdd lo logics raydam tough ,ade dataframe is similar to sql(exactlykadu) and temp tables concept undi adi inka easy but performance slow avtadi 

Ya data frames are basic kadha..ade better asalu Asalu memu spark ye use cheyam sagam tasks lo..I use rdd too..based on the application..Java/Hadoop mida chala Jobs simultaneous ga run ayye company lo alantappudu use avutundi..Company and application batti

Amex - only Naive Bayes telusthe chalu

Wipro - Cloudera kavali

IBM - IBM servers mida grip

BOA - Devops mida grip undali 

Dillards/Macys - Churn analysis chalu

WF - Pyspark

Deloitte - Corticon and other rules engines

Ford ( goods valuation) - Tensorflow

  Inka healthcare, compliance, churn oko application batti inka..backend lo em run avutaya ani..chala vast subject kadha..

[vendettaa]

25 minutes ago, LastManStanding said:

Ya data frames are basic kadha..ade better asalu Asalu memu spark ye use cheyam sagam tasks lo..I use rdd too..based on the application..Java/Hadoop mida chala Jobs simultaneous ga run ayye company lo alantappudu use avutundi..Company and application batti

Amex - only Naive Bayes telusthe chalu

Wipro - Cloudera kavali

IBM - IBM servers mida grip

BOA - Devops mida grip undali 

Dillards/Macys - Churn analysis chalu

WF - Pyspark

Deloitte - Corticon and other rules engines

Ford ( goods valuation) - Tensorflow

  Inka healthcare, compliance, churn oko application batti inka..backend lo em run avutaya ani..chala vast subject kadha..

Rdds are basic but now rdds r like gone case since spark 2.0

in 1.6.3 version to read a txt file ,the result is rdd then define schema daniki scala lo case classes use cheydam  and logics sodi undedi rddlo rasetollam

now we are using spark session,spark conf gone case .now we read directly from spark session which gives dataframe and save also directly to watever database want to save 

 

[tables]

58 minutes ago, vendettaa said:

Spark  application developing with scala currently 

u write spark code either in scala or python or java

moreover spark is developed with scala

we are using spark for processing data because we are going to use spark mlib in future 

Madi Artificial neural networks project so nlp untundi further going ,I can’t disclose more .Currently am doing more of big data engineer role 

nlp unte ANN use chestaru ..ANN unte NLP undadam endi? artham kaaledu.

[LastManStanding]

16 minutes ago, vendettaa said:

Rdds are basic but now rdds r like gone case since spark 2.0

in 1.6.3 version to read a txt file ,the result is rdd then define schema daniki scala lo case classes use cheydam  and logics sodi undedi rddlo rasetollam

now we are using spark session,spark conf gone case .now we read directly from spark session which gives dataframe and save also directly to watever database want to save 

 

Nice. You are a very good DE

[LastManStanding]

2 minutes ago, tables said:

nlp unte ANN use chestaru ..ANN unte NLP undadam endi? artham kaaledu.

Tanu DE/ MLE... tana skills anni vatiki sambandinche unnai..So confuse ayyi AI anaboi ANN anindi anukunta

[vendettaa]

13 minutes ago, tables said:

nlp unte ANN use chestaru ..ANN unte NLP undadam endi? artham kaaledu.

Project name  ANN ani start avtadi  ,scratch nundi started nlp untadi ani chepparu still no one working on it ,currently we r working on insights and features ,nenekuva disclose cheyanu don’t ask too

still nlp Ann varku raledu ,butproject ann related (call center ni lepeydam)

[vendettaa]

10 minutes ago, LastManStanding said:

Tanu DE/ MLE... tana skills anni vatiki sambandinche unnai..So confuse ayyi AI anaboi ANN anindi anukunta

High level lo nakutelidu man

nlp Ann mida work chey ledu ,but current project ade