excel data to json - help

[panipoori]

18 minutes ago, vendettaa said:

nenaite ila chesta

i will read that csv file in spark and create a dataframe out of it

then i will load it to sql server as format json . idanta spark lo cheyochu 

just csv nunchi json convert cheyaddniki ippudu Spark install chesukovala

[vendettaa]

5 minutes ago, karthikn said:

anta navvudu em undi dantlo 

 

[Biskot2]

2 minutes ago, Mr Mirchi said:

yaa..java lo i can...but 400k records dbbase numdi read chesi convert chesi text file ki raayaali...aa file vere team ki ivvaali.....performance concern IO streams kabatti..java coding option naa last option ...sql server lo option vunnattu vundhi but how does it perform anedhi chudaali

make sure that table have clusters in sql. 400k antey koncham time taking aa. query run chesinaka, sql performance tool lo chudu

[vendettaa]

Just now, panipoori said:

just csv nunchi json convert cheyaddniki ippudu Spark install chesukovala

spark open source ga cheskochu , spark scala java use chesi task finsih cheyachu easy ga

akda takuva data kadu ga 400k records

[Katara]

7 minutes ago, Mr Mirchi said:

pyna nenu cheppinattu idhi worked bro...but nested arrays ki option ledhu dheenilo 

So each column lo string data leda? array of data per column or each column already has json and you want to combine?

[panipoori]

1 minute ago, vendettaa said:

spark open source ga cheskochu , spark scala java use chesi task finsih cheyachu easy ga

akda takuva data kadu ga 400k records

I think enterprise version of R or python vnte it's easier

[Katara]

3 minutes ago, panipoori said:

just csv nunchi json convert cheyaddniki ippudu Spark install chesukovala

Mysore bonda akadey tinala antav

[vendettaa]

1 minute ago, panipoori said:

I think enterprise version of R or python vnte it's easier

r and python avasaram ledu 

 

[panipoori]

5 minutes ago, vendettaa said:

r and python avasaram ledu 

 

Spark easy antaav ayte R and python kante?

[AryaD]

17 minutes ago, Mr Mirchi said:

yaa..java lo i can...but 400k records dbbase numdi read chesi convert chesi text file ki raayaali...aa file vere team ki ivvaali.....performance concern IO streams kabatti..java coding option naa last option ...sql server lo option vunnattu vundhi but how does it perform anedhi chudaali

You can use combination of spring batch and java8 streams . Ping me if you need more details .

[ekunadam_enkanna]

Excel lo ela store chestunnadu course array object ni? Flat ga?

 

[Spartan]

nodejs lo npm library undi direct ga..

https://stackoverflow.com/questions/16831250/how-to-convert-csv-to-json-in-node-js

[afacc123]

8 minutes ago, Spartan said:

nodejs lo npm library undi direct ga..

https://stackoverflow.com/questions/16831250/how-to-convert-csv-to-json-in-node-js

If you want even better performance than Java 8 streams combined with Spring this is penultimate 

@Spartan knows what the duck 🦆 he’s talking

[Mr Mirchi]

data ni sql server lo upload chesi JSON path use chesa...chala fas ga easy ga ayindhi...thanks guys

[Mr Mirchi]

10 hours ago, Biskot2 said:

make sure that table have clusters in sql. 400k antey koncham time taking aa. query run chesinaka, sql performance tool lo chudu

1 and half min lo json data create ayindhi ba sql server lo JSON PATH use chesthe.....solved