MrDexter Posted February 4, 2018 Report Posted February 4, 2018 Guys need someone to help me write some java/scala code for XML splitting (large files 500MB to 1GB+) I am ready to PAY for a successful piece of software /code. Let me know if you have any questions. -Dex Quote
andhrabalayya Posted February 4, 2018 Report Posted February 4, 2018 Why not just file splitter? Quote
MrDexter Posted February 4, 2018 Author Report Posted February 4, 2018 1 minute ago, andhrabalayya said: Why not just file splitter? Bro, can you PM me your number, we can chat in Whatsapp or in message. I will explain you the sceanrio. Its simple. i need a software to run everyday anf split large XML files. each file size ranges from 100MB to 2GB. Can you help me with this, i can compensate. Quote
Gains Posted February 4, 2018 Report Posted February 4, 2018 10 minutes ago, MrDexter said: Bro, can you PM me your number, we can chat in Whatsapp or in message. I will explain you the sceanrio. Its simple. i need a software to run everyday anf split large XML files. each file size ranges from 100MB to 2GB. Can you help me with this, i can compensate. http://www.smooks.org/ https://www.saxonica.com/html/documentation/documentation.html Quote
Ustad Posted February 4, 2018 Report Posted February 4, 2018 2 hours ago, MrDexter said: Guys need someone to help me write some java/scala code for XML splitting (large files 500MB to 1GB+) I am ready to PAY for a successful piece of software /code. Let me know if you have any questions. -Dex Pay howmuch? C2C or W2 if C2C @Kumaravarma can help Quote
Gains Posted February 4, 2018 Report Posted February 4, 2018 if you want to write in java use StAX parser ..check out the link below https://stackoverflow.com/questions/5169978/split-1gb-xml-file-using-java Quote
RubberBaloo Posted February 4, 2018 Report Posted February 4, 2018 48 minutes ago, MrDexter said: Guys need someone to help me write some java/scala code for XML splitting (large files 500MB to 1GB+) I am ready to PAY for a successful piece of software /code. Let me know if you have any questions. -Dex nen raasta... kavalante cheppu. Quote
andhrabalayya Posted February 4, 2018 Report Posted February 4, 2018 16 minutes ago, Gains said: if you want to write in java use StAX parser ..check out the link below https://stackoverflow.com/questions/5169978/split-1gb-xml-file-using-java kani split cheyali kada XML ni.. Interesting problem though. Quote
Gains Posted February 4, 2018 Report Posted February 4, 2018 4 minutes ago, andhrabalayya said: kani split cheyali kada XML ni.. Interesting problem though. that link has split functionality too bro..also below links... tons of info.. TS please google it man https://stackoverflow.com/questions/2056910/split-xml-in-multiple-xml-files https://gist.github.com/lachlan/709ead50f1401ee3afa4 Quote
andhrabalayya Posted February 4, 2018 Report Posted February 4, 2018 37 minutes ago, Gains said: that link has split functionality too bro..also below links... tons of info.. TS please google it man https://stackoverflow.com/questions/2056910/split-xml-in-multiple-xml-files https://gist.github.com/lachlan/709ead50f1401ee3afa4 Yeah given element name tho programatically cheyochu. Without knowing XML element name :-) Quote
MrDexter Posted February 4, 2018 Author Report Posted February 4, 2018 1 hour ago, Gains said: that link has split functionality too bro..also below links... tons of info.. TS please google it man https://stackoverflow.com/questions/2056910/split-xml-in-multiple-xml-files https://gist.github.com/lachlan/709ead50f1401ee3afa4 I dont know how to make these things work. I only know my requirement. Requirement is we need a deployable application (jar) in Java (preferably in Scala) which should read and write from AWS S3 every day some large XML files of size 100MB to 2GB and split them into multiple chunks of 10MB files. Each individual file should have valid schema. Just from schema perspective it looks simple. but i need a good project where it should run smoothly in PROD. Willing to pay. please reach me. Quote
MrDexter Posted February 4, 2018 Author Report Posted February 4, 2018 59 minutes ago, andhrabalayya said: Yeah given element name tho programatically cheyochu. Without knowing XML element name :-) we clearly know the element end tags where we can split. Can you help me out. Quote
Ustad Posted February 4, 2018 Report Posted February 4, 2018 1 minute ago, MrDexter said: we clearly know the element end tags where we can split. Can you help me out. Thanks Srikanth Sure Srikanth Quote
Manthrii Posted February 4, 2018 Report Posted February 4, 2018 unix lo file split cheskoni.. xmllink tho parse cheskovachu ga Quote
MrDexter Posted February 4, 2018 Author Report Posted February 4, 2018 18 minutes ago, Manthrii said: unix lo file split cheskoni.. xmllink tho parse cheskovachu ga We need it to be deployed as a jar file along with another downstream app Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.