Jump to content

How to I clean big csv file in Linux?


DesiPokiri

Recommended Posts

Need help va.

I have a multiple big csv files. Each csv file has few columns separated by comma. I just want a second column in each row and discard all the other data.

how can I achieve this ? I can’t do it manually as it they are super big files. And I can’t download to personal drive as well as everything happens in Linux vm 

Link to comment
Share on other sites

17 minutes ago, DesiPokiri said:

Need help va.

I have a multiple big csv files. Each csv file has few columns separated by comma. I just want a second column in each row and discard all the other data.

how can I achieve this ? I can’t do it manually as it they are super big files. And I can’t download to personal drive as well as everything happens in Linux vm 

Use cut -d command and pipe output into another file

Link to comment
Share on other sites

13 minutes ago, TriStateBabu said:

what was the solution that worked for you bro?

I simply uploaded to my personal bucket on s3 from vm using aws cli and downloaded it from there 

  • Thanks 1
Link to comment
Share on other sites

3 minutes ago, toranam said:

Nee multiple jobs etta unnayi bro

db youth ki inspiration taggindi koncham evvu 

First job vadilesa baa, meetings ekkuva pedutunnadu waste gadu. Second and third job doing. Cool going 

  • Confused 1
  • Upvote 1
Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...