Application to open / edit a very large CSV file (500 MB, 4 million records)?

Posted by Giorgi on Super User See other posts from Super User or by Giorgi
Published on 2010-05-06T19:42:24Z Indexed on 2010/05/07 0:48 UTC
Read the original article Hit count: 317

Filed under:

text

|

editing

|

csv

|

large

|

file

Hello,

I have a csv file which has about 4 million rows and is about 500MB in size. Can you recommend any editor that can open the file without making the system crawl? I tried EmEditor but it is complaining that there are too many characters in a single line.

Thanks.

© Super User or respective owner

Related posts about text

Error in running script [closed]

as seen on Programmers - Search for 'Programmers'
I'm trying to run heathusf_v1.1.0.tar.gz found here I installed tcsh to make build_heathusf work. But, when I run ./build_heathusf, I get the following (I'm running that on a Fedora Linux system from Terminal): $ ./build_heathusf Compiling programs to build a library of image processing functions… >>> More
Coloring even heighten columns

as seen on Stack Overflow - Search for 'Stack Overflow'
I try to set different a background colors for left and right columns and to maintain the same height. So I set a background color for outer wrapper ("container" div) so it will set a color to rightBar. But this didn't work. Online Demo I want it to work on all browsers. Markup: <!DOCTYPE… >>> More
HTML: How to create a DIV with only vertical scroll-bar to show long paragraphs on a webpage?

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to show terms and condition note on my website. I dont want to use text field and also dont want to use my whole page. I just want to display my text in selected area and want to use only vertical scroll-bar to go down and read all text. Currently I am using this code: <div style="width:10;height:10;overflow:scroll"… >>> More
Qt Linking Error.

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I configure qt-x11 with following options ./configure -prefix /iTalk/qtx11 -prefix-install -bindir /iTalk/qtx11-install/bin -libdir /iTalk/qtx11-install/lib -docdir /iTalk/qtx11-install/doc -headerdir /iTalk/qtx11-install/include -datadir /iTalk/qtx11-install/data -examplesdir /iTalk/qtx11-install/examples… >>> More
XSLT Escape Character not working

as seen on Stack Overflow - Search for 'Stack Overflow'
I am trying to use escape charaters in my text output, as i would like too surround the output in emailData tags. I am using <xsl:text><emailData></xsl:text> In the XSLT to esnure that this works however because i am using a tool called Cast Iron for some reason it… >>> More

Related posts about editing

How can I retain the editing in the search result with UISearchDisplayController?

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to search a table in editing mode, but when I type a letter the variable tableView.editing is changed to NO. And when I cancel the search, the tableView.editing return to YES. I'd like to retain the editing YES in the result of the search. I put breakpoint in several methods. Until the filterContentForSearchText… >>> More
Use XQuery to Access XML in Emacs

as seen on Oracle Blogs - Search for 'Oracle Blogs'
There you are working on a multi-MB/GB/TB XML document or set of documents, you want to be able to quickly query the content but you don't want to load the XML into a full-blown XML database, the time spent setting things up is simply too expensive. Why not combine a great open source editor, Emacs… >>> More
How to create a plymouth splash with boot messages, progress bar and a spinning logo?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I would like to know how to create a splash for my ubuntu mavercik with boot messages being displayed when i boot as well as a progress bar and a spinning logo. or if possible how to edit a splash which already has a spinning logo and a progress bar, and add a boot messages to it. any help appreciated… >>> More
What word processor can manage left and right pages separately?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I was after a word processor that can manage left and right pages separately so I can have my text on the right pages and my illustrations on the left pages. I know LibeOffice can set "left page" and "right page" formats, but there is no simple way to make the text jump from right page to right page… >>> More
Emacs column editing CUA mode - is it possible to select rectangular region with mouse?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Rectangular or column editing is possible in emacs. And it is very easy with cua-mode enabled. Here are my references for this: Here's a video that shows how to do it: http://vimeo.com/1168225 And see section "CUA rectangle support" here: http://www.cua.dk/cua.html But I also wonder if I can… >>> More