{"id":26179,"date":"2019-08-05T16:46:17","date_gmt":"2019-08-05T20:46:17","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=26179"},"modified":"2019-08-06T15:32:13","modified_gmt":"2019-08-06T19:32:13","slug":"opening-huge-csv-files","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2019\/08\/05\/opening-huge-csv-files\/","title":{"rendered":"Opening Huge CSV Files"},"content":{"rendered":"<p><a href=\"https:\/\/birchtree.me\/blog\/how-long-to-the-major-macos-text-editors-take-to-open-huge-files\/\">Matt Birchler<\/a>:<\/p>\n<blockquote cite=\"https:\/\/birchtree.me\/blog\/how-long-to-the-major-macos-text-editors-take-to-open-huge-files\/\">\n<p>Basically, BBEdit was remarkably fast at opening the file, being 4x faster than Visual Studio Code and 20x faster than Sublime. And then in terms of saving changes to the file, most apps were in the same ballpark, which I assume is because this is reliant on my SSD&rsquo;s ability to save the data, not the app doing anything special.<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/twitter.com\/nohillside\/status\/1158459992388833281\">Patrick Seemann<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/nohillside\/status\/1158459992388833281\"><p>ed: immediately<br \/>\nemacs: ~6s<br \/>\nvi: ~8s<\/p><\/blockquote>\n\n<p>I&rsquo;d like to see the results for <a href=\"https:\/\/mjtsai.com\/blog\/2013\/10\/27\/numbers-13-performance\/\">Excel,  Numbers<\/a>, and TextEdit.<\/p>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2019\/07\/26\/fast-software-the-best-software\/\">Fast Software, the Best Software<\/a><\/li>\n<\/ul>\n\n<p id=\"opening-huge-csv-files-update-2019-08-06\">Update (2019-08-06): <a href=\"https:\/\/twitter.com\/wincent\/status\/1158487064456900608\">Greg Hurrell<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/wincent\/status\/1158487064456900608\">\n<p>Vim takes 8s to open a 1.5GB CSV file.<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/twitter.com\/mattbirchler\/status\/1158494621976137728\">Matt Birchler<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/mattbirchler\/status\/1158494621976137728\">\n<p>I updated the post with the 3 apps you listed &#x1F642;<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/twitter.com\/_venkatasg\/status\/1158554339578806272\">Venkat<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/_venkatasg\/status\/1158554339578806272\">\n<p>Regarding the csv loading, Numbers can&rsquo;t load more than 255 columns of data, which annoyed me frequently in the past few weeks. Google sheets and Excel had no problem with lots of columns.<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/twitter.com\/fzwob\/status\/1158645071438405632\">Friedrich Markgraf<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/fzwob\/status\/1158645071438405632\">\n<p>Numbers does not support more than 65k lines. Current versions at least warn about that after the long import. Last year it just silently dropped lines.<\/p>\n<\/blockquote>","protected":false},"excerpt":{"rendered":"<p>Matt Birchler: Basically, BBEdit was remarkably fast at opening the file, being 4x faster than Visual Studio Code and 20x faster than Sublime. And then in terms of saving changes to the file, most apps were in the same ballpark, which I assume is because this is reliant on my SSD&rsquo;s ability to save the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2019-08-05T20:46:21Z","apple_news_api_id":"8b7888a7-9574-45c9-b161-b1c35788f943","apple_news_api_modified_at":"2019-08-06T19:32:17Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAAAw==","apple_news_api_share_url":"https:\/\/apple.news\/Ai3iIp5V0RcmxYbHDV4j5Qw","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[1853,154,1857,124,30,32,1609,609,241,138,1845,68,1856,1187],"class_list":["post-26179","post","type-post","status-publish","format-standard","hentry","category-technology","tag-atom-text-editor","tag-bbedit","tag-csv","tag-emacs","tag-mac","tag-macapp","tag-macos-10-14","tag-microsoft-excel","tag-numbers","tag-optimization","tag-sublime-text","tag-texteditor","tag-vi","tag-visual-studio-code"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/26179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=26179"}],"version-history":[{"count":2,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/26179\/revisions"}],"predecessor-version":[{"id":26187,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/26179\/revisions\/26187"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=26179"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=26179"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=26179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}