{"id":34661,"date":"2022-01-10T16:50:26","date_gmt":"2022-01-10T21:50:26","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=34661"},"modified":"2022-01-25T16:39:25","modified_gmt":"2022-01-25T21:39:25","slug":"has-time-machine-slowed-for-small-files","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2022\/01\/10\/has-time-machine-slowed-for-small-files\/","title":{"rendered":"Has Time Machine Slowed for Small Files?"},"content":{"rendered":"<p><a href=\"https:\/\/eclecticlight.co\/2022\/01\/09\/last-week-on-my-mac-has-time-machine-slowed\/\">Howard Oakley<\/a>:<\/p>\n<blockquote cite=\"https:\/\/eclecticlight.co\/2022\/01\/09\/last-week-on-my-mac-has-time-machine-slowed\/\">\n<p>The only common factor is that, when trying to back up folders containing seriously large numbers of very small files, some of which may be hard links, the rate of copying falls to ridiculously low numbers.<\/p>\n<p>[&#8230;]<\/p>\n<p>Looking back before 10.15.3, Time Machine never seemed to have problems with copying Xcode, or with the .DocumentRevisions-V100 folder. Exclude those, and anything like them, from backups now, and it performs well, even to a NAS via SMB.<\/p>\n<p>[&#8230;]<\/p>\n<p>Monterey introduced a new hidden feature in Time Machine: before making its first backup to a new backup set, <code>backupd<\/code> runs a speed test.<\/p>\n<p>[&#8230;]<\/p>\n<p>It&rsquo;s unclear what Time Machine does with those results, or why it should perform the second test using many small files, unless Apple knows there&rsquo;s a problem, perhaps.<\/p>\n<\/blockquote>\n\n<p>I&rsquo;ve been seeing this problem, too, except that it&rsquo;s also triggered by small files that I <em>do<\/em> want to back up. I had to restructure my folders to prevent it from grinding away 24\/7.<\/p>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2020\/02\/14\/macos-10-15-3-time-machine-problems\/\">macOS 10.15.3 Time Machine Problems<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2016\/03\/16\/massively-speed-up-time-machine-backups\/\">Massively Speed Up Time Machine Backups<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2014\/01\/02\/network-time-machine-without-a-time-capsule\/\">Network Time Machine Without a Time Capsule<\/a><\/li>\n<\/ul>\n\n<p id=\"has-time-machine-slowed-for-small-files-update-2022-01-25\">Update (2022-01-25): <a href=\"https:\/\/eclecticlight.co\/2022\/01\/20\/why-time-machine-backups-can-be-interminably-slow\/\">Howard Oakley<\/a>:<\/p>\n<blockquote cite=\"https:\/\/eclecticlight.co\/2022\/01\/20\/why-time-machine-backups-can-be-interminably-slow\/\">\n<p>There&rsquo;s another part to this, at least in M1 Macs, in that <code>backupd<\/code> threads must also be given sufficient % CPU to be able to take advantage of any release of that throttle. Having <a href=\"https:\/\/eclecticlight.co\/2022\/01\/12\/how-macos-manages-many-processes-on-m1-cores\/\">demonstrated<\/a> how user threads can make best use of the Efficiency (E) cores in the M1 Pro, my next step was to inspect what happens during a backup using <code>powermetrics<\/code> and the CPU History window. Here I was surprised to see that, while <code>backupd<\/code> accounted for around 90% active residency on each of the two E cores during a backup, those cores were largely running at 972-1332 MHz, around half their maximum frequency.<\/p>\n<p>By default, then, Time Machine backups are run exclusively on the E cores, at economy mode to minimise power consumption, with an I\/O throttle preventing them from accessing storage at normal speed. These limit it to backing up no more than 300-400 items\/s, which in turn means that folders containing very large numbers of items will take a long time to back up.<\/p>\n<p>Sadly, Apple doesn&rsquo;t provide any options for the user to accelerate a backup, nor does <code>backupd<\/code> change its settings when it knows that there are a great many items to be copied.<\/p>\n<\/blockquote>","protected":false},"excerpt":{"rendered":"<p>Howard Oakley: The only common factor is that, when trying to back up folders containing seriously large numbers of very small files, some of which may be hard links, the rate of copying falls to ridiculously low numbers. [&#8230;] Looking back before 10.15.3, Time Machine never seemed to have problems with copying Xcode, or with [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2022-01-10T21:50:29Z","apple_news_api_id":"e047e9ac-58fd-44d3-9f89-55f8b422d576","apple_news_api_modified_at":"2022-01-25T21:39:29Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAAAA==","apple_news_api_share_url":"https:\/\/apple.news\/A4EfprFj9RNOfiVX4tCLVdg","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[2014,131,30,694,1666,1891,2077,216],"class_list":["post-34661","post","type-post","status-publish","format-standard","hentry","category-technology","tag-apple-m1","tag-bug","tag-mac","tag-mac-os-x-versions","tag-macos-10-15","tag-macos-11-0","tag-macos-12","tag-timemachine"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/34661","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=34661"}],"version-history":[{"count":2,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/34661\/revisions"}],"predecessor-version":[{"id":34801,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/34661\/revisions\/34801"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=34661"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=34661"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=34661"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}