{"id":19327,"date":"2017-10-23T16:03:12","date_gmt":"2017-10-23T20:03:12","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=19327"},"modified":"2017-10-23T16:04:53","modified_gmt":"2017-10-23T20:04:53","slug":"how-well-do-filesystems-handle-errors","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2017\/10\/23\/how-well-do-filesystems-handle-errors\/","title":{"rendered":"How Well Do Filesystems Handle Errors?"},"content":{"rendered":"

Dan Luu<\/a> (tweet<\/a>, Hacker News<\/a>):<\/p>\n

We’re going to reproduce some results from papers on filesystem robustness that were written up roughly a decade ago<\/a>: Prabhakaran et al. SOSP 05 paper<\/a>, which injected errors below the filesystem and Gunawi et al. FAST 08<\/a>, which looked at how often filessytems failed to check return codes of functions that can return errors.<\/p>\n

[…]<\/p>\n

No tested filesystem other than btrfs<\/tt> handled silent failures correctly. The other filesystems tested neither duplicate nor checksum data, making it impossible for them to detect silent failures. zfs<\/tt> would probably also handle silent failures correctly but wasn’t tested. apfs<\/tt>, despite post-dating btrfs<\/tt> and zfs<\/tt>, made the explicit decision to not checksum data and silently fail on silent block device errors.<\/p>\n

[…]<\/p>\n

Relatedly, it appears that apfs<\/tt> doesn’t checksum data because “[apfs] engineers contend that Apple devices basically don’t return bogus data”<\/a>. Publicly available studies on SSD reliability have not found that there’s a model that doesn’t sometimes return bad data. It’s a common conception that SSDs are less likely to return bad data than rotational disks[…]<\/p><\/blockquote>\n

Plus, APFS can be used on non-Apple SSDs as well as on hard drives, so there’s really<\/em> no reason to believe that checksums wouldn’t detect errors.<\/p>\n

Previously: Apple File System (APFS)<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

Dan Luu (tweet, Hacker News): We’re going to reproduce some results from papers on filesystem robustness that were written up roughly a decade ago: Prabhakaran et al. SOSP 05 paper, which injected errors below the filesystem and Gunawi et al. FAST 08, which looked at how often filessytems failed to check return codes of functions […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"","apple_news_api_id":"","apple_news_api_modified_at":"","apple_news_api_revision":"","apple_news_api_share_url":"","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[1395,1321,537,31,1472,448,30,1529,174],"class_list":["post-19327","post","type-post","status-publish","format-standard","hentry","category-technology","tag-apple-file-system-apfs","tag-data-integrity","tag-filesystem","tag-ios","tag-ios-11","tag-linux","tag-mac","tag-macos-10-13","tag-storage"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/19327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=19327"}],"version-history":[{"count":1,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/19327\/revisions"}],"predecessor-version":[{"id":19328,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/19327\/revisions\/19328"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=19327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=19327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=19327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}