{"id":36277,"date":"2022-06-20T16:44:25","date_gmt":"2022-06-20T20:44:25","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=36277"},"modified":"2023-08-18T10:24:21","modified_gmt":"2023-08-18T14:24:21","slug":"removed-from-bing-and-duckduckgo","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2022\/06\/20\/removed-from-bing-and-duckduckgo\/","title":{"rendered":"Removed From Bing and DuckDuckGo"},"content":{"rendered":"<p><a href=\"https:\/\/lapcatsoftware.com\/articles\/bing.html\">Jeff Johnson<\/a> (<a href=\"https:\/\/news.ycombinator.com\/item?id=31766882\">Hacker News<\/a>):<\/p>\n<blockquote cite=\"https:\/\/lapcatsoftware.com\/articles\/bing.html\"><p>It turns out that my business web site was removed from Bing, which explains why it&rsquo;s missing from DuckDuckGo.<\/p><p>[&#8230;]<\/p><p>According to <a href=\"https:\/\/support.microsoft.com\/en-us\/topic\/how-bing-delivers-search-results-d18fc815-ac37-4723-bc67-9229ce3eb6a3\" title=\"How Bing delivers search results\">the link in the results<\/a>, &ldquo;Bing limits removal of search results to a narrow set of circumstances and conditions to avoid restricting Bing users&rsquo; access to relevant information.&rdquo; Yet none of these circumstances would seem to apply to my web site, so it&rsquo;s a mystery.<\/p><p>[&#8230;]<\/p><p>A few other people I know, including <a href=\"https:\/\/www.jessesquires.com\/blog\/2022\/03\/25\/my-website-disappeared-from-bing-and-duckduckgo\/\" title=\"My website disappeared from Bing and DuckDuckGo\">Jesse Squires<\/a>, have also seen their web sites mysteriously removed from Bing and DuckDuckGo. Jesse&rsquo;s site is still missing! Jesse&rsquo;s blog post links to a <a href=\"https:\/\/www.linkedin.com\/pulse\/bing-exploit-allows-website-owners-deindex-chase-watts\/\" title=\"Bing Exploit Allows Website Owners to Deindex Competitors\">blog post by Chase Watts<\/a>, Affiliate Manager at GoDaddy, who explains an exploit in Bing that allows website owners to deindex competitors, so it&rsquo;s possible that this is what happened to me.<\/p><\/blockquote>\n\n<p><a href=\"https:\/\/twitter.com\/lapcatsoftware\/status\/1538962747257458689\">Jeff Johnson<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/lapcatsoftware\/status\/1538962747257458689\">\n<p>A <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-bing\/help-why-my-site-has-been-removed-from-bing-s-search-results\/m-p\/2906441\">whole thread<\/a> full of people whose web sites have been inexplicably removed from Microsoft Bing and search engines that rely on Bing, such as DuckDuckGo.<\/p>\n<\/blockquote>\n\n<p>Other people, myself included, are seeing problems where sites are clearly not <em>removed<\/em>, but neither do they seem to be fully indexed.<\/p>\n\n<p><a href=\"https:\/\/twitter.com\/kimonostereo\/status\/1537517307659812864\">Scott Yoshinaga<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/kimonostereo\/status\/1537517307659812864\">\n<p>@gruber\n using the DuckDuckGo search in your archive section returns very limited results. I believe it used to be better. I&rsquo;ve noticed this for my website that uses their search engine as well.<\/p>\n<p>[&#8230;]<\/p>\n<p>Also strange: a search term may not have any results return, but if I reload the page multiple times, search results appear eventually.<\/p>\n<\/blockquote>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2022\/06\/20\/kagi-search-and-orion-browser-public-betas\/\">Kagi Search and Orion Browser Public Betas<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2022\/04\/20\/duckduckgo-youtube-dl-and-bing\/\">DuckDuckGo, youtube-dl, and Bing<\/a><\/li>\n<\/ul>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2022-06-24\">Update (2022-06-24): <a href=\"https:\/\/twitter.com\/lapcatsoftware\/status\/1539451135341338626\">Jeff Johnson<\/a>:<\/p>\n<blockquote cite=\"https:\/\/twitter.com\/lapcatsoftware\/status\/1539451135341338626\">\n<p>Myself and \n@jesse_squires\n are both restored to Bing and DuckDuckGo.<\/p>\n<\/blockquote>\n<p>No explanation given.<\/p>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2022-07-26\">Update (2022-07-26): <a href=\"https:\/\/www.jessesquires.com\/blog\/2022\/07\/25\/my-website-disappeared-from-bing-and-duckduckgo-part-2\/\">Jesse Squires<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.jessesquires.com\/blog\/2022\/07\/25\/my-website-disappeared-from-bing-and-duckduckgo-part-2\/\">\n<p>I originally discovered and <a href=\"https:\/\/www.jessesquires.com\/blog\/2022\/03\/25\/my-website-disappeared-from-bing-and-duckduckgo\/\">wrote about<\/a> the issue in late March. Jeff published <a href=\"https:\/\/lapcatsoftware.com\/articles\/bing.html\">his post<\/a> a few months later in June. I also received a number of emails and tweets from readers facing the same problem. It really felt like <em>everyone<\/em> was having this issue. Yet, no one &mdash; including DuckDuckGo&rsquo;s own CEO &mdash; seemed to know what the fuck was going on.<\/p>\n<p>[&#8230;]<\/p>\n<p>[Bing] confirmed my site committed so-called violations, but refused to tell me what.<\/p>\n<p>[&#8230;]<\/p>\n<p>Fast forward almost exactly one month after Bing Support&rsquo;s response. Ostensibly and miraculously my site is no longer violating Bing&rsquo;s guidelines.<\/p>\n<p>[&#8230;]<\/p>\n<p>However, results on DuckDuckGo still seem incomplete compared to what they used to be, especially compared to Google.<\/p>\n<\/blockquote>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2022-08-02\">Update (2022-08-02): <a href=\"https:\/\/io.bikegremlin.com\/28530\/microsoft-bing-serp-gone-overnight\/\">Relja Novovi&#x107;<\/a> (via <a href=\"https:\/\/twitter.com\/lapcatsoftware\/status\/1552750818012585986\">Jeff Johnson<\/a>):<\/p>\n<blockquote cite=\"https:\/\/io.bikegremlin.com\/28530\/microsoft-bing-serp-gone-overnight\/\">\n<p>My websites just got erased from their search results &#x2013; overnight!<\/p>\n<p>[&#8230;]<\/p>\n<p>The first question to ask when something like this happens is: &ldquo;what did you do\/change\/update?&rdquo; The answer is, as far as I remember and can tell &#x2013; nothing.<\/p>\n<p>[&#8230;]<\/p>\n<p>To add insult to injury, when you &ldquo;Google&rdquo; the term &ldquo;BikeGremlin&rdquo; on Microsoft Bing or DuckDuckGo, SERPs show BikeGremlin social-media accounts and results from a website &ldquo;bikehow.com&rdquo; that has literally copied my articles and re-published them!<\/p>\n<\/blockquote>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2022-11-01\">Update (2022-11-01): <a href=\"https:\/\/thejollyteapot.com\/2022\/10\/28\/something-is-rotten-in-the-state-of-bing-search\">Nicolas Magand<\/a>:<\/p>\n<blockquote cite=\"https:\/\/thejollyteapot.com\/2022\/10\/28\/something-is-rotten-in-the-state-of-bing-search\">\n<p>This week, I tried one more time to get in touch with Bing support, I guess this makes it the seventh or eighth time. In a couple of days, I expect to receive a generic email saying that my website doesn&rsquo;t follow <a href=\"https:\/\/www.bing.com\/webmasters\/help\/webmaster-guidelines-30fba23a\">Bing&rsquo;s guidelines<\/a>, without saying anything more, even if my website apparently follows every guideline. I have a background in SEO, I write original content, I have a very clean website, I use Bing Webmaster Tools and Google Search Console, and I can&rsquo;t find anything wrong. I can&rsquo;t find any reason for this removal. I can&rsquo;t find any solution to this problem. Clearly, this is a <a href=\"https:\/\/mjtsai.com\/blog\/2022\/06\/20\/removed-from-bing-and-duckduckgo\/\">Bing issue<\/a>, and they are extremely bad at fixing it, or at least point their users to the right direction.<\/p>\n<\/blockquote>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2023-01-18\">Update (2023-01-18): <a href=\"https:\/\/daverupert.com\/2023\/01\/shadow-banned-by-duckduckgo-and-bing\/\">Dave Rupert<\/a> (<a href=\"https:\/\/news.ycombinator.com\/item?id=34388962\">Hacker News<\/a>):<\/p>\n<blockquote cite=\"https:\/\/daverupert.com\/2023\/01\/shadow-banned-by-duckduckgo-and-bing\/\">\n<p>Why on earth would Bing not index my site at all? To solve this, I took the first step and signed up for Bing Webmaster Tools to try to know what Bing knows about my site and sure enough: zero clicks, zero impressions, and zero indexed pages for my site. Awful.<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/lapcatsoftware.com\/articles\/bing2.html\">Jeff Johnson<\/a>:<\/p>\n<blockquote cite=\"https:\/\/lapcatsoftware.com\/articles\/bing2.html\">\n<p>Sure enough, https:\/\/underpassapp.com is now missing again from both Bing and DuckDuckGo!<\/p>\n<p>My personal site https:\/\/lapcatsoftware.com was never removed from Bing or DuckDuckGo. Only my business site is missing.<\/p>\n<\/blockquote>\n\n<p id=\"removed-from-bing-and-duckduckgo-update-2023-08-18\">Update (2023-08-18): <a href=\"https:\/\/pxlnv.com\/linklog\/bing-wtf\/\">Nick Heer<\/a> (<a href=\"https:\/\/mastodon.social\/@pxlnv\/110906728407153415\">Mastodon<\/a>):<\/p>\n<blockquote cite=\"https:\/\/pxlnv.com\/linklog\/bing-wtf\/\">\n<p>[This] appears to be a somewhat common issue where Bing &mdash; and, consequently, the many small search engines which rely on its results &mdash; will completely de-index a website for no apparent reason. <a href=\"https:\/\/www.bing.com\/search?q=site%3Atechdirt.com\">Bing still shows<\/a> zero results for a query for <code>site:techdirt.com<\/code>, though it does again say &ldquo;some results have been removed&rdquo; and links to a <a href=\"https:\/\/support.microsoft.com\/en-us\/topic\/how-bing-delivers-search-results-d18fc815-ac37-4723-bc67-9229ce3eb6a3\">generic help page<\/a>.<\/p>\n<\/blockquote>","protected":false},"excerpt":{"rendered":"<p>Jeff Johnson (Hacker News): It turns out that my business web site was removed from Bing, which explains why it&rsquo;s missing from DuckDuckGo.[&#8230;]According to the link in the results, &ldquo;Bing limits removal of search results to a narrow set of circumstances and conditions to avoid restricting Bing users&rsquo; access to relevant information.&rdquo; Yet none of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2022-06-20T20:44:27Z","apple_news_api_id":"4c3164e1-7bde-4ad7-b582-7b1db6b5a2f6","apple_news_api_modified_at":"2023-08-18T14:24:25Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAABw==","apple_news_api_share_url":"https:\/\/apple.news\/ATDFk4XveSte1gnsdtrWi9g","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[313,1469,343,96],"class_list":["post-36277","post","type-post","status-publish","format-standard","hentry","category-technology","tag-bing","tag-duckduckgo","tag-search","tag-web"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/36277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=36277"}],"version-history":[{"count":9,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/36277\/revisions"}],"predecessor-version":[{"id":40387,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/36277\/revisions\/40387"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=36277"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=36277"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=36277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}