The explanations for eradicating a web page from Google’s search outcomes haven’t a lot modified since I first printed this text in 2023. Examples embrace pages with confidential, premium, or outdated data. But the instruments and ways have advanced.
Right here’s my up to date model.
Non permanent Removing
The necessity to take away URLs from Google is pressing when a web site is (i) hacked with malware or illicit content material whereas listed (even rating) or (ii) inadvertently exposes non-public data that the search large then indexes.
The quickest solution to disguise URLs from searchers is through Google’s URL elimination device within the “Indexing” part of Search Console. There, you may take away a single URL or a complete class.
Google processes these requests rapidly in my expertise, however it doesn’t completely deindex them. It as a substitute hides the URLs from search outcomes for roughly six months.
Search Console’s device removes URLs from search outcomes for “about six months.” Click on picture to enlarge.
An identical function in Bing Webmaster Instruments, referred to as “Block URLs,” hides pages from Bing search for roughly 90 days.
“Block URLs” in Bing Webmaster Instruments hides pages from Bing seek for roughly 90 days. Click on picture to enlarge.
Everlasting
A number of choices take away URLs completely from Google’s index.
Delete the web page out of your web site
Deleting a web page out of your net server will completely deindex it. After deleting, arrange a 410 HTTP standing code of “gone” as a substitute of 404 “not discovered.” Permit a number of days for Google to recrawl the location, uncover the 410 code, and take away the web page from its index.
Word that Google discourages the usage of redirects to take away low-value pages, because the apply sends poor indicators to the successor.
As an apart, Google gives a type to take away private data from search outcomes.
Add the noindex tag
Search engines like google almost all the time honor the noindex meta tag. Search bots will crawl a noindex web page, however is not going to embrace it in search outcomes.
In my expertise, Google will instantly acknowledge a noindex meta tag as soon as it crawls the web page. Word that the tag removes the web page from search outcomes, not the location. The web page stays accessible by way of different hyperlinks, inside and exterior.
A noindex tag is not going to seemingly take away the web page from LLMs resembling ChatGPT, Claude, and Perplexity, as these platforms don’t all the time honor noindex tags and even robots.txt exclusions. Deleting pages out of your web site is the surefire elimination tactic.
Password shield
Take into account including a password to a printed web page to forestall it from turning into publicly accessible. Google can’t crawl pages requiring passwords or person names.
Including a password is not going to take away an listed web page. A noindex tag will, nonetheless.
Take away inside hyperlinks
Take away all inside hyperlinks to pages you don’t need listed. And don’t hyperlink to password-protected or deleted pages; each harm the person expertise. At all times deal with human guests — not serps alone.
Robots.txt
Robots.txt recordsdata can forestall Google (and different bots) from crawling a web page (or class). Pages blocked through robots.txt may nonetheless be listed and ranked if included in a web site map or in any other case linked. Google is not going to encounter a noindex tag on blocked pages because it can’t crawl them.
A robots.txt file can instruct net crawlers to disregard, for example, login pages, private archives, or pages ensuing from distinctive types and filters. Protect search bots’ crawl time on the elements you wish to rank.
