Hi all!
Just a simple thread to share how to "mask" our Joomla to avoid Web Archive to screenshot you website if you don't want (for x reason) to block automatic archiving.
Just add to your robots.txt:If you need to delete previously taken data from your website, you need to send an email to Archive website and to explain the reason of deletion.
Bye!![:)]( "Smiley")
Just a simple thread to share how to "mask" our Joomla to avoid Web Archive to screenshot you website if you don't want (for x reason) to block automatic archiving.
Just add to your robots.txt:
Code:
User-agent: ia_archiverDisallow: /User-agent: archive.org_botDisallow: /User-agent: ia_archiver-web.archive.orgDisallow: /Bye!
Statistics: Posted by stormbyte — Fri Dec 06, 2024 11:03 am