Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I think they work off of current robots.txt so if you purchase a domain name update the robots.txt to not allow archive.org they delete the entire history.

Which sucks in an archival perspective.



Yeah, they really ought to work from the version of robots.txt archived along with a given snapshot. If the legal owner of the content wants it taken down, they can submit an explicit request for that.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: