Now you can watch the Internet Archive preserve documents in real time
9 comments
·May 23, 2025ignoramous
I am part of an informal group involved in actively archiving websites, and the ones behind Cloudflare Captchas are barely archive-able. I presumed Cloudflare had a deal with Archive.org but I guess it went no where? https://blog.cloudflare.com/cloudflares-always-online-and-th...
sadeshmukh
It's still a setting in their dashboard, but the site owner has to manually enable Always Online.
charcircuit
Are you using ios or macos to have access to private access tokens?
https://blog.cloudflare.com/eliminating-captchas-on-iphones-...
qingcharles
This looks like a useful solution for scraping. It doesn't prove you're a human, simply that you can afford to buy an iPhone. So buy the cheapest iPhone that supports this on eBay and then use that for scraping and archiving from now on.
lxgr
Given that these tokens are intentionally designed to distinguish human from bot traffic, I'd be surprised if they were (easily) available to archival tooling.
charcircuit
The URLSession API supports private access tokens (it's handled for you automatically) while your app is foregrounded.
https://developer.apple.com/documentation/foundation/urlsess...
Direct link: https://www.youtube.com/watch?v=aPg2V5RVh7U