-
maxbittker Extr4Extr4 tarngerine NYT_first_said internetarchive obtusatum That all makes sense. Unfortunately I find that, for most scraping, the only way to get through is to pretend I'm Facebook. github.com/AramZS/contexter/blob/main/src/fetch-tools.js#L7
-
maxbittker Extr4Extr4 tarngerine NYT_first_said internetarchive obtusatum It does sort of make me think it would be interesting to go around and test which scraper UAs are more often privileged than others.
-
maxbittker Extr4Extr4 tarngerine NYT_first_said internetarchive obtusatum Also, hadn't really thought of this until now... but the death of UAs will provide some interesting challenges to scrapers and archives.