Chronotope’s Twitter Archive—№ 140,186

mkramer You could probably hash the sites and then only re archive the sites whose hashes change. If you do this regularly and record the frequency of change that should give you a probability map of likely to change sites and then you could crank down the frequency you archive them.