-
robinberjon mkramer I don't know if you'd need a shared crawler, crawling is easy and these days fairly cheap. You just need a shared crawler standard and an agreement to use a common user agent I think?On twitter.com
Mood +4 🙂
-
robinberjon mkramer I think this could get really interesting if it came together with Hyperdrive, your browsing than stands in for the crawler and your storage hosts an index which gets auto joined via connections, with larger servers using Hyper agents to pull federation into the standard web.Permalink On twitter.com
❤️ 2 Favorites
Mood +2 🙂