@DuckDuckGo at old.reddit.com/r/duckduckgo/wiki… you say you offer no way to submit sites. Well, then, please offer faster spidering of @microdotblog websites, because tonight G4e finds tbcg0222c but you do not. I've joined the #IndieWeb movement and am starting to rely on you more.
We'll see. I trust @DuckDuckGo to do the right thing and to be a friend of #IndieWeb.
1
Today I see that Google has added this thread to its results. _And_ it returns this thread in a third "#indieweb hashtag on Twitter" result. Now I'm finding this ironic. For timely results they are a far superior friend to the indie web, while @DuckDuckGo still shows 0 results.
I would expect that. I'm complaining that they seem to be slow to spider micro.blog/. I can't find anything I've written at tbc.micro.blog via @duckduckgo. That's what I mean by them not being a friend of #IndieWeb. Too hard to get content indexed by them.
1
None of these files even exist, so that's not their excuse. micro.blog/robots.txt tbc.micro.blog/robots.txt timchambersusa.com/robots.tx… They respect metacpan.org/pod/WWW::RobotR…. Seems to me if robots.txt doesn't exist, spidering would be allowed.
It's just the reader part of micro.blog that's javascript based. The actual blog content on ppls sites is all rendered out as static HTML

Mar 6, 2019 · 2:15 PM UTC

1