Consider excluding crawlers by default

Anecdotally, we have had a number of users complain about their name and email address being made available to spiders. This could be done by adding a robots.txt file to a pod.

Solid, being a privacy first framework, should consider excluding crawlers by default.

It would be relatively easy subsequently to turn it on via a dashboard, or an app.

The downside to the approach is that an adoption vector of finding people via search engine is lost. And ability to create a social graph.

I'm personally unsure on the trade off here.

Good idea / Bad idea / Thoughts?

未指定任何檔案、測試或進入點。首先釐清排除 crawler 是否應為預設行為，以及使用者如何透過 dashboard 或 app 選擇加入，然後檢查 server 提供 pod 的行為。當形成一項已達成共識的政策和一份考量隱私與可發現性之間取捨的實作計畫時，即視為完成。