• reddig33@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        5 months ago

        I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.

        • Evotech@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          You can just require a log in to view content, or just flat out auto ban indexing robots.