• helenslunch@feddit.nl
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    4 months ago

    How can they do that, logistically?

    Like I realize there’s a flag they can raise that asks not to be indexed but that’s not legally binding.

    • Evotech@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      I guess they can make it hard to index by scraping by rate limiting or requiring login to view content etc and only provide Google the api to bypass the restrictions

      There’s probably a lot of ways to do it