• 0 Posts
  • 573 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle



  • TBF, pushing a site to the public while adding a “no scrapping” rule is a bit of a shitty practice; and pushing it and adding a “no scrapping, unless you are Google” is a giant shitty practice.

    Rules for politely scrapping the site are fine. But then, there will be always people that disobey those, so you must also actively enforce those rules too. So I’m not sure robots.txt is really useful at all.













  • marcos@lemmy.worldtoMicroblog Memes@lemmy.worldOutstanding idea.
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    4
    ·
    8 days ago

    The return is delayed because they decided to run a lot of extra experiments on their experimental capsule.

    I’m not saying it’s not fucked-up. The extra experiments are all because there’s a lot of stuff that must be fixed or else they’ll get a really pissed-off customer. But it’s not just stuck there because it can’t return.