Showerthoughts @lemmy.world irelephant [he/him]🍭 @lemm.ee 11mo ago Robots.txt is just a dni for scrapers.