This blog post is so I can share this rather than explain this over and over again.
robots.txt files are not used to block bots. They are used to help bots.
You see, a long time ago, indexing websites for search was expensive, and website owners wanted their sites to be indexed. So they created robots.txt files to help bots find the good content and avoid pages that aren't worth indexing.
If you're using robots.txt to try to block bots and scrapers, you're doing it wrong. You are hammering a nail with a bagel.