How to Control AI Crawlers: A Practical Guide to robots.txt, Nginx, and WAF Rules