# robots.txt — psychomedia.it # Updated 2026-06-06 # All crawlers: stay out of the dead search alias and don't pull heavy media. User-agent: * Disallow: /motore/ Disallow: /sphider-1.3.4/ Disallow: /sphider-1.3.5/ Disallow: /*.mp4$ Disallow: /*.m4v$ Disallow: /*.mov$ Disallow: /*.mkv$ Disallow: /*.avi$ Disallow: /*.webm$ Disallow: /*.ogv$ Disallow: /*.ogg$ Disallow: /*.mp3$ Disallow: /*.m4a$ Disallow: /*.wav$ Disallow: /*.pdf$ Disallow: /*.zip$ Crawl-delay: 10 # SEO/backlink/AI scrapers with zero value to this site: out entirely. User-agent: Amazonbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: meta-externalagent Disallow: /