#Restrict bots User-agent: ahrefsbot User-agent: mauibot User-agent: semrushbot User-agent: blexbot User-agent: MJ12Bot Disallow: / User-agent: * Disallow: /403 Disallow: /404 Disallow: /secure/ Disallow: /person/ Disallow: /tender/view Disallow: /contract/view Disallow: /fpp/view