|
You could work with 2 robots.txt, one which allows, another which doesn't, and set up a cron job which executes a script to exchange them from time to time. Ask your host if you have managed hosting, should be easy to set up. If you have a dedicated server you could block the IP when you want to for a while.
|