I have a problem with my magento store. Every now and then when a bot crawls my shop, the website goes down.
I have made changes to robots.txt and .htacces. Also varnish is installed and a full page cache.
But still it doesn't help. Does anybody have some tips what I can try?