added robots.txt

1 job for master in 5 minutes and 22 seconds (queued for 2 seconds)