# Robots.txt file from http://www.youjk.com # All robots will spider the domain # author zhangys@youjk.com 2009-02-05 User-agent:Python-urllib Disallow: / User-agent:larbin Disallow: / User-agent:GigaBot Disallow: / User-agent:SurveyBot Disallow: / User-agent:lwp-trivial Disallow: / User-agent:DoCoMo Disallow: / User-agent:BSpider Disallow: / User-agent: * Disallow: /background.do Disallow: /backgroundLogin.do Disallow: /webEditor/