diff options
Diffstat (limited to 'perl/perl-www-robotrules/slack-desc')
-rw-r--r-- | perl/perl-www-robotrules/slack-desc | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/perl/perl-www-robotrules/slack-desc b/perl/perl-www-robotrules/slack-desc new file mode 100644 index 0000000000000..a9900b5749f0d --- /dev/null +++ b/perl/perl-www-robotrules/slack-desc @@ -0,0 +1,18 @@ +# HOW TO EDIT THIS FILE: +# The handy ruler below makes it easier to edit a package description. Line +# up the first '|' above the ':' following the base package name, and the '|' on +# the right side marks the last column you can put a character in. You must make +# exactly 11 lines for the formatting to be correct. It's also customary to +# leave one space after the ':'. +# |----------------------------------------------------------| +perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms) +perl-www-robotrules: +perl-www-robotrules: This perl module parses /robots.txt files as specified +perl-www-robotrules: in "A Standard for Robot Exclusion". Webmasters can use +perl-www-robotrules: the /robots.txt file to forbid conforming robots from +perl-www-robotrules: accessing parts of their web site +perl-www-robotrules: +perl-www-robotrules: http://search.cpan.org/dist/WWW-RobotRules/ +perl-www-robotrules: +perl-www-robotrules: +perl-www-robotrules: |