Sie befinden sich hier: eisfair / Pack-Eis
News News News

Content

perl-www-robotrules (perl)

Perl - WWW::RobotRules (Offizielles Paket)

Version: 2.8.0 Status: stable Release Datum: 2018-01-28
Autor: the eisfair team, team(at)eisfair(dot)org
Internal Program Version: WWW::RobotRules  6.02

This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at http://www.robotstxt.org/wc/norobots.html
Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.

http://search.cpan.org/dist/WWW-RobotRules
SHA256-Prüfsumme: ac9d1fbad498d1b94c8c996395e270fb947fe4dfc1d98210c6b6adb28dbc62e6
Größe: 5.88 KByte
Info-Datei: https://www.pack-eis.de/dl.php?l=20979/perl-www-robotrules.tar.bz2.info
Benötigte Pakete: base 2.8.1
perl 2.8.0
perl-uri 2.8.0