robots-txt 0.1.0.1 → 0.1.0.2

raw patch · 2 files changed

+3/−4 lines, 2 filesPVP: major bump suggested

API removals or changes: PVP suggests a major version bump

API changes (from Hackage documentation)

Files

• robots-txt.cabal +1/−1
• src/Network/HTTP/Robots.hs +2/−3

@@ -2,7 +2,7 @@ -- documentation, see http://haskell.org/cabal/users-guide/  name:                robots-txt-version:             0.1.0.1+version:             0.1.0.2 synopsis:            Parser for robots.txt description:         This is an attoparsec parser for robots.txt files homepage:            http://github.com/meanpath/robots-txt

@@ -16,15 +16,14 @@                | Disallow Path                | CrawlDelay Int   deriving (Show,Eq)--- this is an ugly hack, but i don't want to handle comments--- everywhere.++-- | parseRobots is the main entry point for parsing a robots.txt file. parseRobots :: ByteString -> Either String Robot parseRobots = parseOnly robotP               . BS.unlines               . filter ( (\x -> BS.null x || BS.head x /= '#' ) . BS.dropWhile (==' '))               . BS.lines -data Hole = Hole robotP :: Parser Robot robotP = many ((,) <$> agentP <*> many directiveP) <?> "robot"