pandoc-emphasize-code (empty) → 0.1.0
raw patch · 15 files changed
+1181/−0 lines, 15 filesdep +basedep +filepathdep +hashablesetup-changed
Dependencies added: base, filepath, hashable, mtl, pandoc-emphasize-code, pandoc-types, process, tasty, tasty-discover, tasty-hspec, tasty-hunit, text, unordered-containers
Files
- LICENSE +373/−0
- Setup.hs +78/−0
- filter/Main.hs +21/−0
- pandoc-emphasize-code.cabal +61/−0
- src/Text/Pandoc/Filter/EmphasizeCode.hs +139/−0
- src/Text/Pandoc/Filter/EmphasizeCode/Chunking.hs +63/−0
- src/Text/Pandoc/Filter/EmphasizeCode/Parser.hs +74/−0
- src/Text/Pandoc/Filter/EmphasizeCode/Position.hs +42/−0
- src/Text/Pandoc/Filter/EmphasizeCode/Pretty.hs +47/−0
- src/Text/Pandoc/Filter/EmphasizeCode/Range.hs +119/−0
- test/Main.hs +1/−0
- test/Text/Pandoc/Filter/EmphasizeCode/ChunkingTest.hs +32/−0
- test/Text/Pandoc/Filter/EmphasizeCode/RangeTest.hs +51/−0
- test/Text/Pandoc/Filter/EmphasizeCode/Testing/Ranges.hs +15/−0
- test/Text/Pandoc/Filter/EmphasizeCodeTest.hs +65/−0
+ LICENSE view
@@ -0,0 +1,373 @@+Mozilla Public License Version 2.0+==================================++1. Definitions+--------------++1.1. "Contributor"+ means each individual or legal entity that creates, contributes to+ the creation of, or owns Covered Software.++1.2. "Contributor Version"+ means the combination of the Contributions of others (if any) used+ by a Contributor and that particular Contributor's Contribution.++1.3. "Contribution"+ means Covered Software of a particular Contributor.++1.4. "Covered Software"+ means Source Code Form to which the initial Contributor has attached+ the notice in Exhibit A, the Executable Form of such Source Code+ Form, and Modifications of such Source Code Form, in each case+ including portions thereof.++1.5. "Incompatible With Secondary Licenses"+ means++ (a) that the initial Contributor has attached the notice described+ in Exhibit B to the Covered Software; or++ (b) that the Covered Software was made available under the terms of+ version 1.1 or earlier of the License, but not also under the+ terms of a Secondary License.++1.6. "Executable Form"+ means any form of the work other than Source Code Form.++1.7. "Larger Work"+ means a work that combines Covered Software with other material, in + a separate file or files, that is not Covered Software.++1.8. "License"+ means this document.++1.9. "Licensable"+ means having the right to grant, to the maximum extent possible,+ whether at the time of the initial grant or subsequently, any and+ all of the rights conveyed by this License.++1.10. "Modifications"+ means any of the following:++ (a) any file in Source Code Form that results from an addition to,+ deletion from, or modification of the contents of Covered+ Software; or++ (b) any new file in Source Code Form that contains any Covered+ Software.++1.11. "Patent Claims" of a Contributor+ means any patent claim(s), including without limitation, method,+ process, and apparatus claims, in any patent Licensable by such+ Contributor that would be infringed, but for the grant of the+ License, by the making, using, selling, offering for sale, having+ made, import, or transfer of either its Contributions or its+ Contributor Version.++1.12. "Secondary License"+ means either the GNU General Public License, Version 2.0, the GNU+ Lesser General Public License, Version 2.1, the GNU Affero General+ Public License, Version 3.0, or any later versions of those+ licenses.++1.13. "Source Code Form"+ means the form of the work preferred for making modifications.++1.14. "You" (or "Your")+ means an individual or a legal entity exercising rights under this+ License. For legal entities, "You" includes any entity that+ controls, is controlled by, or is under common control with You. For+ purposes of this definition, "control" means (a) the power, direct+ or indirect, to cause the direction or management of such entity,+ whether by contract or otherwise, or (b) ownership of more than+ fifty percent (50%) of the outstanding shares or beneficial+ ownership of such entity.++2. License Grants and Conditions+--------------------------------++2.1. Grants++Each Contributor hereby grants You a world-wide, royalty-free,+non-exclusive license:++(a) under intellectual property rights (other than patent or trademark)+ Licensable by such Contributor to use, reproduce, make available,+ modify, display, perform, distribute, and otherwise exploit its+ Contributions, either on an unmodified basis, with Modifications, or+ as part of a Larger Work; and++(b) under Patent Claims of such Contributor to make, use, sell, offer+ for sale, have made, import, and otherwise transfer either its+ Contributions or its Contributor Version.++2.2. Effective Date++The licenses granted in Section 2.1 with respect to any Contribution+become effective for each Contribution on the date the Contributor first+distributes such Contribution.++2.3. Limitations on Grant Scope++The licenses granted in this Section 2 are the only rights granted under+this License. No additional rights or licenses will be implied from the+distribution or licensing of Covered Software under this License.+Notwithstanding Section 2.1(b) above, no patent license is granted by a+Contributor:++(a) for any code that a Contributor has removed from Covered Software;+ or++(b) for infringements caused by: (i) Your and any other third party's+ modifications of Covered Software, or (ii) the combination of its+ Contributions with other software (except as part of its Contributor+ Version); or++(c) under Patent Claims infringed by Covered Software in the absence of+ its Contributions.++This License does not grant any rights in the trademarks, service marks,+or logos of any Contributor (except as may be necessary to comply with+the notice requirements in Section 3.4).++2.4. Subsequent Licenses++No Contributor makes additional grants as a result of Your choice to+distribute the Covered Software under a subsequent version of this+License (see Section 10.2) or under the terms of a Secondary License (if+permitted under the terms of Section 3.3).++2.5. Representation++Each Contributor represents that the Contributor believes its+Contributions are its original creation(s) or it has sufficient rights+to grant the rights to its Contributions conveyed by this License.++2.6. Fair Use++This License is not intended to limit any rights You have under+applicable copyright doctrines of fair use, fair dealing, or other+equivalents.++2.7. Conditions++Sections 3.1, 3.2, 3.3, and 3.4 are conditions of the licenses granted+in Section 2.1.++3. Responsibilities+-------------------++3.1. Distribution of Source Form++All distribution of Covered Software in Source Code Form, including any+Modifications that You create or to which You contribute, must be under+the terms of this License. You must inform recipients that the Source+Code Form of the Covered Software is governed by the terms of this+License, and how they can obtain a copy of this License. You may not+attempt to alter or restrict the recipients' rights in the Source Code+Form.++3.2. Distribution of Executable Form++If You distribute Covered Software in Executable Form then:++(a) such Covered Software must also be made available in Source Code+ Form, as described in Section 3.1, and You must inform recipients of+ the Executable Form how they can obtain a copy of such Source Code+ Form by reasonable means in a timely manner, at a charge no more+ than the cost of distribution to the recipient; and++(b) You may distribute such Executable Form under the terms of this+ License, or sublicense it under different terms, provided that the+ license for the Executable Form does not attempt to limit or alter+ the recipients' rights in the Source Code Form under this License.++3.3. Distribution of a Larger Work++You may create and distribute a Larger Work under terms of Your choice,+provided that You also comply with the requirements of this License for+the Covered Software. If the Larger Work is a combination of Covered+Software with a work governed by one or more Secondary Licenses, and the+Covered Software is not Incompatible With Secondary Licenses, this+License permits You to additionally distribute such Covered Software+under the terms of such Secondary License(s), so that the recipient of+the Larger Work may, at their option, further distribute the Covered+Software under the terms of either this License or such Secondary+License(s).++3.4. Notices++You may not remove or alter the substance of any license notices+(including copyright notices, patent notices, disclaimers of warranty,+or limitations of liability) contained within the Source Code Form of+the Covered Software, except that You may alter any license notices to+the extent required to remedy known factual inaccuracies.++3.5. Application of Additional Terms++You may choose to offer, and to charge a fee for, warranty, support,+indemnity or liability obligations to one or more recipients of Covered+Software. However, You may do so only on Your own behalf, and not on+behalf of any Contributor. You must make it absolutely clear that any+such warranty, support, indemnity, or liability obligation is offered by+You alone, and You hereby agree to indemnify every Contributor for any+liability incurred by such Contributor as a result of warranty, support,+indemnity or liability terms You offer. You may include additional+disclaimers of warranty and limitations of liability specific to any+jurisdiction.++4. Inability to Comply Due to Statute or Regulation+---------------------------------------------------++If it is impossible for You to comply with any of the terms of this+License with respect to some or all of the Covered Software due to+statute, judicial order, or regulation then You must: (a) comply with+the terms of this License to the maximum extent possible; and (b)+describe the limitations and the code they affect. Such description must+be placed in a text file included with all distributions of the Covered+Software under this License. Except to the extent prohibited by statute+or regulation, such description must be sufficiently detailed for a+recipient of ordinary skill to be able to understand it.++5. Termination+--------------++5.1. The rights granted under this License will terminate automatically+if You fail to comply with any of its terms. However, if You become+compliant, then the rights granted under this License from a particular+Contributor are reinstated (a) provisionally, unless and until such+Contributor explicitly and finally terminates Your grants, and (b) on an+ongoing basis, if such Contributor fails to notify You of the+non-compliance by some reasonable means prior to 60 days after You have+come back into compliance. Moreover, Your grants from a particular+Contributor are reinstated on an ongoing basis if such Contributor+notifies You of the non-compliance by some reasonable means, this is the+first time You have received notice of non-compliance with this License+from such Contributor, and You become compliant prior to 30 days after+Your receipt of the notice.++5.2. If You initiate litigation against any entity by asserting a patent+infringement claim (excluding declaratory judgment actions,+counter-claims, and cross-claims) alleging that a Contributor Version+directly or indirectly infringes any patent, then the rights granted to+You by any and all Contributors for the Covered Software under Section+2.1 of this License shall terminate.++5.3. In the event of termination under Sections 5.1 or 5.2 above, all+end user license agreements (excluding distributors and resellers) which+have been validly granted by You or Your distributors under this License+prior to termination shall survive termination.++************************************************************************+* *+* 6. Disclaimer of Warranty *+* ------------------------- *+* *+* Covered Software is provided under this License on an "as is" *+* basis, without warranty of any kind, either expressed, implied, or *+* statutory, including, without limitation, warranties that the *+* Covered Software is free of defects, merchantable, fit for a *+* particular purpose or non-infringing. The entire risk as to the *+* quality and performance of the Covered Software is with You. *+* Should any Covered Software prove defective in any respect, You *+* (not any Contributor) assume the cost of any necessary servicing, *+* repair, or correction. This disclaimer of warranty constitutes an *+* essential part of this License. No use of any Covered Software is *+* authorized under this License except under this disclaimer. *+* *+************************************************************************++************************************************************************+* *+* 7. Limitation of Liability *+* -------------------------- *+* *+* Under no circumstances and under no legal theory, whether tort *+* (including negligence), contract, or otherwise, shall any *+* Contributor, or anyone who distributes Covered Software as *+* permitted above, be liable to You for any direct, indirect, *+* special, incidental, or consequential damages of any character *+* including, without limitation, damages for lost profits, loss of *+* goodwill, work stoppage, computer failure or malfunction, or any *+* and all other commercial damages or losses, even if such party *+* shall have been informed of the possibility of such damages. This *+* limitation of liability shall not apply to liability for death or *+* personal injury resulting from such party's negligence to the *+* extent applicable law prohibits such limitation. Some *+* jurisdictions do not allow the exclusion or limitation of *+* incidental or consequential damages, so this exclusion and *+* limitation may not apply to You. *+* *+************************************************************************++8. Litigation+-------------++Any litigation relating to this License may be brought only in the+courts of a jurisdiction where the defendant maintains its principal+place of business and such litigation shall be governed by laws of that+jurisdiction, without reference to its conflict-of-law provisions.+Nothing in this Section shall prevent a party's ability to bring+cross-claims or counter-claims.++9. Miscellaneous+----------------++This License represents the complete agreement concerning the subject+matter hereof. If any provision of this License is held to be+unenforceable, such provision shall be reformed only to the extent+necessary to make it enforceable. Any law or regulation which provides+that the language of a contract shall be construed against the drafter+shall not be used to construe this License against a Contributor.++10. Versions of the License+---------------------------++10.1. New Versions++Mozilla Foundation is the license steward. Except as provided in Section+10.3, no one other than the license steward has the right to modify or+publish new versions of this License. Each version will be given a+distinguishing version number.++10.2. Effect of New Versions++You may distribute the Covered Software under the terms of the version+of the License under which You originally received the Covered Software,+or under the terms of any subsequent version published by the license+steward.++10.3. Modified Versions++If you create software not governed by this License, and you want to+create a new license for such software, you may create and use a+modified version of this License if you rename the license and remove+any references to the name of the license steward (except to note that+such modified license differs from this License).++10.4. Distributing Source Code Form that is Incompatible With Secondary+Licenses++If You choose to distribute Source Code Form that is Incompatible With+Secondary Licenses under the terms of this version of the License, the+notice described in Exhibit B of this License must be attached.++Exhibit A - Source Code Form License Notice+-------------------------------------------++ This Source Code Form is subject to the terms of the Mozilla Public+ License, v. 2.0. If a copy of the MPL was not distributed with this+ file, You can obtain one at http://mozilla.org/MPL/2.0/.++If it is not possible or desirable to put the notice in a particular+file, then You may include the notice in a location (such as a LICENSE+file in a relevant directory) where a recipient would be likely to look+for such a notice.++You may add additional accurate notices of copyright ownership.++Exhibit B - "Incompatible With Secondary Licenses" Notice+---------------------------------------------------------++ This Source Code Form is "Incompatible With Secondary Licenses", as+ defined by the Mozilla Public License, v. 2.0.
+ Setup.hs view
@@ -0,0 +1,78 @@+import Distribution.PackageDescription+import Distribution.Simple+import Distribution.Simple.LocalBuildInfo+import Distribution.Simple.UserHooks+import Distribution.Simple.Setup++import System.Info+import System.Directory+import System.Environment+import System.Process+import System.FilePath++import Data.Maybe++main = defaultMainWithHooks simpleUserHooks { confHook = odenConfHook+ , postConf = odenPostConf }++addLibDirsToBuildInfo :: BuildInfo -> IO BuildInfo+addLibDirsToBuildInfo buildInfo = do+ wd <- getCurrentDirectory+ return $ buildInfo {+ extraLibDirs = wd : extraLibDirs buildInfo+ }++addLibDirsToOdenExe :: [Executable] -> IO [Executable]+addLibDirsToOdenExe = mapM addIfOden+ where+ addIfOden exe+ | exeName exe == "oden-exe" = do+ withLibDirs <- addLibDirsToBuildInfo (buildInfo exe)+ return $ exe { buildInfo = withLibDirs }+ | otherwise = return exe++addLibDirsToTests :: [TestSuite] -> IO [TestSuite]+addLibDirsToTests = mapM addLibDirs+ where+ addLibDirs suite = do+ withLibDirs <- addLibDirsToBuildInfo (testBuildInfo suite)+ return $ suite { testBuildInfo = withLibDirs }++odenConfHook :: (GenericPackageDescription, HookedBuildInfo)+ -> ConfigFlags+ -> IO LocalBuildInfo+odenConfHook (description, buildInfo) flags = do+ localBuildInfo <- confHook simpleUserHooks (description, buildInfo) flags+ let packageDescription = localPkgDescr localBuildInfo+ lib = fromJust $ library packageDescription++ libWithLibDirs <- addLibDirsToBuildInfo (libBuildInfo lib)+ executablesWithLibDirs <- addLibDirsToOdenExe (executables packageDescription)+ testSuitesWithLibDirs <- addLibDirsToTests (testSuites packageDescription)++ return $ localBuildInfo {+ localPkgDescr = packageDescription {+ library = Just $ lib {+ libBuildInfo = libWithLibDirs+ },+ executables = executablesWithLibDirs,+ testSuites = testSuitesWithLibDirs+ }+ }++ext :: String+ext = case os of+ "darwin" -> ".dylib"+ "windows" -> ".dll"+ _ -> ".so"++odenPostConf :: Args -> ConfigFlags -> PackageDescription -> LocalBuildInfo -> IO ()+odenPostConf _ _ _ _ = do+ wd <- getCurrentDirectory+ setEnv "GOPATH" (wd </> "go")++ let dynamicPath = wd </> ("libimporter" ++ ext)+ buildDynamic = shell ("go build -buildmode=c-shared -o " ++ dynamicPath ++ " oden/cmd/importer")++ putStrLn $ "Compiling Go dynamic library to " ++ dynamicPath+ readCreateProcess buildDynamic "" >>= putStr
+ filter/Main.hs view
@@ -0,0 +1,21 @@+{-# LANGUAGE LambdaCase #-}+module Main where++import System.Environment++import Text.Pandoc.JSON+import Text.Pandoc.Filter.EmphasizeCode++import Paths_pandoc_emphasize_code+import qualified Data.Version as Version++main :: IO ()+main =+ getArgs >>=+ \case+ (arg:_)+ | arg == "-V" -> showVersion+ | arg == "--version" -> showVersion+ _ -> toJSONFilter emphasizeCode+ where+ showVersion = putStrLn (Version.showVersion version)
+ pandoc-emphasize-code.cabal view
@@ -0,0 +1,61 @@+name: pandoc-emphasize-code+synopsis: A Pandoc filter for emphasizing code in fenced blocks+description:+ A Pandoc filter for emphasizing sections of code in fenced blocks.+author: Oskar Wickström+maintainer: Oskar Wickström+homepage: https://github.com/owickstrom/pandoc-emphasize-code+version: 0.1.0+cabal-version: >= 1.8+build-type: Simple+category: Documentation+license: MPL-2.0+license-file: LICENSE++source-repository head+ type: git+ location: git://github.com/owickstrom/pandoc-emphasize-code.git++library+ hs-source-dirs: src+ exposed-modules: Text.Pandoc.Filter.EmphasizeCode+ Text.Pandoc.Filter.EmphasizeCode.Position+ Text.Pandoc.Filter.EmphasizeCode.Range+ Text.Pandoc.Filter.EmphasizeCode.Chunking+ Text.Pandoc.Filter.EmphasizeCode.Parser+ Text.Pandoc.Filter.EmphasizeCode.Pretty+ build-depends: base >= 4 && < 5+ , unordered-containers >= 0.2 && < 0.3+ , process+ , hashable >= 1.2 && < 2+ , filepath+ , text >= 1.2 && < 1.3+ , mtl >= 2.2 && < 3+ , pandoc-types >= 1.12 && <= 1.19+ ghc-options: -Wall+++executable pandoc-emphasize-code+ hs-source-dirs: filter+ other-modules: Paths_pandoc_emphasize_code+ main-is: Main.hs+ build-depends: base >= 4 && < 5+ , pandoc-types >= 1.12 && <= 1.19+ , pandoc-emphasize-code++test-suite filter-tests+ type: exitcode-stdio-1.0+ hs-source-dirs: test+ main-is: Main.hs+ other-modules: Text.Pandoc.Filter.EmphasizeCodeTest+ Text.Pandoc.Filter.EmphasizeCode.RangeTest+ Text.Pandoc.Filter.EmphasizeCode.ChunkingTest+ Text.Pandoc.Filter.EmphasizeCode.Testing.Ranges+ build-depends: base >= 4 && < 5+ , unordered-containers >= 0.2 && < 0.3+ , pandoc-types >= 1.12 && <= 1.19+ , pandoc-emphasize-code+ , tasty+ , tasty-hunit+ , tasty-hspec+ , tasty-discover
+ src/Text/Pandoc/Filter/EmphasizeCode.hs view
@@ -0,0 +1,139 @@+{-# LANGUAGE CPP #-}+{-# LANGUAGE FlexibleContexts #-}+{-# LANGUAGE LambdaCase #-}+{-# LANGUAGE NamedFieldPuns #-}+{-# LANGUAGE OverloadedStrings #-}+{-# LANGUAGE ViewPatterns #-}++module Text.Pandoc.Filter.EmphasizeCode+ ( emphasizeCode+ ) where+#if MIN_VERSION_base(4,8,0)+import Data.Semigroup ((<>))+#else+import Control.Applicative+import Data.Monoid+#endif+import Data.Char (isSpace)+import qualified Data.HashMap.Strict as HM+import Data.Text (Text)+import qualified Data.Text as Text+import Text.Pandoc.JSON++import Text.Pandoc.Filter.EmphasizeCode.Chunking+import Text.Pandoc.Filter.EmphasizeCode.Parser+import Text.Pandoc.Filter.EmphasizeCode.Pretty+import Text.Pandoc.Filter.EmphasizeCode.Range++printAndFail :: ParseError -> IO a+printAndFail = fail . Text.unpack . printParseError++emphasizeChunkHtml :: LineChunk -> Text+emphasizeChunkHtml chunk =+ case chunk of+ Literal t -> t+ Emphasized t -> "<em>" <> t <> "</em>"++emphasizeRangeHtml ::+ (String, [String], [(String, String)]) -> EmphasizedLines -> Block+emphasizeRangeHtml (_, classes, _) lines' =+ RawBlock (Format "html") (Text.unpack emphasized)+ where+ classAttr =+ if null classes+ then ""+ else " class=\"" <> Text.pack (unwords classes) <> "\""+ emphasized =+ mconcat+ [ "<pre"+ , classAttr+ , "><code>"+ , Text.dropEnd+ 1+ (Text.unlines (map (foldMap emphasizeChunkHtml) lines'))+ , "</code>"+ , "</pre>"+ ]++emphasizeRangeMarkdown ::+ (String, [String], [(String, String)]) -> EmphasizedLines -> Block+emphasizeRangeMarkdown (_, classes, _) lines' =+ RawBlock (Format "html") (Text.unpack emphasized)+ where+ classAttr =+ if null classes+ then ""+ else " class=\"" <> Text.pack (unwords classes) <> "\""+ emphasized =+ mconcat+ [ "<pre"+ , classAttr+ , "><code>"+ , Text.dropEnd+ 1+ (Text.unlines (map (foldMap emphasizeChunkHtml) lines'))+ , "</code>"+ , "</pre>"+ ]++emphasizeRangeLatex ::+ (String, [String], [(String, String)]) -> EmphasizedLines -> Block+emphasizeRangeLatex (_, classes, _) lines' =+ RawBlock (Format "latex") (Text.unpack (encloseInVerbatim emphasized))+ where+ languageAttr =+ case classes of+ [lang] -> ",language=" <> Text.pack lang+ _ -> ""+ encloseInTextIt t+ | Text.null t = t+ | otherwise = "£\\CodeEmphasis{" <> t <> "}£"+ emphasizeNonSpace t+ | Text.null t = t+ | otherwise =+ let (nonSpace, rest) = Text.break isSpace t+ (spaces, rest') = Text.span isSpace rest+ in mconcat [encloseInTextIt nonSpace, spaces, emphasizeNonSpace rest']+ emphasizeChunk chunk =+ case chunk of+ Literal t -> t+ Emphasized t -> emphasizeNonSpace t+ emphasized = Text.unlines (map (foldMap emphasizeChunk) lines')+ encloseInVerbatim t =+ mconcat+ [ "\\begin{lstlisting}[escapechar=£"+ , languageAttr+ , "]\n"+ , t+ , "\\end{lstlisting}\n"+ ]++type Emphasizer+ = (String, [String], [(String, String)]) -> EmphasizedLines -> Block++asEmphasizer :: Format -> Maybe Emphasizer+asEmphasizer f+ | f `elem` ["html", "html5"] = Just emphasizeRangeHtml+ | f == "markdown_github" = Just emphasizeRangeMarkdown+ | f == "latex" = Just emphasizeRangeLatex+ | f == "beamer" = Just emphasizeRangeLatex+ | otherwise = Nothing++lookupRanges :: HM.HashMap String String -> Maybe Text.Text+lookupRanges attrs = Text.pack <$> HM.lookup "emphasize" attrs++-- | A Pandoc filter that emphasizes code blocks.+emphasizeCode :: Maybe Format -> Block -> IO Block+emphasizeCode (Just (asEmphasizer -> Just emphasizer)) cb@(CodeBlock (id', classes, attrs) contents) =+ case lookupRanges attrs' >>= (runParser . parseRanges) of+ Just (Right ranges) ->+ let lines' = emphasizeRanges (splitRanges ranges) (Text.pack contents)+ in return+ (emphasizer+ (id', classes, HM.toList (HM.delete "emphasize" attrs'))+ lines')+ Just (Left err) -> printAndFail err+ Nothing -> return cb+ where+ attrs' = HM.fromList attrs+emphasizeCode _ x = return x
+ src/Text/Pandoc/Filter/EmphasizeCode/Chunking.hs view
@@ -0,0 +1,63 @@+{-# LANGUAGE CPP #-}+{-# LANGUAGE OverloadedStrings #-}++module Text.Pandoc.Filter.EmphasizeCode.Chunking+ ( LineChunk(..)+ , EmphasizedLine+ , EmphasizedLines+ , emphasizeRanges+ ) where++import Data.HashMap.Strict (HashMap)+import qualified Data.HashMap.Strict as HashMap+import Data.List (foldl')+import Data.Text (Text)+import qualified Data.Text as Text++import Text.Pandoc.Filter.EmphasizeCode.Position+import Text.Pandoc.Filter.EmphasizeCode.Range++data LineChunk+ = Literal Text+ | Emphasized Text+ deriving (Show, Eq)++chunkText :: LineChunk -> Text+chunkText (Literal t) = t+chunkText (Emphasized t) = t++type EmphasizedLine = [LineChunk]++type EmphasizedLines = [EmphasizedLine]++emphasizeRanges :: HashMap Line [LineRange] -> Text -> EmphasizedLines+emphasizeRanges ranges contents = zipWith chunkLine (Text.lines contents) [1 ..]+ where+ chunkLine line' lineNr =+ let (rest, _, chunks) =+ foldl'+ chunkRange+ (line', 0, [])+ (HashMap.lookupDefault [] lineNr ranges)+ in filter (not . Text.null . chunkText) (chunks ++ [Literal rest])+ chunkRange ::+ (Text, Column, EmphasizedLine)+ -> LineRange+ -> (Text, Column, EmphasizedLine)+ chunkRange (lineText, offset, chunks) r =+ case Text.splitAt startIndex lineText of+ (before, rest) ->+ case lineRangeEnd r of+ Just end ->+ let endIndex = fromIntegral (end - offset) - Text.length before+ (emph, rest') = Text.splitAt endIndex rest+ newOffset =+ offset ++ fromIntegral (Text.length lineText - Text.length rest')+ in (rest', newOffset, chunks ++ [Literal before, Emphasized emph])+ Nothing ->+ ( ""+ , offset + fromIntegral (Text.length lineText)+ , chunks ++ [Literal before, Emphasized rest])+ where+ startIndex = fromIntegral (lineRangeStart r - 1 - offset)
+ src/Text/Pandoc/Filter/EmphasizeCode/Parser.hs view
@@ -0,0 +1,74 @@+{-# LANGUAGE CPP #-}+{-# LANGUAGE FlexibleContexts #-}+{-# LANGUAGE NamedFieldPuns #-}+{-# LANGUAGE OverloadedStrings #-}++module Text.Pandoc.Filter.EmphasizeCode.Parser+ ( Parser+ , ParseError(..)+ , parseRanges+ , runParser+ ) where++import Control.Monad.Except+import Data.Text (Text)+import qualified Data.Text as Text+import Text.Read (readMaybe)++import Text.Pandoc.Filter.EmphasizeCode.Position+import Text.Pandoc.Filter.EmphasizeCode.Range++type Parser a = ExceptT ParseError Maybe a++data ParseError+ = InvalidRange Position+ Position+ | InvalidRanges RangesError+ | InvalidRangeFormat Text+ | InvalidPosition Line+ Column+ | InvalidPositionFormat Text+ | InvalidLineNumber Text+ | InvalidColumnNumber Text+ deriving (Show, Eq)++parseMaybe :: Read a => Text -> (Text -> ParseError) -> Parser a+parseMaybe t mkError =+ case readMaybe (Text.unpack t) of+ Just x -> pure x+ Nothing -> throwError (mkError t)++split2 :: MonadError e m => Text -> Text -> (Text -> e) -> m (Text, Text)+split2 sep t err =+ case Text.splitOn sep t of+ [before, after] -> return (before, after)+ _ -> throwError (err t)++parsePosition :: Text -> Parser Position+parsePosition t = do+ (line, col) <- split2 ":" t InvalidPositionFormat+ line' <- Line <$> parseMaybe line InvalidLineNumber+ col' <- Column <$> parseMaybe col InvalidColumnNumber+ case mkPosition line' col' of+ Just position -> pure position+ Nothing -> throwError (InvalidPosition line' col')++parseRange :: Text -> Parser Range+parseRange t = do+ (startStr, endStr) <- split2 "-" t InvalidRangeFormat+ start <- parsePosition startStr+ end <- parsePosition endStr+ case mkRange start end of+ Just range -> pure range+ Nothing -> throwError (InvalidRange start end)++parseRanges :: Text -> Parser Ranges+parseRanges t = do+ let strs = filter (not . Text.null) (map Text.strip (Text.splitOn "," t))+ rs <- mapM parseRange strs+ case mkRanges rs of+ Left err -> throwError (InvalidRanges err)+ Right ranges -> pure ranges++runParser :: Parser a -> Maybe (Either ParseError a)+runParser = runExceptT
+ src/Text/Pandoc/Filter/EmphasizeCode/Position.hs view
@@ -0,0 +1,42 @@+{-# LANGUAGE GeneralizedNewtypeDeriving #-}++-- | A position that cannot be constructed with incorrect bounds.+module Text.Pandoc.Filter.EmphasizeCode.Position+ ( Line(..)+ , Column(..)+ , Position+ , line+ , column+ , mkPosition+ , positionToTuple+ ) where++import Data.Hashable++newtype Line =+ Line Word+ deriving (Show, Eq, Ord, Num, Enum, Real, Integral, Hashable)++newtype Column =+ Column Word+ deriving (Show, Eq, Ord, Num, Enum, Real, Integral, Hashable)++data Position = Position+ { line :: Line+ , column :: Column+ } deriving (Eq, Show)++instance Ord Position where+ Position r1 c1 `compare` Position r2 c2+ | r1 < r2 = LT+ | r1 == r2 && c1 == c2 = EQ+ | r1 == r2 && c1 < c2 = LT+ | otherwise = GT++mkPosition :: Line -> Column -> Maybe Position+mkPosition r c+ | r > 0 && c > 0 = Just (Position r c)+ | otherwise = Nothing++positionToTuple :: Position -> (Line, Column)+positionToTuple (Position l c) = (l, c)
+ src/Text/Pandoc/Filter/EmphasizeCode/Pretty.hs view
@@ -0,0 +1,47 @@+{-# LANGUAGE CPP #-}+{-# LANGUAGE OverloadedStrings #-}++module Text.Pandoc.Filter.EmphasizeCode.Pretty where+#if MIN_VERSION_base(4,8,0)+import Data.Semigroup ((<>))+#else+import Control.Applicative+import Data.Monoid+#endif+import Data.Text (Text)+import qualified Data.Text as Text++import Text.Pandoc.Filter.EmphasizeCode.Parser+import Text.Pandoc.Filter.EmphasizeCode.Position+import Text.Pandoc.Filter.EmphasizeCode.Range++printLine :: Line -> Text+printLine (Line n) = Text.pack (show n)++printColumn :: Column -> Text+printColumn (Column n) = Text.pack (show n)++printPosition :: Position -> Text+printPosition p = printLine (line p) <> ":" <> printColumn (column p)++printRange :: Range -> Text+printRange r = printPosition (rangeStart r) <> "-" <> printPosition (rangeEnd r)++printRangesError :: RangesError -> Text+printRangesError err =+ case err of+ EmptyRanges -> "At least one range is required"+ Overlap r1 r2 -> printRange r1 <> " overlaps with " <> printRange r2++printParseError :: ParseError -> Text+printParseError err =+ case err of+ InvalidRange start end ->+ "Invalid range: " <> printPosition start <> " to " <> printPosition end+ InvalidRanges rangesErr -> printRangesError rangesErr+ InvalidRangeFormat t -> "Invalid range: " <> t+ InvalidPosition line' column' ->+ "Invalid position: " <> printLine line' <> " to " <> printColumn column'+ InvalidPositionFormat t -> "Invalid position: " <> t+ InvalidLineNumber n -> "Invalid line number: " <> n+ InvalidColumnNumber n -> "Invalid column number: " <> n
+ src/Text/Pandoc/Filter/EmphasizeCode/Range.hs view
@@ -0,0 +1,119 @@+{-# LANGUAGE CPP #-}++-- | Ranges that cannot be constructed with incorrect bounds.+module Text.Pandoc.Filter.EmphasizeCode.Range+ ( Range+ , rangeStart+ , rangeEnd+ , mkRange+ , rangeToTuple+ , rangeToTuples+ , lineIntersectsWithRange+ , Ranges+ , rangesToList+ , RangesError(..)+ , mkRanges+ , LineRange+ , lineRangeLine+ , lineRangeStart+ , lineRangeEnd+ , mkLineRange+ , splitRanges+ ) where+#if MIN_VERSION_base(4,8,0)+import Data.Semigroup ((<>))+#else+import Control.Applicative+import Data.Monoid+#endif+import Control.Monad (foldM_, when)+import Data.HashMap.Strict (HashMap)+import qualified Data.HashMap.Strict as HashMap+import Data.List (sortOn)++import Text.Pandoc.Filter.EmphasizeCode.Position++data Range = Range+ { rangeStart :: Position+ , rangeEnd :: Position+ } deriving (Eq, Show)++mkRange :: Position -> Position -> Maybe Range+mkRange s e+ | s < e = Just (Range s e)+ | otherwise = Nothing++rangeToTuple :: Range -> (Position, Position)+rangeToTuple (Range p1 p2) = (p1, p2)++rangeToTuples :: Range -> ((Line, Column), (Line, Column))+rangeToTuples r =+ let (p1, p2) = rangeToTuple r+ in (positionToTuple p1, positionToTuple p2)++rangesAreDisjoint :: Range -> Range -> Bool+rangesAreDisjoint (Range s1 e1) (Range s2 e2) =+ (s1 < s2 && e1 < e2) || (s2 < s1 && e2 < e1)++rangeIntersects :: Range -> Range -> Bool+rangeIntersects r1 r2 = not (rangesAreDisjoint r1 r2)++lineIntersectsWithRange :: Line -> Range -> Bool+lineIntersectsWithRange l (Range start end) = line start <= l && line end >= l++newtype Ranges =+ Ranges [Range]+ deriving (Eq, Show)++rangesToList :: Ranges -> [Range]+rangesToList (Ranges rs) = rs++data RangesError+ = EmptyRanges+ | Overlap Range+ Range+ deriving (Show, Eq)++mkRanges :: [Range] -> Either RangesError Ranges+mkRanges [] = Left EmptyRanges+mkRanges ranges = do+ let sorted = sortOn rangeStart ranges+ foldM_ checkOverlap Nothing sorted+ pure (Ranges sorted)+ where+ checkOverlap (Just last') this = do+ when (last' `rangeIntersects` this) $ Left (Overlap last' this)+ return (Just this)+ checkOverlap Nothing this = return (Just this)++data LineRange = LineRange+ { lineRangeLine :: Line+ , lineRangeStart :: Column+ , lineRangeEnd :: Maybe Column+ } deriving (Eq, Show)++mkLineRange :: Line -> Column -> Maybe Column -> Maybe LineRange+mkLineRange line' start (Just end)+ | line' > 0 && start < end = Just (LineRange line' start (Just end))+mkLineRange line' start Nothing+ | line' > 0 = Just (LineRange line' start Nothing)+mkLineRange _ _ _ = Nothing++rangeToLineRanges :: Range -> [LineRange]+rangeToLineRanges r@Range {rangeStart = p1, rangeEnd = p2}+ | line p1 == line p2 = [LineRange (line p1) (column p1) (Just (column p2))]+ | line p2 > line p1 =+ let startLine = LineRange (line p1) (column p1) Nothing+ endLine = LineRange (line p2) 1 (Just (column p2))+ middleLines =+ [LineRange n 1 Nothing | n <- [succ (line p1) .. pred (line p2)]]+ in startLine : middleLines ++ [endLine]+ | otherwise = error ("'Range' has invalid positions: " ++ show r)++splitRanges :: Ranges -> HashMap Line [LineRange]+splitRanges ranges =+ HashMap.fromListWith+ (flip (<>))+ [ (lineRangeLine lr, [lr])+ | lr <- concatMap rangeToLineRanges (rangesToList ranges)+ ]
+ test/Main.hs view
@@ -0,0 +1,1 @@+{-# OPTIONS_GHC -F -pgmF tasty-discover #-}
+ test/Text/Pandoc/Filter/EmphasizeCode/ChunkingTest.hs view
@@ -0,0 +1,32 @@+{-# LANGUAGE OverloadedStrings #-}+{-# OPTIONS_GHC -fno-warn-missing-signatures #-}++module Text.Pandoc.Filter.EmphasizeCode.ChunkingTest where++import Test.Tasty.Hspec++import Text.Pandoc.Filter.EmphasizeCode.Chunking+import Text.Pandoc.Filter.EmphasizeCode.Range+import Text.Pandoc.Filter.EmphasizeCode.Testing.Ranges++spec_emphasizeRanges = do+ it "emphasizes a single line range" $ do+ rs <- splitRanges <$> mkRanges' [((1, 1), (1, 7))]+ emphasizeRanges rs "hello world" `shouldBe`+ [[Emphasized "hello w", Literal "orld"]]+ it "emphasizes multiple line ranges on a single line" $ do+ rs <- splitRanges <$> mkRanges' [((1, 1), (1, 3)), ((1, 5), (1, 8))]+ emphasizeRanges rs "hello world" `shouldBe`+ [[Emphasized "hel", Literal "l", Emphasized "o wo", Literal "rld"]]+ it "emphasizes multiple line ranges on multiple lines" $ do+ rs <-+ splitRanges <$>+ mkRanges' [((1, 1), (1, 5)), ((1, 7), (2, 3)), ((4, 5), (4, 10))]+ emphasizeRanges rs "hello world\nhej världen\nhallo welt\nhei verden" `shouldBe`+ [ [Emphasized "hello", Literal " ", Emphasized "world"]+ , [Emphasized "hej", Literal " världen"]+ , [Literal "hallo welt"]+ , [Literal "hei ", Emphasized "verden"]+ ]++{-# ANN module ("HLint: ignore Use camelCase" :: String) #-}
+ test/Text/Pandoc/Filter/EmphasizeCode/RangeTest.hs view
@@ -0,0 +1,51 @@+{-# OPTIONS_GHC -fno-warn-missing-signatures #-}++module Text.Pandoc.Filter.EmphasizeCode.RangeTest where++import qualified Data.HashMap.Strict as HashMap+import Data.Maybe (mapMaybe)+import Test.Tasty.Hspec++import Text.Pandoc.Filter.EmphasizeCode.Position+import Text.Pandoc.Filter.EmphasizeCode.Range+import Text.Pandoc.Filter.EmphasizeCode.Testing.Ranges++makeLineRanges :: [(Line, Column, Maybe Column)] -> [LineRange]+makeLineRanges = mapMaybe mkLineRange'+ where+ mkLineRange' (line', start, end) = mkLineRange line' start end++spec_mkRanges = do+ it "sorts ranges" $ do+ rs <- mkRanges' [((1, 1), (1, 7)), ((4, 1), (7, 2)), ((1, 8), (3, 4))]+ map rangeToTuples (rangesToList rs) `shouldBe`+ [((1, 1), (1, 7)), ((1, 8), (3, 4)), ((4, 1), (7, 2))]+ it "does not accept empty ranges" $+ mkRanges' [] `shouldThrow` anyException++spec_splitRanges = do+ it "splits one range into line ranges" $ do+ rs <- mkRanges' [((1, 1), (1, 7))]+ let lrs = HashMap.fromList [(1, makeLineRanges [(1, 1, Just 7)])]+ splitRanges rs `shouldBe` lrs+ it "splits two ranges into line ranges" $ do+ rs <- mkRanges' [((1, 1), (1, 7)), ((1, 8), (2, 2))]+ let lrs =+ HashMap.fromList+ [ (1, makeLineRanges [(1, 1, Just 7), (1, 8, Nothing)])+ , (2, makeLineRanges [(2, 1, Just 2)])+ ]+ splitRanges rs `shouldBe` lrs+ it "splits multiple ranges into line ranges" $ do+ rs <- mkRanges' [((1, 1), (1, 7)), ((1, 8), (3, 4)), ((8, 2), (10, 2))]+ let lrs =+ HashMap.fromList+ [ (1, makeLineRanges [(1, 1, Just 7), (1, 8, Nothing)])+ , (2, makeLineRanges [(2, 1, Nothing)])+ , (3, makeLineRanges [(3, 1, Just 4)])+ , (8, makeLineRanges [(8, 2, Nothing)])+ , (9, makeLineRanges [(9, 1, Nothing)])+ , (10, makeLineRanges [(10, 1, Just 2)])+ ]+ splitRanges rs `shouldBe` lrs+{-# ANN module ("HLint: ignore Use camelCase" :: String) #-}
+ test/Text/Pandoc/Filter/EmphasizeCode/Testing/Ranges.hs view
@@ -0,0 +1,15 @@+module Text.Pandoc.Filter.EmphasizeCode.Testing.Ranges where++import Data.Maybe (mapMaybe)++import Text.Pandoc.Filter.EmphasizeCode.Position+import Text.Pandoc.Filter.EmphasizeCode.Range++mkRanges' :: [((Line, Column), (Line, Column))] -> IO Ranges+mkRanges' rs = either (fail . show) return (mkRanges (mapMaybe makeRange rs))+ where+ makeRange ((r1, c1), (r2, c2)) = do+ p1 <- mkPosition r1 c1+ p2 <- mkPosition r2 c2+ mkRange p1 p2+
+ test/Text/Pandoc/Filter/EmphasizeCodeTest.hs view
@@ -0,0 +1,65 @@+{-# LANGUAGE OverloadedStrings #-}+{-# OPTIONS_GHC -fno-warn-missing-signatures #-}++module Text.Pandoc.Filter.EmphasizeCodeTest where++import Test.Tasty.Hspec++import qualified Text.Pandoc.Filter.EmphasizeCode as Filter+import Text.Pandoc.JSON++(@@?=) :: (Eq a, Show a) => IO a -> a -> IO ()+(@@?=) a b = a >>= (`shouldBe` b)++emphasizeCode :: Format -> String -> IO Block+emphasizeCode format ranges =+ Filter.emphasizeCode+ (Just format)+ (CodeBlock+ ("", ["my-lang"], [("emphasize", ranges)])+ "hello world\nhej världen\nhallo welt\nhei verden")++spec_emphasizeCode = do+ it "emphasizes HTML and a single range" $+ emphasizeCode "html5" "2:5-3:5" @@?=+ RawBlock+ "html"+ (mconcat+ [ "<pre class=\"my-lang\"><code>hello world\n"+ , "hej <em>världen</em>\n"+ , "<em>hallo</em> welt\n"+ , "hei verden</code></pre>"+ ])+ it "emphasizes HTML and a single range over multiple lines" $+ emphasizeCode "html5" "2:5-4:3" @@?=+ RawBlock+ "html"+ (mconcat+ [ "<pre class=\"my-lang\"><code>hello world\n"+ , "hej <em>världen</em>\n"+ , "<em>hallo welt</em>\n"+ , "<em>hei</em> verden</code></pre>"+ ])+ it "emphasizes HTML and multiple ranges" $+ emphasizeCode "html5" "1:1-1:5,2:5-3:5" @@?=+ RawBlock+ "html"+ (mconcat+ [ "<pre class=\"my-lang\"><code><em>hello</em> world\n"+ , "hej <em>världen</em>\n"+ , "<em>hallo</em> welt\n"+ , "hei verden</code></pre>"+ ])+ it "emphasizes latex and multiple ranges" $+ emphasizeCode "latex" "1:1-1:5,2:5-3:5" @@?=+ RawBlock+ "latex"+ (mconcat+ [ "\\begin{lstlisting}[escapechar=£,language=my-lang]\n"+ , "£\\CodeEmphasis{hello}£ world\n"+ , "hej £\\CodeEmphasis{världen}£\n"+ , "£\\CodeEmphasis{hallo}£ welt\n"+ , "hei verden\n"+ , "\\end{lstlisting}\n"+ ])+{-# ANN module ("HLint: ignore Use camelCase" :: String) #-}