process-sequential (empty) → 0.1.0.0

raw patch · 5 files changed

+162/−0 lines, 5 filesdep +basedep +directorydep +mmsyn3setup-changed

Dependencies added: base, directory, mmsyn3, process, sublists

Files

• ChangeLog.md +5/−0
• LICENSE +20/−0
• Setup.hs +2/−0
• System/Process/Sequential.hs +109/−0
• process-sequential.cabal +26/−0

@@ -0,0 +1,5 @@+# Revision history for process-sequential++## 0.1.0.0 -- YYYY-mm-dd++* First version. Released on an unsuspecting world.

@@ -0,0 +1,20 @@+Copyright (c) 2021 OleksandrZhabenko++Permission is hereby granted, free of charge, to any person obtaining+a copy of this software and associated documentation files (the+"Software"), to deal in the Software without restriction, including+without limitation the rights to use, copy, modify, merge, publish,+distribute, sublicense, and/or sell copies of the Software, and to+permit persons to whom the Software is furnished to do so, subject to+the following conditions:++The above copyright notice and this permission notice shall be included+in all copies or substantial portions of the Software.++THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

@@ -0,0 +1,2 @@+import Distribution.Simple+main = defaultMain

@@ -0,0 +1,109 @@+-- |+-- Module      :  System.Process.Sequential+-- Copyright   :  (c) OleksandrZhabenko 2021+-- License     :  MIT+-- Stability   :  Experimental+-- Maintainer  :  olexandr543@yahoo.com+--+-- This library is intended to be a testsuite for some recursive multi file multiprocessment using some system executable+-- that processes multiple files creating the resulting one (the \"sox\" can be a good example).+-- +-- The purposes are to avoid leakage of resources if the+-- number of files are too great to be processed at once, to use multiple sequential processment schemes for the same+-- executable and to create to some extent complex processment environment. Nevertheless, there is no guarantees that+-- the test will be successful and such an environment can be created using such a scheme. Please, do not use at the moment+-- in the production without additional thorough testing.++module System.Process.Sequential where++import Data.List (isPrefixOf)+import Data.Maybe (mapMaybe, fromJust)+import Data.Monoid (mappend)+import System.Process (readProcessWithExitCode)+import System.Directory (listDirectory,doesFileExist,removeFile)+import System.Exit (ExitCode(..))+import EndOfExe (showE)+import Sublists (intoRegularSublists)++seqFlsReadProcessWithExitCode+  :: FilePath -- ^ A name of the executable that must be available inside the variable PATH.+  -> Int -- ^ A limiting parameter for the number of cycles.+  -> (String -> String) -- ^ A function to convert the name of the files in the current directory that are sequentially processed.+  -> String -- ^ A needed symbol sequence to be found firstly to filter the needed files to be processed by the first recursion pass.+  -> [Int] -- ^ A list of the length of the needed file sequences for the 'intoRegularSublists' function.+  -> ([Int] -> [Int]) -- ^ A function to change the previous parameter at the each step of recursive call.+  -> ([String] -> Int -> [String]) -- ^ A function to change the list of arguments applied after the file names as command line arguments for the executable. An 'Int' is used to additionally control the processment.+  -> [String] -- ^ A list of the first pass command line arguments for the executable after the file names.+  -> String -- ^ A parameter for the 'readProcessWithExitCode' -- the last one. Is often [].+  -> IO ([FilePath],[Int],[String],Int) -- ^ The result to be obtained if the processment is successful.+seqFlsReadProcessWithExitCode executable limK f searchNeedle1 ns g_N h_S xss ys = do+  ends1 <- seqFlsReadProcessWithExitCode1 executable f searchNeedle1 ns xss ys+  recursiveApplyFGH executable (limK - 1) f ends1 (g_N ns) g_N h_S (h_S xss (limK - 1)) ys++seqFlsReadProcessWithExitCode1+  :: FilePath -- ^ A name of the executable that must be available inside the variable PATH.+  -> (String -> String) -- ^ A function to convert the name of the files in the current directory that are sequentially processed.+  -> String -- ^ A needed symbol sequence to be found firstly to filter the needed files to be processed by the first recursion pass.+  -> [Int] -- ^ A list of the length of the needed file sequences for the 'intoRegularSublists' function.+  -> [String] -- ^ A list of the first pass command line arguments for the executable after the file names.+  -> String -- ^ A parameter for the 'readProcessWithExitCode' -- the last one. Is often [].+  -> IO [FilePath] -- ^ The result to be obtained if the processment is successful.+seqFlsReadProcessWithExitCode1 executable f searchNeedle ns xss ys = do+  dir <- listDirectory "."+  let zss = filter (isPrefixOf searchNeedle) dir+      yss = filter (not . null) . intoRegularSublists ns $ zss+      ends1 = map (f . last) yss+      y1ss = zipWith (\xss rs -> xss ++ [rs]) yss ends1+  mapM_ (\uss -> seqFlsHelp1 executable uss xss ys) y1ss+  return ends1++seqFlsReadProcessWithExitCode0+  :: FilePath -- ^ A name of the executable that must be available inside the variable PATH.+  -> (String -> String) -- ^ A function to convert the name of the files in the current directory that are sequentially processed.+  -> [Int] -- ^ A list of the length of the needed file sequences for the 'intoRegularSublists' function.+  -> [FilePath] -- ^ A list of the files that are processed (the existing ones plus the new one in that order).+  -> [String] -- ^ A list of the first pass command line arguments for the executable after the file names.+  -> String -- ^ A parameter for the 'readProcessWithExitCode' -- the last one. Is often [].+  -> IO ([FilePath],[Int],[String]) -- ^ The result to be obtained if the processment is successful.+seqFlsReadProcessWithExitCode0 executable f ns zss xss ys = do+  let yss = filter (not . null) . intoRegularSublists ns $ zss+      ends1 = map (f . last) yss+      y1ss = zipWith (\xss rs -> xss ++ [rs]) yss ends1+  mapM_ (\uss -> seqFlsHelp1 executable uss xss ys) y1ss+  return (ends1, ns, xss)++recursiveApplyFGH+  :: FilePath -- ^ A name of the executable that must be available inside the variable PATH.+  -> Int -- ^ A limiting parameter for the number of cycles.+  -> (String -> String) -- ^ A function to convert the name of the files in the current directory that are sequentially processed.+  -> [FilePath] -- ^ A list of the files that are processed (the existing ones plus the new one in that order).+  -> [Int] -- ^ A list of the length of the needed file sequences for the 'intoRegularSublists' function.+  -> ([Int] -> [Int]) -- ^ A function to change the previous parameter at the each step of recursive call.+  -> ([String] -> Int -> [String]) -- ^ A function to change the list of arguments applied after the file names as command line arguments for the executable. An 'Int' is used to additionally control the processment.+  -> [String] -- ^ A list of the first pass command line arguments for the executable after the file names.+  -> String -- ^ A parameter for the 'readProcessWithExitCode' -- the last one. Is often [].+  -> IO ([FilePath],[Int],[String],Int) -- ^ The result to be obtained if the processment is successful.+recursiveApplyFGH executable limK f zss ns g_N h_S xss ys+ | limK > 0 = do+  (ends1, ns, xss) <- seqFlsReadProcessWithExitCode0 executable f ns zss xss ys+  let newNs = g_N ns+      newXss = h_S xss (limK - 1)+  recursiveApplyFGH executable (limK - 1) f ends1 newNs g_N h_S newXss ys+ | otherwise = return (zss, ns, xss, limK)++seqFlsHelp1+  :: FilePath -- ^ A name of the executable that must be available inside the variable PATH.+  -> [FilePath] -- ^ A list of the files that are processed (the existing ones plus the new one in that order).+  -> [String] -- ^ A list of the first pass command line arguments for the executable after the file names.+  -> String -- ^ A parameter for the 'readProcessWithExitCode' -- the last one. Is often [].+  -> IO ExitCode -- ^ The result to be obtained. 'ExitSuccess' means that the processment was successful.+seqFlsHelp1 executable files args poststr = do+  (code,hout,herr) <- readProcessWithExitCode (fromJust (showE executable)) (files `mappend` args) poststr+  case code of+    ExitSuccess -> putStr hout+    _ -> do+      exi <- doesFileExist (last files)+      if exi then removeFile (last files) >> putStrLn "System.Process.Sequential.seqFlsHelp1: not successful operation. " >>+        putStrLn herr+      else putStrLn "System.Process.Sequential.seqFlsHelp1: not successful operation. " >> putStrLn herr+  return code

@@ -0,0 +1,26 @@+-- Initial process-sequential.cabal generated by cabal init.  For further+-- documentation, see http://haskell.org/cabal/users-guide/++name:                process-sequential+version:             0.1.0.0+synopsis:            A test suite for the complex multi files multi level processment.+description:         This library is intended to be a testsuite for some recursive multi file multiprocessment using some system executable that processes multiple files creating the resulting one (the \"sox\" can be a good example). The purposes are to avoid leakage of resources if the number of files are too great to be processed at once, to use multiple sequential processment schemes for the same executable and to create to some extent complex processment environment. Nevertheless, there is no guarantees that the test will be successful and such an environment can be created using such a scheme. Please, do not use at the moment in the production without additional thorough testing.+homepage:            https://hackage.haskell.org/package/process-sequential+license:             MIT+license-file:        LICENSE+author:              OleksandrZhabenko+maintainer:          olexandr543@yahoo.com+copyright:           Oleksandr Zhabenko+category:            System, Testing+build-type:          Simple+extra-source-files:  ChangeLog.md+cabal-version:       >=1.10++library+  exposed-modules:     System.Process.Sequential+  -- other-modules:+  -- other-extensions:+  build-depends:       base >=4.7 && <4.15, process >=1.4 && <1.9, directory >=1.2.7 && <1.7, mmsyn3 >=0.1.5 && <1, sublists >=0.1.1 && <1+  -- hs-source-dirs:+  default-language:    Haskell2010+