miniterion performance measurements
+want to understand this report?
+overview
+
+
+
+ ⓘ
+
+
+
+
+
+ 
## Summary
@@ -16,10 +17,11 @@
[`tasty-bench`][tasty-bench]) should be easily done.
As in `criterion`, the executable built with the `defaultMain`
-supports selecting the running benchmarks with prefix match,
-case insensitive prefix match, substring match, or glob pattern match
-via the command line option. Invoke the benchmark executable with `--help`
-option to see other available options.
+supports selecting the running benchmarks with prefix match, case
+insensitive prefix match, substring match, or glob pattern match via
+the command line option. The executable has options to write CSV
+summary, JSON summary, and HTML report. Invoke the benchmark
+executable with `--help` option to see other available options.
## Motivation
@@ -30,11 +32,11 @@
other packages mentioned above.
The miniterion package is designed to have a small number of package
-dependencies. At the time of writing, the dependency packages are only
-two: `base` and `deepseq`. The miniterion package does not have rich
-features, but compared to other benchmarking packages, the package and
-benchmark executable should compile faster, and the resulting
-benchmark executable should be smaller.
+dependencies. At the time of writing, the direct dependency packages
+are only two: `base` and `deepseq`. The miniterion package does not
+have rich features, but compared to other benchmarking packages, the
+package and benchmark executable should compile faster, and the
+resulting benchmark executable should be smaller.
## Example
@@ -51,7 +53,7 @@
hs-source-dirs: bench
main-is: Main.hs
build-depends: base
- , miniterion
+ , miniterion
```
And in file `bench/Main.hs`:
@@ -61,7 +63,7 @@
import Miniterion
-fib :: Integer -> Integer
+fib :: Int -> Int
fib m | m < 0 = error "negative!"
| otherwise = go m
where
@@ -83,28 +85,37 @@
```console
$ cabal bench
-Build profile: -w ghc-9.6.2 -O1
+Build profile: -w ghc-9.14.1 -O1
In order, the following will be built (use -v for more details):
- - miniterion-0.1.0.0 (bench:fibo) (first run)
-Preprocessing benchmark 'fibo' for miniterion-0.1.0.0..
-Building benchmark 'fibo' for miniterion-0.1.0.0..
+ - miniterion-0.1.2.1 (bench:fibo) (ephemeral targets)
+Preprocessing benchmark 'fibo' for miniterion-0.1.2.1...
+Building benchmark 'fibo' for miniterion-0.1.2.1...
Running 1 benchmarks...
Benchmark fibo: RUNNING...
benchmarking fib/1
-mean 13.58 ns
-std dev 686.0 ps
+time 3.453 ns (3.426 ns .. 3.498 ns)
+ 0.998 R² (0.995 R² .. 1.000 R²)
+mean 3.434 ns (3.423 ns .. 3.451 ns)
+std dev 16.55 ps (2.983 ps .. 20.13 ps)
benchmarking fib/5
-mean 216.6 ns
-std dev 15.78 ns
+time 40.67 ns (40.60 ns .. 40.75 ns)
+ 1.000 R² (1.000 R² .. 1.000 R²)
+mean 40.78 ns (40.68 ns .. 40.88 ns)
+std dev 112.4 ps (7.561 ps .. 121.8 ps)
benchmarking fib/9
-mean 1.586 μs
-std dev 89.60 ns
+time 336.4 ns (335.6 ns .. 337.7 ns)
+ 1.000 R² (1.000 R² .. 1.000 R²)
+mean 335.7 ns (335.5 ns .. 335.8 ns)
+std dev 155.5 ps (4.366 ps .. 187.1 ps)
benchmarking fib/11
-mean 4.175 μs
-std dev 92.17 ns
+time 900.6 ns (899.5 ns .. 902.0 ns)
+ 1.000 R² (1.000 R² .. 1.000 R²)
+mean 899.7 ns (899.0 ns .. 900.2 ns)
+std dev 759.3 ps (67.06 ps .. 955.3 ps)
+variance introduced by outliers: 64% (severely inflated)
Benchmark fibo: FINISH
```
diff --git a/bench/Main.hs b/bench/Main.hs
--- a/bench/Main.hs
+++ b/bench/Main.hs
@@ -2,7 +2,7 @@
import Miniterion
-fib :: Integer -> Integer
+fib :: Int -> Int
fib m | m < 0 = error "negative!"
| otherwise = go m
where
diff --git a/data/template.html b/data/template.html
new file mode 100644
--- /dev/null
+++ b/data/template.html
@@ -0,0 +1,1155 @@
+
+
+
+
+ want to understand this report?
+