mirror of
https://github.com/johnkerl/miller.git
synced 2026-01-24 02:36:15 +00:00
doc neaten
This commit is contained in:
John Kerl
parent
6e16b05f47
commit
addf8d3604
29 changed files with 561 additions and 811 deletions
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -1,7 +1,7 @@
|
|||
|
||||
<p/>
|
||||
<center>
|
||||
<boldmaroon>Comparing verbs and DSL</boldmaroon>
|
||||
<boldmaroon>Stats with and without out-of-stream variables</boldmaroon>
|
||||
</center>
|
||||
|
||||
POKI_PUT_TOC_HERE
|
||||
|
|
@ -15,6 +15,117 @@ POKI_PUT_TOC_HERE
|
|||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_overview');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_overview" style="display: block">
|
||||
|
||||
<p/> To do.
|
||||
<p/> One of Miller’s strengths is its compact notation: for example, given input of the form
|
||||
|
||||
POKI_RUN_COMMAND{{head -n 5 ../data/medium}}HERE
|
||||
|
||||
you can simply do
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a sum -f x ../data/medium}}HERE
|
||||
|
||||
or
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a sum -f x -g b ../data/medium}}HERE
|
||||
|
||||
rather than the more tedious
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-sum.sh)HERE
|
||||
|
||||
or
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-sum-grouped.sh)HERE
|
||||
|
||||
<p/> The former (<tt>mlr stats1</tt> et al.) has the advantages of being easier
|
||||
to type, being less error-prone to type, and running faster.
|
||||
|
||||
<p/> Nonetheless, out-of-stream variables (which I whimsically call
|
||||
<i>oosvars</i>), begin/end blocks, and emit statements give you the ability to
|
||||
implement logic — if you wish to do so — which isn’t present
|
||||
in other Miller verbs. (If you find yourself often using the same
|
||||
out-of-stream-variable logic over and over, please file a request at <a
|
||||
href="https://github.com/johnkerl/miller/issues">https://github.com/johnkerl/miller/issues</a>
|
||||
to get it implemented directly in C as a Miller verb of its own.)
|
||||
|
||||
<p/> The following examples compute some things using oosvars which are already
|
||||
computable using Miller verbs, by way of providing food for thought.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_mean" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a mean -f x data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/mean-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_mean" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a mean -f x -g a,b data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/keyed-mean-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Variance and standard deviation without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_var_stddev');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_var_stddev" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a count,sum,mean,var,stddev -f x data/medium}}HERE
|
||||
POKI_RUN_COMMAND{{cat variance.mlr}}HERE
|
||||
POKI_RUN_COMMAND{{mlr --oxtab put -q -f variance.mlr data/medium}}HERE
|
||||
|
||||
You can also do this keyed, of course, imitating the keyed-mean example above.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_min_max" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a min,max -f x data/medium}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab put -q '@x_min = min(@x_min, $x); @x_max = max(@x_max, $x); end{emitf @x_min, @x_max}' data/medium}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_min_max" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a min,max -f x -g a data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/keyed-min-max-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_delta" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint step -a delta -f x data/small}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint put '$x_delta = is_present(@last) ? $x - @last : 0; @last = $x' data/small}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_delta" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint step -a delta -f x -g a data/small}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint put '$x_delta = is_present(@last[$a]) ? $x - @last[$a] : 0; @last[$a]=$x' data/small}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Exponentially weighted moving averages without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_ewma');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_ewma" style="display: block">
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(verb-example-ewma.sh)HERE
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-ewma.sh)HERE
|
||||
|
||||
</div>
|
||||
|
|
|
|||
|
|
@ -1,131 +0,0 @@
|
|||
|
||||
<p/>
|
||||
<center>
|
||||
<boldmaroon>Stats with and without out-of-stream variables</boldmaroon>
|
||||
</center>
|
||||
|
||||
POKI_PUT_TOC_HERE
|
||||
|
||||
<p/>
|
||||
<button style="font-weight:bold;color:maroon;border:0" onclick="expand_all();" href="javascript:;">Expand all sections</button>
|
||||
<button style="font-weight:bold;color:maroon;border:0" onclick="collapse_all();" href="javascript:;">Collapse all sections</button>
|
||||
|
||||
<!-- ================================================================ -->
|
||||
<h1>Overview</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_overview');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_overview" style="display: block">
|
||||
|
||||
<p/> One of Miller’s strengths is its compact notation: for example, given input of the form
|
||||
|
||||
POKI_RUN_COMMAND{{head -n 5 ../data/medium}}HERE
|
||||
|
||||
you can simply do
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a sum -f x ../data/medium}}HERE
|
||||
|
||||
or
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a sum -f x -g b ../data/medium}}HERE
|
||||
|
||||
rather than the more tedious
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-sum.sh)HERE
|
||||
|
||||
or
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-sum-grouped.sh)HERE
|
||||
|
||||
<p/> The former (<tt>mlr stats1</tt> et al.) has the advantages of being easier
|
||||
to type, being less error-prone to type, and running faster.
|
||||
|
||||
<p/> Nonetheless, out-of-stream variables (which I whimsically call
|
||||
<i>oosvars</i>), begin/end blocks, and emit statements give you the ability to
|
||||
implement logic — if you wish to do so — which isn’t present
|
||||
in other Miller verbs. (If you find yourself often using the same
|
||||
out-of-stream-variable logic over and over, please file a request at <a
|
||||
href="https://github.com/johnkerl/miller/issues">https://github.com/johnkerl/miller/issues</a>
|
||||
to get it implemented directly in C as a Miller verb of its own.)
|
||||
|
||||
<p/> The following examples compute some things using oosvars which are already
|
||||
computable using Miller verbs, by way of providing food for thought.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_mean" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a mean -f x data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/mean-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_mean" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a mean -f x -g a,b data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/keyed-mean-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Variance and standard deviation without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_var_stddev');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_var_stddev" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a count,sum,mean,var,stddev -f x data/medium}}HERE
|
||||
POKI_RUN_COMMAND{{cat variance.mlr}}HERE
|
||||
POKI_RUN_COMMAND{{mlr --oxtab put -q -f variance.mlr data/medium}}HERE
|
||||
|
||||
You can also do this keyed, of course, imitating the keyed-mean example above.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_min_max" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab stats1 -a min,max -f x data/medium}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --oxtab put -q '@x_min = min(@x_min, $x); @x_max = max(@x_max, $x); end{emitf @x_min, @x_max}' data/medium}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_min_max" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint stats1 -a min,max -f x -g a data/medium}}HERE
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(data/keyed-min-max-with-oosvars.sh)HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_delta" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint step -a delta -f x data/small}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint put '$x_delta = is_present(@last) ? $x - @last : 0; @last = $x' data/small}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Keyed delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_delta" style="display: block">
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint step -a delta -f x -g a data/small}}HERE
|
||||
|
||||
POKI_RUN_COMMAND{{mlr --opprint put '$x_delta = is_present(@last[$a]) ? $x - @last[$a] : 0; @last[$a]=$x' data/small}}HERE
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<h1>Exponentially weighted moving averages without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_ewma');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_ewma" style="display: block">
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(verb-example-ewma.sh)HERE
|
||||
|
||||
POKI_INCLUDE_AND_RUN_ESCAPED(oosvar-example-ewma.sh)HERE
|
||||
|
||||
</div>
|
||||
|
|
@ -45,6 +45,12 @@ Miller’s added values include:
|
|||
<a href="http://stedolan.github.io/jq/">jq</a> does for JSON. If you’re
|
||||
not already familiar with <tt>jq</tt>, please <a href="http://stedolan.github.io/jq/">check it out!</a>.
|
||||
|
||||
<p/><boldmaroon>What about similar tools?</boldmaroon>
|
||||
Here’s a comprehensive list:
|
||||
<a href="https://github.com/dbohdan/structured-text-tools">https://github.com/dbohdan/structured-text-tools</a>.
|
||||
It doesn’t mention <a href="https://github.com/turicas/rows">rows</a> so here’s a plug for that as well.
|
||||
As it turns out, I learned about most of these after writing Miller.
|
||||
|
||||
<p/><boldmaroon>What about DOTADIW?</boldmaroon> One of the key points of the
|
||||
<a href="http://en.wikipedia.org/wiki/Unix_philosophy">Unix philosophy</a> is
|
||||
that a tool should do one thing and do it well. Hence <tt>sort</tt> and
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html"><b>Cookbook part 1</b></a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html"><b>Cookbook part 2</b></a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html"><b>Cookbook part 3</b></a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
@ -188,12 +187,20 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
|
||||
<p/>
|
||||
<center>
|
||||
<boldmaroon>Comparing verbs and DSL</boldmaroon>
|
||||
<boldmaroon>Stats with and without out-of-stream variables</boldmaroon>
|
||||
</center>
|
||||
|
||||
<div class="pokitoc">
|
||||
<center><b>Contents:</b></center>
|
||||
• <a href="#Overview">Overview</a><br/>
|
||||
• <a href="#Mean_without/with_oosvars">Mean without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_mean_without/with_oosvars">Keyed mean without/with oosvars</a><br/>
|
||||
• <a href="#Variance_and_standard_deviation_without/with_oosvars">Variance and standard deviation without/with oosvars</a><br/>
|
||||
• <a href="#Min/max_without/with_oosvars">Min/max without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_min/max_without/with_oosvars">Keyed min/max without/with oosvars</a><br/>
|
||||
• <a href="#Delta_without/with_oosvars">Delta without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_delta_without/with_oosvars">Keyed delta without/with oosvars</a><br/>
|
||||
• <a href="#Exponentially_weighted_moving_averages_without/with_oosvars">Exponentially weighted moving averages without/with oosvars</a><br/>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
|
|
@ -206,7 +213,433 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_overview');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_overview" style="display: block">
|
||||
|
||||
<p/> To do.
|
||||
<p/> One of Miller’s strengths is its compact notation: for example, given input of the form
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ head -n 5 ../data/medium
|
||||
a=pan,b=pan,i=1,x=0.3467901443380824,y=0.7268028627434533
|
||||
a=eks,b=pan,i=2,x=0.7586799647899636,y=0.5221511083334797
|
||||
a=wye,b=wye,i=3,x=0.20460330576630303,y=0.33831852551664776
|
||||
a=eks,b=wye,i=4,x=0.38139939387114097,y=0.13418874328430463
|
||||
a=wye,b=pan,i=5,x=0.5732889198020006,y=0.8636244699032729
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
you can simply do
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a sum -f x ../data/medium
|
||||
x_sum 4986.019682
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
or
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a sum -f x -g b ../data/medium
|
||||
b x_sum
|
||||
pan 965.763670
|
||||
wye 1023.548470
|
||||
zee 979.742016
|
||||
eks 1016.772857
|
||||
hat 1000.192668
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
rather than the more tedious
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q '
|
||||
@x_sum += $x;
|
||||
end {
|
||||
emit @x_sum
|
||||
}
|
||||
' data/medium
|
||||
x_sum 4986.019682
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
or
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum[$b] += $x;
|
||||
end {
|
||||
emit @x_sum, "b"
|
||||
}
|
||||
' data/medium
|
||||
b x_sum
|
||||
pan 965.763670
|
||||
wye 1023.548470
|
||||
zee 979.742016
|
||||
eks 1016.772857
|
||||
hat 1000.192668
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/> The former (<tt>mlr stats1</tt> et al.) has the advantages of being easier
|
||||
to type, being less error-prone to type, and running faster.
|
||||
|
||||
<p/> Nonetheless, out-of-stream variables (which I whimsically call
|
||||
<i>oosvars</i>), begin/end blocks, and emit statements give you the ability to
|
||||
implement logic — if you wish to do so — which isn’t present
|
||||
in other Miller verbs. (If you find yourself often using the same
|
||||
out-of-stream-variable logic over and over, please file a request at <a
|
||||
href="https://github.com/johnkerl/miller/issues">https://github.com/johnkerl/miller/issues</a>
|
||||
to get it implemented directly in C as a Miller verb of its own.)
|
||||
|
||||
<p/> The following examples compute some things using oosvars which are already
|
||||
computable using Miller verbs, by way of providing food for thought.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Mean_without/with_oosvars"/><h1>Mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_mean" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a mean -f x data/medium
|
||||
x_mean
|
||||
0.498602
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum += $x;
|
||||
@x_count += 1;
|
||||
end {
|
||||
@x_mean = @x_sum / @x_count;
|
||||
emit @x_mean
|
||||
}
|
||||
' data/medium
|
||||
x_mean
|
||||
0.498602
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_mean_without/with_oosvars"/><h1>Keyed mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_mean" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a mean -f x -g a,b data/medium
|
||||
a b x_mean
|
||||
pan pan 0.513314
|
||||
eks pan 0.485076
|
||||
wye wye 0.491501
|
||||
eks wye 0.483895
|
||||
wye pan 0.499612
|
||||
zee pan 0.519830
|
||||
eks zee 0.495463
|
||||
zee wye 0.514267
|
||||
hat wye 0.493813
|
||||
pan wye 0.502362
|
||||
zee eks 0.488393
|
||||
hat zee 0.509999
|
||||
hat eks 0.485879
|
||||
wye hat 0.497730
|
||||
pan eks 0.503672
|
||||
eks eks 0.522799
|
||||
hat hat 0.479931
|
||||
hat pan 0.464336
|
||||
zee zee 0.512756
|
||||
pan hat 0.492141
|
||||
pan zee 0.496604
|
||||
zee hat 0.467726
|
||||
wye zee 0.505907
|
||||
eks hat 0.500679
|
||||
wye eks 0.530604
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum[$a][$b] += $x;
|
||||
@x_count[$a][$b] += 1;
|
||||
end{
|
||||
for ((a, b), v in @x_sum) {
|
||||
@x_mean[a][b] = @x_sum[a][b] / @x_count[a][b];
|
||||
}
|
||||
emit @x_mean, "a", "b"
|
||||
}
|
||||
' data/medium
|
||||
a b x_mean
|
||||
pan pan 0.513314
|
||||
pan wye 0.502362
|
||||
pan eks 0.503672
|
||||
pan hat 0.492141
|
||||
pan zee 0.496604
|
||||
eks pan 0.485076
|
||||
eks wye 0.483895
|
||||
eks zee 0.495463
|
||||
eks eks 0.522799
|
||||
eks hat 0.500679
|
||||
wye wye 0.491501
|
||||
wye pan 0.499612
|
||||
wye hat 0.497730
|
||||
wye zee 0.505907
|
||||
wye eks 0.530604
|
||||
zee pan 0.519830
|
||||
zee wye 0.514267
|
||||
zee eks 0.488393
|
||||
zee zee 0.512756
|
||||
zee hat 0.467726
|
||||
hat wye 0.493813
|
||||
hat zee 0.509999
|
||||
hat eks 0.485879
|
||||
hat hat 0.479931
|
||||
hat pan 0.464336
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Variance_and_standard_deviation_without/with_oosvars"/><h1>Variance and standard deviation without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_var_stddev');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_var_stddev" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a count,sum,mean,var,stddev -f x data/medium
|
||||
x_count 10000
|
||||
x_sum 4986.019682
|
||||
x_mean 0.498602
|
||||
x_var 0.084270
|
||||
x_stddev 0.290293
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ cat variance.mlr
|
||||
@n += 1;
|
||||
@sumx += $x;
|
||||
@sumx2 += $x**2;
|
||||
end {
|
||||
@mean = @sumx / @n;
|
||||
@var = (@sumx2 - @mean * (2 * @sumx - @n * @mean)) / (@n - 1);
|
||||
@stddev = sqrt(@var);
|
||||
emitf @n, @sumx, @sumx2, @mean, @var, @stddev
|
||||
}
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q -f variance.mlr data/medium
|
||||
n 10000
|
||||
sumx 4986.019682
|
||||
sumx2 3328.652400
|
||||
mean 0.498602
|
||||
var 0.084270
|
||||
stddev 0.290293
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
You can also do this keyed, of course, imitating the keyed-mean example above.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Min/max_without/with_oosvars"/><h1>Min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_min_max" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a min,max -f x data/medium
|
||||
x_min 0.000045
|
||||
x_max 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q '@x_min = min(@x_min, $x); @x_max = max(@x_max, $x); end{emitf @x_min, @x_max}' data/medium
|
||||
x_min 0.000045
|
||||
x_max 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_min/max_without/with_oosvars"/><h1>Keyed min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_min_max" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a min,max -f x -g a data/medium
|
||||
a x_min x_max
|
||||
pan 0.000204 0.999403
|
||||
eks 0.000692 0.998811
|
||||
wye 0.000187 0.999823
|
||||
zee 0.000549 0.999490
|
||||
hat 0.000045 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint --from data/medium put -q '
|
||||
@min[$a] = min(@min[$a], $x);
|
||||
@max[$a] = max(@max[$a], $x);
|
||||
end{
|
||||
emit (@min, @max), "a";
|
||||
}
|
||||
'
|
||||
a min max
|
||||
pan 0.000204 0.999403
|
||||
eks 0.000692 0.998811
|
||||
wye 0.000187 0.999823
|
||||
zee 0.000549 0.999490
|
||||
hat 0.000045 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Delta_without/with_oosvars"/><h1>Delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_delta" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a delta -f x data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.411890
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 -0.554077
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.176796
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.191890
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '$x_delta = is_present(@last) ? $x - @last : 0; @last = $x' data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.411890
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 -0.554077
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.176796
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.191890
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_delta_without/with_oosvars"/><h1>Keyed delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_delta" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a delta -f x -g a data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 -0.377281
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.368686
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '$x_delta = is_present(@last[$a]) ? $x - @last[$a] : 0; @last[$a]=$x' data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 -0.377281
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.368686
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Exponentially_weighted_moving_averages_without/with_oosvars"/><h1>Exponentially weighted moving averages without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_ewma');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_ewma" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a ewma -d 0.1 -f x data/small
|
||||
a b i x y x_ewma_0.1
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0.346790
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.387979
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0.369642
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.370817
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.391064
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '
|
||||
begin{ @a=0.1 };
|
||||
$e = NR==1 ? $x : @a * $x + (1 - @a) * @e;
|
||||
@e=$e
|
||||
' data/small
|
||||
a b i x y e
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0.346790
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.387979
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0.369642
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.370817
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.391064
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
</div>
|
||||
|
|
|
|||
|
|
@ -1,651 +0,0 @@
|
|||
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
|
||||
<html lang="en">
|
||||
|
||||
<!-- PAGE GENERATED FROM template.html and content-for-cookbook4.html BY poki. -->
|
||||
<!-- PLEASE MAKE CHANGES THERE AND THEN RE-RUN poki. -->
|
||||
<head>
|
||||
<meta http-equiv="Content-type" content="text/html;charset=UTF-8"/>
|
||||
<meta name="description" content="Miller documentation"/>
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1.0"/> <!-- mobile-friendly -->
|
||||
<meta name="keywords"
|
||||
content="John Kerl, Kerl, Miller, miller, mlr, OLAP, data analysis software, regression, correlation, variance, data tools, " />
|
||||
|
||||
<title> Cookbook part 4 </title>
|
||||
<link rel="stylesheet" type="text/css" href="css/miller.css"/>
|
||||
<link rel="stylesheet" type="text/css" href="css/poki-callbacks.css"/>
|
||||
</head>
|
||||
|
||||
<!-- ================================================================ -->
|
||||
<script type="text/javascript">
|
||||
var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");
|
||||
document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));
|
||||
</script>
|
||||
<script type="text/javascript">
|
||||
try {
|
||||
var pageTracker = _gat._getTracker("UA-15651652-1");
|
||||
pageTracker._trackPageview();
|
||||
} catch(err) {}
|
||||
</script>
|
||||
|
||||
<!-- ================================================================ -->
|
||||
<script type="text/javascript">
|
||||
function toggle_div(div) {
|
||||
if (div != null) {
|
||||
if (div.id.startsWith("section_toggle_")) {
|
||||
var state = div.style.display;
|
||||
if (state == "block") {
|
||||
div.style.display = "none";
|
||||
} else {
|
||||
div.style.display = "block";
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
function expand_div(div) {
|
||||
if (div != null) {
|
||||
if (div.id.startsWith("section_toggle_")) {
|
||||
div.style.display = "block";
|
||||
}
|
||||
}
|
||||
}
|
||||
function collapse_div(div) {
|
||||
if (div != null) {
|
||||
if (div.id.startsWith("section_toggle_")) {
|
||||
div.style.display = "none";
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
function toggle_by_name(divName) {
|
||||
toggle_div(document.getElementById(divName));
|
||||
}
|
||||
function expand_by_name(divName) {
|
||||
expand_div(document.getElementById(divName));
|
||||
}
|
||||
function collapse_by_name(divName) {
|
||||
collapse_div(document.getElementById(divName));
|
||||
}
|
||||
|
||||
function expand_all() {
|
||||
var divs = document.getElementsByTagName("div");
|
||||
for(var i = 0; i < divs.length; i++) {
|
||||
expand_div(divs[i]);
|
||||
}
|
||||
}
|
||||
function collapse_all() {
|
||||
var divs = document.getElementsByTagName("div");
|
||||
for(var i = 0; i < divs.length; i++){
|
||||
collapse_div(divs[i]);
|
||||
}
|
||||
}
|
||||
</script>
|
||||
|
||||
<!--
|
||||
The background image is from a screenshot of a Google search for "data analysis
|
||||
tools", lightened and sepia-toned. Over this was placed a Mac Terminal app with
|
||||
very light-grey font and translucent background, in which a few statistical
|
||||
Miller commands were run with pretty-print-tabular output format.
|
||||
-->
|
||||
<body background="pix/sepia-overlay.jpg">
|
||||
|
||||
<!-- ================================================================ -->
|
||||
<table width="100%">
|
||||
<tr>
|
||||
|
||||
<!-- navbar -->
|
||||
<td width="15%">
|
||||
<!--
|
||||
<img src="pix/mlr.jpg" />
|
||||
<img style="border-width:1px; color:black;" src="pix/mlr.jpg" />
|
||||
-->
|
||||
|
||||
<div class="pokinav">
|
||||
<center><titleinbody>Miller</titleinbody></center>
|
||||
|
||||
<!-- PAGE LIST GENERATED FROM template.html BY poki -->
|
||||
<br/><b>Overview:</b>
|
||||
<br/>• <a href="index.html">About Miller</a>
|
||||
<br/>• <a href="10-min.html">Miller in 10 minutes</a>
|
||||
<br/>• <a href="file-formats.html">File formats</a>
|
||||
<br/>• <a href="feature-comparison.html">Miller features in the context of the Unix toolkit</a>
|
||||
<br/>• <a href="record-heterogeneity.html">Record-heterogeneity</a>
|
||||
<br/>• <a href="internationalization.html">Internationalization</a>
|
||||
<br/><b>Using Miller:</b>
|
||||
<br/>• <a href="faq.html">FAQ</a>
|
||||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html"><b>Cookbook part 4</b></a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
<br/>• <a href="reference-verbs.html">Reference: Verbs</a>
|
||||
<br/>• <a href="reference-dsl.html">Reference: DSL</a>
|
||||
<br/>• <a href="release-docs.html">Documents by release</a>
|
||||
<br/>• <a href="build.html">Installation, portability, dependencies, and testing</a>
|
||||
<br/><b>Background:</b>
|
||||
<br/>• <a href="why.html">Why?</a>
|
||||
<br/>• <a href="whyc.html">Why C?</a>
|
||||
<br/>• <a href="etymology.html">Why call it Miller?</a>
|
||||
<br/>• <a href="originality.html">How original is Miller?</a>
|
||||
<br/>• <a href="performance.html">Performance</a>
|
||||
<br/><b>Repository:</b>
|
||||
<br/>• <a href="to-do.html">Things to do</a>
|
||||
<br/>• <a href="contact.html">Contact information</a>
|
||||
<br/>• <a href="https://github.com/johnkerl/miller">GitHub repo</a>
|
||||
<br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/>
|
||||
<br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/> <br/>
|
||||
<br/> <br/> <br/> <br/> <br/> <br/>
|
||||
</div>
|
||||
</td>
|
||||
|
||||
<!-- page body -->
|
||||
<td>
|
||||
<!--
|
||||
This is a visually gorgeous feature (here & in the CSS): it allows for
|
||||
independent scroll of the nav and body panels. In particular the nav
|
||||
stays on-screen as you scroll the body.
|
||||
|
||||
However, two problems:
|
||||
|
||||
(1) In Firefox & Chrome both I get janky end-of-body scrolls: there is
|
||||
more content but I can't scroll down to it unless I repeatedly retry the
|
||||
scrolldown. Which is weird.
|
||||
|
||||
(2) Worse, only the first page renders in PDF (again, Firefox & Chrome).
|
||||
|
||||
For now I'm disabling this separate-scroll feature. A frontender, I am
|
||||
not ... maybe someday I'll find a config which gets *all* the features
|
||||
I want; for now, it's a tradeoff.
|
||||
-->
|
||||
|
||||
<!-- Implementation details: one bit is right here:
|
||||
|
||||
div style="overflow-y:scroll;height:1500px"
|
||||
|
||||
and the other bit is in css/poki-callbacks.css:
|
||||
|
||||
.pokinav {
|
||||
display: inline-block;
|
||||
background: #e8d9bc;
|
||||
border: 1;
|
||||
box-shadow: 0px 0px 3px 3px #C9C9C9;
|
||||
margin: 10px;
|
||||
padding-top: 10px;
|
||||
padding-bottom: 10px;
|
||||
padding-left: 10px;
|
||||
padding-right: 10px;
|
||||
overflow-y: scroll; < - - - - - - here
|
||||
height: 1500px;
|
||||
}
|
||||
|
||||
-->
|
||||
<div>
|
||||
<center> <titleinbody> Cookbook part 4 </titleinbody> </center>
|
||||
<p/>
|
||||
|
||||
<!-- BODY COPIED FROM content-for-cookbook4.html BY poki -->
|
||||
|
||||
<p/>
|
||||
<center>
|
||||
<boldmaroon>Stats with and without out-of-stream variables</boldmaroon>
|
||||
</center>
|
||||
|
||||
<div class="pokitoc">
|
||||
<center><b>Contents:</b></center>
|
||||
• <a href="#Overview">Overview</a><br/>
|
||||
• <a href="#Mean_without/with_oosvars">Mean without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_mean_without/with_oosvars">Keyed mean without/with oosvars</a><br/>
|
||||
• <a href="#Variance_and_standard_deviation_without/with_oosvars">Variance and standard deviation without/with oosvars</a><br/>
|
||||
• <a href="#Min/max_without/with_oosvars">Min/max without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_min/max_without/with_oosvars">Keyed min/max without/with oosvars</a><br/>
|
||||
• <a href="#Delta_without/with_oosvars">Delta without/with oosvars</a><br/>
|
||||
• <a href="#Keyed_delta_without/with_oosvars">Keyed delta without/with oosvars</a><br/>
|
||||
• <a href="#Exponentially_weighted_moving_averages_without/with_oosvars">Exponentially weighted moving averages without/with oosvars</a><br/>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<button style="font-weight:bold;color:maroon;border:0" onclick="expand_all();" href="javascript:;">Expand all sections</button>
|
||||
<button style="font-weight:bold;color:maroon;border:0" onclick="collapse_all();" href="javascript:;">Collapse all sections</button>
|
||||
|
||||
<!-- ================================================================ -->
|
||||
<a id="Overview"/><h1>Overview</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_overview');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_overview" style="display: block">
|
||||
|
||||
<p/> One of Miller’s strengths is its compact notation: for example, given input of the form
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ head -n 5 ../data/medium
|
||||
a=pan,b=pan,i=1,x=0.3467901443380824,y=0.7268028627434533
|
||||
a=eks,b=pan,i=2,x=0.7586799647899636,y=0.5221511083334797
|
||||
a=wye,b=wye,i=3,x=0.20460330576630303,y=0.33831852551664776
|
||||
a=eks,b=wye,i=4,x=0.38139939387114097,y=0.13418874328430463
|
||||
a=wye,b=pan,i=5,x=0.5732889198020006,y=0.8636244699032729
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
you can simply do
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a sum -f x ../data/medium
|
||||
x_sum 4986.019682
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
or
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a sum -f x -g b ../data/medium
|
||||
b x_sum
|
||||
pan 965.763670
|
||||
wye 1023.548470
|
||||
zee 979.742016
|
||||
eks 1016.772857
|
||||
hat 1000.192668
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
rather than the more tedious
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q '
|
||||
@x_sum += $x;
|
||||
end {
|
||||
emit @x_sum
|
||||
}
|
||||
' data/medium
|
||||
x_sum 4986.019682
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
or
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum[$b] += $x;
|
||||
end {
|
||||
emit @x_sum, "b"
|
||||
}
|
||||
' data/medium
|
||||
b x_sum
|
||||
pan 965.763670
|
||||
wye 1023.548470
|
||||
zee 979.742016
|
||||
eks 1016.772857
|
||||
hat 1000.192668
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/> The former (<tt>mlr stats1</tt> et al.) has the advantages of being easier
|
||||
to type, being less error-prone to type, and running faster.
|
||||
|
||||
<p/> Nonetheless, out-of-stream variables (which I whimsically call
|
||||
<i>oosvars</i>), begin/end blocks, and emit statements give you the ability to
|
||||
implement logic — if you wish to do so — which isn’t present
|
||||
in other Miller verbs. (If you find yourself often using the same
|
||||
out-of-stream-variable logic over and over, please file a request at <a
|
||||
href="https://github.com/johnkerl/miller/issues">https://github.com/johnkerl/miller/issues</a>
|
||||
to get it implemented directly in C as a Miller verb of its own.)
|
||||
|
||||
<p/> The following examples compute some things using oosvars which are already
|
||||
computable using Miller verbs, by way of providing food for thought.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Mean_without/with_oosvars"/><h1>Mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_mean" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a mean -f x data/medium
|
||||
x_mean
|
||||
0.498602
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum += $x;
|
||||
@x_count += 1;
|
||||
end {
|
||||
@x_mean = @x_sum / @x_count;
|
||||
emit @x_mean
|
||||
}
|
||||
' data/medium
|
||||
x_mean
|
||||
0.498602
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_mean_without/with_oosvars"/><h1>Keyed mean without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_mean');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_mean" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a mean -f x -g a,b data/medium
|
||||
a b x_mean
|
||||
pan pan 0.513314
|
||||
eks pan 0.485076
|
||||
wye wye 0.491501
|
||||
eks wye 0.483895
|
||||
wye pan 0.499612
|
||||
zee pan 0.519830
|
||||
eks zee 0.495463
|
||||
zee wye 0.514267
|
||||
hat wye 0.493813
|
||||
pan wye 0.502362
|
||||
zee eks 0.488393
|
||||
hat zee 0.509999
|
||||
hat eks 0.485879
|
||||
wye hat 0.497730
|
||||
pan eks 0.503672
|
||||
eks eks 0.522799
|
||||
hat hat 0.479931
|
||||
hat pan 0.464336
|
||||
zee zee 0.512756
|
||||
pan hat 0.492141
|
||||
pan zee 0.496604
|
||||
zee hat 0.467726
|
||||
wye zee 0.505907
|
||||
eks hat 0.500679
|
||||
wye eks 0.530604
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put -q '
|
||||
@x_sum[$a][$b] += $x;
|
||||
@x_count[$a][$b] += 1;
|
||||
end{
|
||||
for ((a, b), v in @x_sum) {
|
||||
@x_mean[a][b] = @x_sum[a][b] / @x_count[a][b];
|
||||
}
|
||||
emit @x_mean, "a", "b"
|
||||
}
|
||||
' data/medium
|
||||
a b x_mean
|
||||
pan pan 0.513314
|
||||
pan wye 0.502362
|
||||
pan eks 0.503672
|
||||
pan hat 0.492141
|
||||
pan zee 0.496604
|
||||
eks pan 0.485076
|
||||
eks wye 0.483895
|
||||
eks zee 0.495463
|
||||
eks eks 0.522799
|
||||
eks hat 0.500679
|
||||
wye wye 0.491501
|
||||
wye pan 0.499612
|
||||
wye hat 0.497730
|
||||
wye zee 0.505907
|
||||
wye eks 0.530604
|
||||
zee pan 0.519830
|
||||
zee wye 0.514267
|
||||
zee eks 0.488393
|
||||
zee zee 0.512756
|
||||
zee hat 0.467726
|
||||
hat wye 0.493813
|
||||
hat zee 0.509999
|
||||
hat eks 0.485879
|
||||
hat hat 0.479931
|
||||
hat pan 0.464336
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Variance_and_standard_deviation_without/with_oosvars"/><h1>Variance and standard deviation without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_var_stddev');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_var_stddev" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a count,sum,mean,var,stddev -f x data/medium
|
||||
x_count 10000
|
||||
x_sum 4986.019682
|
||||
x_mean 0.498602
|
||||
x_var 0.084270
|
||||
x_stddev 0.290293
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ cat variance.mlr
|
||||
@n += 1;
|
||||
@sumx += $x;
|
||||
@sumx2 += $x**2;
|
||||
end {
|
||||
@mean = @sumx / @n;
|
||||
@var = (@sumx2 - @mean * (2 * @sumx - @n * @mean)) / (@n - 1);
|
||||
@stddev = sqrt(@var);
|
||||
emitf @n, @sumx, @sumx2, @mean, @var, @stddev
|
||||
}
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q -f variance.mlr data/medium
|
||||
n 10000
|
||||
sumx 4986.019682
|
||||
sumx2 3328.652400
|
||||
mean 0.498602
|
||||
var 0.084270
|
||||
stddev 0.290293
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
You can also do this keyed, of course, imitating the keyed-mean example above.
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Min/max_without/with_oosvars"/><h1>Min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_min_max" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab stats1 -a min,max -f x data/medium
|
||||
x_min 0.000045
|
||||
x_max 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --oxtab put -q '@x_min = min(@x_min, $x); @x_max = max(@x_max, $x); end{emitf @x_min, @x_max}' data/medium
|
||||
x_min 0.000045
|
||||
x_max 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_min/max_without/with_oosvars"/><h1>Keyed min/max without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_min_max');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_min_max" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint stats1 -a min,max -f x -g a data/medium
|
||||
a x_min x_max
|
||||
pan 0.000204 0.999403
|
||||
eks 0.000692 0.998811
|
||||
wye 0.000187 0.999823
|
||||
zee 0.000549 0.999490
|
||||
hat 0.000045 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint --from data/medium put -q '
|
||||
@min[$a] = min(@min[$a], $x);
|
||||
@max[$a] = max(@max[$a], $x);
|
||||
end{
|
||||
emit (@min, @max), "a";
|
||||
}
|
||||
'
|
||||
a min max
|
||||
pan 0.000204 0.999403
|
||||
eks 0.000692 0.998811
|
||||
wye 0.000187 0.999823
|
||||
zee 0.000549 0.999490
|
||||
hat 0.000045 0.999953
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Delta_without/with_oosvars"/><h1>Delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_delta" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a delta -f x data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.411890
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 -0.554077
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.176796
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.191890
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '$x_delta = is_present(@last) ? $x - @last : 0; @last = $x' data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.411890
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 -0.554077
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.176796
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.191890
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Keyed_delta_without/with_oosvars"/><h1>Keyed delta without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_keyed_delta');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_keyed_delta" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a delta -f x -g a data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 -0.377281
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.368686
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '$x_delta = is_present(@last[$a]) ? $x - @last[$a] : 0; @last[$a]=$x' data/small
|
||||
a b i x y x_delta
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 -0.377281
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.368686
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
<!-- ================================================================ -->
|
||||
<a id="Exponentially_weighted_moving_averages_without/with_oosvars"/><h1>Exponentially weighted moving averages without/with oosvars</h1>
|
||||
<button style="font-weight:bold;color:maroon;border:0" padding=0 onclick="toggle_by_name('section_toggle_ewma');" href="javascript:;">Toggle section visibility</button>
|
||||
<div id="section_toggle_ewma" style="display: block">
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint step -a ewma -d 0.1 -f x data/small
|
||||
a b i x y x_ewma_0.1
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0.346790
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.387979
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0.369642
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.370817
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.391064
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
<p/>
|
||||
<div class="pokipanel">
|
||||
<pre>
|
||||
$ mlr --opprint put '
|
||||
begin{ @a=0.1 };
|
||||
$e = NR==1 ? $x : @a * $x + (1 - @a) * @e;
|
||||
@e=$e
|
||||
' data/small
|
||||
a b i x y e
|
||||
pan pan 1 0.3467901443380824 0.7268028627434533 0.346790
|
||||
eks pan 2 0.7586799647899636 0.5221511083334797 0.387979
|
||||
wye wye 3 0.20460330576630303 0.33831852551664776 0.369642
|
||||
eks wye 4 0.38139939387114097 0.13418874328430463 0.370817
|
||||
wye pan 5 0.5732889198020006 0.8636244699032729 0.391064
|
||||
</pre>
|
||||
</div>
|
||||
<p/>
|
||||
|
||||
</div>
|
||||
</div>
|
||||
</td>
|
||||
|
||||
</table>
|
||||
</body>
|
||||
</html>
|
||||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html"><b>Data-diving examples</b></a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html"><b>Manpage</b></a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
@ -232,6 +231,12 @@ Miller’s added values include:
|
|||
<a href="http://stedolan.github.io/jq/">jq</a> does for JSON. If you’re
|
||||
not already familiar with <tt>jq</tt>, please <a href="http://stedolan.github.io/jq/">check it out!</a>.
|
||||
|
||||
<p/><boldmaroon>What about similar tools?</boldmaroon>
|
||||
Here’s a comprehensive list:
|
||||
<a href="https://github.com/dbohdan/structured-text-tools">https://github.com/dbohdan/structured-text-tools</a>.
|
||||
It doesn’t mention <a href="https://github.com/turicas/rows">rows</a> so here’s a plug for that as well.
|
||||
As it turns out, I learned about most of these after writing Miller.
|
||||
|
||||
<p/><boldmaroon>What about DOTADIW?</boldmaroon> One of the key points of the
|
||||
<a href="http://en.wikipedia.org/wiki/Unix_philosophy">Unix philosophy</a> is
|
||||
that a tool should do one thing and do it well. Hence <tt>sort</tt> and
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -11,7 +11,6 @@ faq.html FAQ
|
|||
cookbook.html Cookbook part 1
|
||||
cookbook2.html Cookbook part 2
|
||||
cookbook3.html Cookbook part 3
|
||||
cookbook4.html Cookbook part 4
|
||||
data-examples.html Data-diving examples
|
||||
manpage.html Manpage
|
||||
reference.html Reference
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html"><b>Reference</b></a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
|
|
@ -115,7 +115,6 @@ Miller commands were run with pretty-print-tabular output format.
|
|||
<br/>• <a href="cookbook.html">Cookbook part 1</a>
|
||||
<br/>• <a href="cookbook2.html">Cookbook part 2</a>
|
||||
<br/>• <a href="cookbook3.html">Cookbook part 3</a>
|
||||
<br/>• <a href="cookbook4.html">Cookbook part 4</a>
|
||||
<br/>• <a href="data-examples.html">Data-diving examples</a>
|
||||
<br/>• <a href="manpage.html">Manpage</a>
|
||||
<br/>• <a href="reference.html">Reference</a>
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue