mirror of
https://github.com/johnkerl/miller.git
synced 2026-07-20 18:10:07 +00:00
f233923351
* Rename inputChannel,outputChannel to readerChannel,writerChannel * Rename inputChannel,outputChannel to readerChannel,writerChannel (#772) * Start batched-reader API mods * Singleton-list step for reader-batching at input * CLI options for records-per-batch and hash-records * Push channelized-reader logic into DKVP reader * Push batching logic into chain-transformer, transformers, and channel-writer * foo * cmd/mprof and cmd/mprof2 * cmd/mprof3 and cmd/mprof4 * narrowed in on regexp-splitting on IFS/IPS as perf-hit * neaten * channelize nidx * cmd/mprof5 * channelize CSV reader * channelize NIDX reader * Dedupe DKVP-reader and NIDX-reader source files * channelize CSV-lite reader * channelize XTAB reader * batchify JSON reader * channelize GEN pseudo-reader * scripts for perf-testing on larger files * merge with main for #776 * Fix record-batching for join and repl * Fix comment-handling in channelized XTAB reader * Fix bug found in positional-rename
18 lines
261 B
Bash
Executable file
18 lines
261 B
Bash
Executable file
#!/bin/bash
|
|
|
|
mlr="mlr -S"
|
|
suffix="dkvp"
|
|
|
|
iflag=""
|
|
if [ $# -ge 1 ]; then
|
|
iflag="--$1"
|
|
if [ "$iflag" = "--csvlite" ]; then
|
|
suffix="csv"
|
|
else
|
|
suffix=$1
|
|
fi
|
|
fi
|
|
if [ $# -eq 2 ]; then
|
|
mlr="$2"
|
|
fi
|
|
justtime $mlr $iflag cat ~/tmp/big.$suffix | md5sum -
|