Mirrors/miller
1
0
Fork 0
mirror of https://github.com/johnkerl/miller.git synced 2026-07-26 01:15:27 +00:00
Code Issues Projects Releases Wiki Activity
miller/docs/src
History
John Kerl 58d9ad19bc
Record hashing perf (#781) 
* todo

* Rename inputChannel,outputChannel to readerChannel,writerChannel

* Rename inputChannel,outputChannel to readerChannel,writerChannel (#772)

* Start batched-reader API mods

* Singleton-list step for reader-batching at input

* CLI options for records-per-batch and hash-records

* Push channelized-reader logic into DKVP reader

* Push batching logic into chain-transformer, transformers, and channel-writer

* foo

* cmd/mprof and cmd/mprof2

* cmd/mprof3 and cmd/mprof4

* narrowed in on regexp-splitting on IFS/IPS as perf-hit

* neaten

* channelize nidx

* cmd/mprof5

* channelize CSV reader

* channelize NIDX reader

* Dedupe DKVP-reader and NIDX-reader source files

* channelize CSV-lite reader

* channelize XTAB reader

* batchify JSON reader

* channelize GEN pseudo-reader

* scripts for perf-testing on larger files

* merge with main for #776

* Fix record-batching for join and repl

* Fix comment-handling in channelized XTAB reader

* Fix bug found in positional-rename

* Use --no-hash-records by default
2021-12-14 22:41:40 -05:00
..
_static Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
coverart Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
data Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
images Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
javascripts Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
multi-join Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
ngrams Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
pix Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
polyglot-dkvp-io Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
programs Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
tools Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
.vimrc Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
10min.md Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
10min.md.in Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
absent-example.json Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
build-one Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
build.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
build.md.in Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
circle.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
commas.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
community.md Fix some doc links 2021-11-05 11:14:14 -04:00
community.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
context-example.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
contributing.md Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
contributing.md.in Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
cpu.md Fix some doc links 2021-11-05 11:14:14 -04:00
cpu.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
csv-with-and-without-headers.md Fix some doc links 2021-11-05 11:14:14 -04:00
csv-with-and-without-headers.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
customization.md Fix some doc links 2021-11-05 11:14:14 -04:00
customization.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
data-cleaning-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
data-cleaning-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
data-diving-examples.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
data-diving-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
date-time-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
date-time-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
dates.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
dkvp-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
dkvp-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
doc-reorg.txt Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
dsl-example.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
etymology.md Fix some doc links 2021-11-05 11:14:14 -04:00
etymology.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
example.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
example.json Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
expo-sample.sh Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
extra.css Fix some doc links 2021-11-05 11:14:14 -04:00
factorial-example.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
features.md Fix some doc links 2021-11-05 11:14:14 -04:00
features.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
file-formats.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
file-formats.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
flags.txt Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
flatten-unflatten.md Fix some doc links 2021-11-05 11:14:14 -04:00
flatten-unflatten.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
for-example.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
genmd-filter More Miller 6 release prep 2021-11-06 12:57:24 -04:00
genmds Ensure 'make man' and 'make docs' use in-tree mlr executable 2021-11-12 22:41:40 -05:00
glossary.md Fix some doc links 2021-11-05 11:14:14 -04:00
glossary.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
gz-example.csv.gz Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
h1foo Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
h2foo Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
h3foo Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
if-example.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
index.md Fix some doc links 2021-11-05 11:14:14 -04:00
index.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
installing-miller.md Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
installing-miller.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
internationalization.md Fix some doc links 2021-11-05 11:14:14 -04:00
internationalization.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
keystroke-savers.md Fix some doc links 2021-11-05 11:14:14 -04:00
keystroke-savers.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
link.txt Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
log-processing-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
log-processing-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
log.txt Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
Makefile Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
manpage.md Record hashing perf (#781) 2021-12-14 22:41:40 -05:00
manpage.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
manpage.txt Record hashing perf (#781) 2021-12-14 22:41:40 -05:00
miller-on-windows.md More Miller 6 release prep 2021-11-06 12:57:24 -04:00
miller-on-windows.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
miller-programming-language.md Fix some doc links 2021-11-05 11:14:14 -04:00
miller-programming-language.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
misc-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
misc-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
mk-flag-info.rb Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
mk-func-h2s.sh Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
mk-func-info.rb Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
mlr.1 Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
morph More Miller 6 release prep 2021-11-06 12:57:24 -04:00
morphs Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
new-in-miller-6.md Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
new-in-miller-6.md.in Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
online-help.md Approximate-match feature for online help (#754) 2021-11-17 23:37:48 -05:00
online-help.md.in Approximate-match feature for online help (#754) 2021-11-17 23:37:48 -05:00
operating-on-all-fields.md Fix some doc links 2021-11-05 11:14:14 -04:00
operating-on-all-fields.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
operating-on-all-records.md Fix some doc links 2021-11-05 11:14:14 -04:00
operating-on-all-records.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
originality.md Fix some doc links 2021-11-05 11:14:14 -04:00
originality.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
output-colorization.md Fix some doc links 2021-11-05 11:14:14 -04:00
output-colorization.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
performance.md Fix some doc links 2021-11-05 11:14:14 -04:00
performance.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
programming-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
programming-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
purple.csv.gz Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
questions-about-joins.md Fix some doc links 2021-11-05 11:14:14 -04:00
questions-about-joins.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
questions-about-then-chaining.md Fix some doc links 2021-11-05 11:14:14 -04:00
questions-about-then-chaining.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
randomizing-examples.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
randomizing-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
record-heterogeneity.md More Miller 6 release prep 2021-11-06 12:57:24 -04:00
record-heterogeneity.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
red.csv.gz Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
reference-dsl-builtin-functions.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-builtin-functions.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-complexity.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-complexity.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
reference-dsl-control-structures.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-control-structures.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-differences.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-differences.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-errors.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-errors.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
reference-dsl-filter-statements.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-filter-statements.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-higher-order-functions.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-higher-order-functions.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-operators.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-operators.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-output-statements.md emit1 for emitting arbitrary map-valued expressions (#739) 2021-11-09 14:45:10 -05:00
reference-dsl-output-statements.md.in emit1 for emitting arbitrary map-valued expressions (#739) 2021-11-09 14:45:10 -05:00
reference-dsl-syntax.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-syntax.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-time.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-time.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-unset-statements.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-unset-statements.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-user-defined-functions.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl-user-defined-functions.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl-variables.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
reference-dsl-variables.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-dsl.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-dsl.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-arithmetic.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-arithmetic.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-arrays.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-arrays.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-auxiliary-commands.md Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
reference-main-auxiliary-commands.md.in Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
reference-main-compressed-data.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-compressed-data.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-data-types.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-data-types.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-env-vars.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-env-vars.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
reference-main-flag-list.md Record hashing perf (#781) 2021-12-14 22:41:40 -05:00
reference-main-flag-list.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-in-place-processing.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-in-place-processing.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
reference-main-maps.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-maps.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-null-data.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-null-data.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-number-formatting.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-number-formatting.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-overview.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-overview.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-regular-expressions.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-regular-expressions.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-separators.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-separators.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-strings.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-strings.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-main-then-chaining.md Fix some doc links 2021-11-05 11:14:14 -04:00
reference-main-then-chaining.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
reference-verbs.md Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
reference-verbs.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
release-docs.md Link to10.3 release notes 2021-11-17 20:06:26 -05:00
release-docs.md.in Link to10.3 release notes 2021-11-17 20:06:26 -05:00
repl.md Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
repl.md.in Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
sample_mlrrc Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
shapes-of-data.md Fix some doc links 2021-11-05 11:14:14 -04:00
shapes-of-data.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
shell-commands.md Fix some doc links 2021-11-05 11:14:14 -04:00
shell-commands.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
sorting.md emit1 for emitting arbitrary map-valued expressions (#739) 2021-11-09 14:45:10 -05:00
sorting.md.in emit1 for emitting arbitrary map-valued expressions (#739) 2021-11-09 14:45:10 -05:00
spaces.csv Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
special-symbols-and-formatting.md Fix some doc links 2021-11-05 11:14:14 -04:00
special-symbols-and-formatting.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
sql-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
sql-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
square.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
statistics-examples.md Fix some doc links 2021-11-05 11:14:14 -04:00
statistics-examples.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
streaming-and-memory.md Fix some doc links 2021-11-05 11:14:14 -04:00
streaming-and-memory.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
structure-of-these-documents.md Fix some doc links 2021-11-05 11:14:14 -04:00
structure-of-these-documents.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
triangle.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
two-pass-algorithms.md Fix some doc links 2021-11-05 11:14:14 -04:00
two-pass-algorithms.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
unix-toolkit-context.md Fix some doc links 2021-11-05 11:14:14 -04:00
unix-toolkit-context.md.in More Miller 6 release prep 2021-11-06 12:57:24 -04:00
variance.mlr Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
vimrc.md Fix some doc links 2021-11-05 11:14:14 -04:00
vimrc.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
why.md Fix some doc links 2021-11-05 11:14:14 -04:00
why.md.in Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
yellow.csv.gz Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
παράδειγμα.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
пример.csv Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00