Mirrors/miller
1
0
Fork 0
mirror of https://github.com/johnkerl/miller.git synced 2026-07-25 08:53:55 +00:00
Code Issues Projects Releases Wiki Activity
miller/internal/pkg
History
John Kerl 58d9ad19bc
Record hashing perf (#781) 
* todo

* Rename inputChannel,outputChannel to readerChannel,writerChannel

* Rename inputChannel,outputChannel to readerChannel,writerChannel (#772)

* Start batched-reader API mods

* Singleton-list step for reader-batching at input

* CLI options for records-per-batch and hash-records

* Push channelized-reader logic into DKVP reader

* Push batching logic into chain-transformer, transformers, and channel-writer

* foo

* cmd/mprof and cmd/mprof2

* cmd/mprof3 and cmd/mprof4

* narrowed in on regexp-splitting on IFS/IPS as perf-hit

* neaten

* channelize nidx

* cmd/mprof5

* channelize CSV reader

* channelize NIDX reader

* Dedupe DKVP-reader and NIDX-reader source files

* channelize CSV-lite reader

* channelize XTAB reader

* batchify JSON reader

* channelize GEN pseudo-reader

* scripts for perf-testing on larger files

* merge with main for #776

* Fix record-batching for join and repl

* Fix comment-handling in channelized XTAB reader

* Fix bug found in positional-rename

* Use --no-hash-records by default
2021-12-14 22:41:40 -05:00
..
auxents Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
cli Record hashing perf (#781) 2021-12-14 22:41:40 -05:00
climain Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
colorizer Standardize Go-package structure (#746) 2021-11-11 14:15:13 -05:00
dsl Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
entrypoint Improvements for shebang-script handling (#758) 2021-11-24 01:15:28 -05:00
input Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
lib Fix issue with pipe or dot as IFS for DKVP/NIDX/CSV-lite (#778) 2021-12-12 23:25:16 -05:00
output Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
parsing More Go-package restructuring (#748) 2021-11-12 12:49:55 -05:00
pbnjay-strptime Standardize Go-package structure (#746) 2021-11-11 14:15:13 -05:00
platform Standardize Go-package structure (#746) 2021-11-11 14:15:13 -05:00
runtime Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
stream Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
transformers Performance improvement: record-batching (#779) 2021-12-13 00:57:52 -05:00
types Record hashing perf (#781) 2021-12-14 22:41:40 -05:00
version Standardize Go-package structure (#746) 2021-11-11 14:15:13 -05:00
README.md Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00

README.md

Please see ../../README-go-port.md for an overview; please see each subdirectory for details about it.