Commit graph

184 commits

Author SHA1 Message Date
John Kerl
2e431d4234 Update README-profiling.md (#810) 2021-12-27 23:49:11 -05:00
John Kerl
a296476ecc neaten 2021-12-27 02:08:30 -05:00
John Kerl
73c715d95b todo 2021-12-27 02:06:56 -05:00
John Kerl
a736f651b2 Update perf docs to include #809, as well as Linux/Mac 2021-12-27 02:03:38 -05:00
John Kerl
e10fee0724
Improve type-inference performance (#809)
* To-do items for broader platform/go-version benchmarking

* neaten inferrer API

* extend type-inference unit-test cases

* Add benchmark scripts for comparing compiler versions

* mlr version in addition to mlr --version

* some go-benchmark files for Mac/Linux perf comparisons

* neaten perf-scripts

* merge

* type-scan optimization tests

* type-scan optimization infra

* test new inferrer

* mlr --time option

* include --cpuprofile and --traceprofile in on-line help

* sharpen inferred/deferred-type API distinction

* replace old inferrer with newer/faster

* update docs for new type-inferrer
2021-12-27 00:54:21 -05:00
John Kerl
f2f528ee41 more doc-neatens re windows and mlr -s 2021-12-25 14:30:58 -05:00
John Kerl
4f57e802fe another missing file for previous doc commit 2021-12-25 14:20:08 -05:00
John Kerl
a9c9b6dfba Add new files for previous commit 2021-12-25 14:14:30 -05:00
John Kerl
25fb7f1d78
Document --norc flag (#806) 2021-12-25 13:11:58 -05:00
John Kerl
f56ab87c2d
Docs for funct keyword (#805) 2021-12-25 12:58:02 -05:00
John Kerl
8aa62db860
Update perf-docs to include XTAB I/O improvement on #799 (#804) 2021-12-25 12:25:34 -05:00
John Kerl
984df274bb Minor neatens 2021-12-25 12:16:10 -05:00
John Kerl
096bb9bc12
Make --ifs-regex and --ips-regex explicit command-line flags (#799)
* Function-pointerize IXS/IXSRegex to reduce runtime iffelsing

* remove IsRegexString and SuppressIXSRegex

* regression tests passing

* doc updates
2021-12-25 00:00:18 -05:00
John Kerl
c43a7109d1 Merge branch 'perf-doc' 2021-12-23 00:20:24 -05:00
John Kerl
cf8dd134e6
Add performance stats to "What's new in Miller 6" webdoc page (#795)
* Perf notes in README-go-port.md

* Update CPU webdoc

* Add perf-stats to new-in-miller-6.md
2021-12-23 00:16:20 -05:00
John Kerl
ed1147cf14 Add perf-stats to new-in-miller-6.md 2021-12-23 00:15:34 -05:00
John Kerl
a21143f692 Update CPU webdoc 2021-12-22 22:20:20 -05:00
John Kerl
9c8f8680d6 Fix minor doc-formatting issue on PR #794 2021-12-22 21:29:39 -05:00
John Kerl
157e567909
Dedupe field names by default (#794) 2021-12-22 21:07:29 -05:00
John Kerl
e824f377c9 README-docs.md 2021-12-22 19:27:27 -05:00
John Kerl
3c1ee965ca Document exit codes 2021-12-22 18:37:24 -05:00
John Kerl
3e71ddde21
Add instructions for makeless install (#793)
* Build-from-source info with/without make

* todo

* go install instructions
2021-12-22 18:21:12 -05:00
John Kerl
772ee0d00d
Build-from-source info with/without make (#792) 2021-12-22 17:54:41 -05:00
John Kerl
765df9a995 typofix 2021-12-22 14:29:52 -05:00
John Kerl
bcb8c0ca3b perf notes in new-in-miller-6.md 2021-12-22 13:57:14 -05:00
John Kerl
1d3bc11b29
urandelement DSL function (#789) 2021-12-21 23:15:14 -05:00
John Kerl
93862f16f9
update mlr -O behavior for #756 (#788) 2021-12-21 22:40:34 -05:00
John Kerl
58d9ad19bc
Record hashing perf (#781)
* todo

* Rename inputChannel,outputChannel to readerChannel,writerChannel

* Rename inputChannel,outputChannel to readerChannel,writerChannel (#772)

* Start batched-reader API mods

* Singleton-list step for reader-batching at input

* CLI options for records-per-batch and hash-records

* Push channelized-reader logic into DKVP reader

* Push batching logic into chain-transformer, transformers, and channel-writer

* foo

* cmd/mprof and cmd/mprof2

* cmd/mprof3 and cmd/mprof4

* narrowed in on regexp-splitting on IFS/IPS as perf-hit

* neaten

* channelize nidx

* cmd/mprof5

* channelize CSV reader

* channelize NIDX reader

* Dedupe DKVP-reader and NIDX-reader source files

* channelize CSV-lite reader

* channelize XTAB reader

* batchify JSON reader

* channelize GEN pseudo-reader

* scripts for perf-testing on larger files

* merge with main for #776

* Fix record-batching for join and repl

* Fix comment-handling in channelized XTAB reader

* Fix bug found in positional-rename

* Use --no-hash-records by default
2021-12-14 22:41:40 -05:00
Andrea Borruso
08cf55f9d5
Updated the edit PATH (#775) 2021-12-12 23:01:44 -05:00
John Kerl
4c3e141df8
Split separators from context (#771)
* Fix mlr -O to return strings for all octal numbers along with 0* numbers like 07 and 08

* Factor separators out of Context struct
2021-12-06 22:47:58 -05:00
John Kerl
cef753c232
Performance improvement: buffered output (#765)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support

* Performance optmization: less frequent syscall.write on output
2021-12-01 20:12:31 -05:00
John Kerl
d9dbb1e92e
Improvements for shebang-script handling (#758)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support
2021-11-24 01:15:28 -05:00
John Kerl
191bdfa159 merge 2021-11-22 22:43:15 -05:00
John Kerl
49863a5db5 Merge branch 'main' of git+ssh://github.com/johnkerl/miller 2021-11-22 22:39:33 -05:00
John Kerl
f097a8dcd2 merge 2021-11-22 22:39:28 -05:00
Andrea Borruso
8ca1d56f7c
To enable 404 'age (#757) 2021-11-22 22:37:47 -05:00
John Kerl
6a41f73328 Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
John Kerl
4394819cf8
Approximate-match feature for online help (#754)
* Explicitly support approximate-match help

* Unit tests for exact and approximate help
2021-11-17 23:37:48 -05:00
John Kerl
bff6890a9e Unit tests for exact and approximate help 2021-11-17 23:22:41 -05:00
John Kerl
2ea267eaa9 Link to10.3 release notes 2021-11-17 20:06:26 -05:00
John Kerl
b14c917a79
Neaten output of mlr stats1 --help (#751) 2021-11-15 07:46:11 -05:00
John Kerl
dba3ed5dc4 Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
John Kerl
5f1b0ecf05
Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
John Kerl
c0ae15a288 Ensure 'make man' and 'make docs' use in-tree mlr executable 2021-11-12 22:41:40 -05:00
John Kerl
bc72cd1857
More Go-package restructuring (#748) 2021-11-12 12:49:55 -05:00
John Kerl
0d4fc143ad rename make precommit to make dev 2021-11-11 00:02:24 -05:00
John Kerl
bf25cec435
Update draft release notes (#743) 2021-11-10 23:59:28 -05:00
John Kerl
feec887738 rename docs title from Miller 6 to Miller 6.0.0 2021-11-10 13:27:25 -05:00
John Kerl
c5a0531189 update man/Makefile .PHONY targets 2021-11-10 12:44:05 -05:00
John Kerl
db69402e24 make sure manpage gets updated on make build check install 2021-11-10 10:13:14 -05:00