Commit graph

67 commits

Author SHA1 Message Date
John Kerl
ac47c7052a typofix 2022-02-05 00:27:25 -05:00
John Kerl
b7f76cd622
Multiple on-line-help issues from #908 (#921)
* More on issue 908

* doc-build artifacts
2022-02-05 00:18:55 -05:00
John Kerl
9c29f0cef9
Multiple on-line-help issues from #908 (#913)
* Populate help strings for systime, systimeint, and uptime DSL functions

* Extend help strings for joink, joinv, and joinkv

* Expand on-line help for ssub/sub/gsub

* doc artifacts
2022-02-04 22:43:33 -05:00
John Kerl
c327055db7
Fix multiple on-line-help issues from #907 (#910)
* Fix multiple on-line-help issues from #907

* build-artifacts for previous commit
2022-01-31 23:41:32 -05:00
John Kerl
bef2fa74de
Update default colorization (#904)
* colorization experiment

* todo

* Add dependency on github.com/johnkerl/lumin

* lumin dependency

* more badges in README.md

* on-line help for bold/underine/reverse

* update webdocs
2022-01-30 14:12:47 -05:00
John Kerl
f7ff63124b
mlr split verb (#898)
* mlr split

* regression-test cases

* doc-build artifacts
2022-01-26 23:16:25 -05:00
John Kerl
dad6456022
Clarify source for printf-style formatting (#895) 2022-01-24 22:52:38 -05:00
John Kerl
62a50fb9a5 Fix slwin-7-2 -> slwin_7_2 doc info 2022-01-24 16:33:05 -05:00
John Kerl
b4c50470a2 typofix 2022-01-23 23:18:23 -05:00
John Kerl
77811a4788
Sliding window averages (#894)
* todo

* Neaten existing DSL sketch

* rebase on #893, and sketch

* code-complete

* build artifacts for previous commit

* replace - with _ in shift and slwin
2022-01-23 23:03:46 -05:00
John Kerl
a2a9118ad8
Implement shift-lead option for mlr step (#893)
* iterating

* stepper-input refactor in prep for sliding-window PR

* window-keeper util class

* integrate window-keeper into step-transformer
2022-01-23 00:54:39 -05:00
John Kerl
b6bad96caf
Fix #891 (#892)
* Fix #891

* update tests; artifacts for previous commit
2022-01-20 13:34:58 -05:00
John Kerl
d25cf6fd70
Improve mlr top documentation for #861 (#875)
* Doc improvements for mlr top -a

* Build-artifacts for previous commit
2022-01-16 17:00:28 -05:00
John Kerl
a0048f0393
New format DSL function (#869)
* New format DSL function

* Updated affected test cases involving on-line help on "for" prefix

* doc-build artifacts for previous commit

* regression-test cases
2022-01-12 22:40:59 -05:00
John Kerl
1e1e03e4b3
New concat DSL function for arrays (#868)
* New concat DSL function for arrays

* Documentation artifacts for previous commit

* Regression-test cases
2022-01-12 21:14:27 -05:00
John Kerl
43e81eec20 Update version string to 6.0.0-dev for post-release 2022-01-11 09:32:14 -05:00
John Kerl
8346d332a2
Tag 6.0.0 (#850) 2022-01-09 19:51:18 -05:00
John Kerl
ebef818a00
More Miller 6 doc info (#849)
* Info on operator precedence and the REPL

* Information on indexed emit/emit1 in Miller 6
2022-01-09 19:25:44 -05:00
John Kerl
da91878939
Distinguish between JSON and JSON Lines formats (#844)
* Draw a distinction between JSON and JSON Lines formats

* Add JSON Lines to on-line help example

* Have JSON format default to --jlistwrap and --jvstack

* Update test cases for --jlistwrap output for JSON output format

* Have JSON format default to --jlistwrap and --jvstack for --{X}2j as well

* Make --jlistwrap / --jvstack as legacy flags, since now --json and --jsonl

* Add --c2l, --l2c, etc. command-line flags

* docmods for JSON Lines

* Update regression-test cases for JSON / JSON Lines distinction
2022-01-09 11:11:54 -05:00
John Kerl
8267b2220d 6.0.0.rc1 2022-01-08 15:47:19 -05:00
John Kerl
1b9526e585
More codespell fixes (#834)
* Fix mlr tail -n4

* More codespell fixes
2022-01-03 21:40:53 -05:00
Jauder Ho
587eece378
Fix low hanging fruit typos. (#825) 2022-01-03 13:49:21 -05:00
John Kerl
c4436d1a34 change version from 6.0.0-dev to 6.0.0-rc 2021-12-29 21:38:36 -05:00
John Kerl
e10fee0724
Improve type-inference performance (#809)
* To-do items for broader platform/go-version benchmarking

* neaten inferrer API

* extend type-inference unit-test cases

* Add benchmark scripts for comparing compiler versions

* mlr version in addition to mlr --version

* some go-benchmark files for Mac/Linux perf comparisons

* neaten perf-scripts

* merge

* type-scan optimization tests

* type-scan optimization infra

* test new inferrer

* mlr --time option

* include --cpuprofile and --traceprofile in on-line help

* sharpen inferred/deferred-type API distinction

* replace old inferrer with newer/faster

* update docs for new type-inferrer
2021-12-27 00:54:21 -05:00
John Kerl
25fb7f1d78
Document --norc flag (#806) 2021-12-25 13:11:58 -05:00
John Kerl
f56ab87c2d
Docs for funct keyword (#805) 2021-12-25 12:58:02 -05:00
John Kerl
096bb9bc12
Make --ifs-regex and --ips-regex explicit command-line flags (#799)
* Function-pointerize IXS/IXSRegex to reduce runtime iffelsing

* remove IsRegexString and SuppressIXSRegex

* regression tests passing

* doc updates
2021-12-25 00:00:18 -05:00
John Kerl
9c8f8680d6 Fix minor doc-formatting issue on PR #794 2021-12-22 21:29:39 -05:00
John Kerl
157e567909
Dedupe field names by default (#794) 2021-12-22 21:07:29 -05:00
John Kerl
1d3bc11b29
urandelement DSL function (#789) 2021-12-21 23:15:14 -05:00
John Kerl
93862f16f9
update mlr -O behavior for #756 (#788) 2021-12-21 22:40:34 -05:00
John Kerl
58d9ad19bc
Record hashing perf (#781)
* todo

* Rename inputChannel,outputChannel to readerChannel,writerChannel

* Rename inputChannel,outputChannel to readerChannel,writerChannel (#772)

* Start batched-reader API mods

* Singleton-list step for reader-batching at input

* CLI options for records-per-batch and hash-records

* Push channelized-reader logic into DKVP reader

* Push batching logic into chain-transformer, transformers, and channel-writer

* foo

* cmd/mprof and cmd/mprof2

* cmd/mprof3 and cmd/mprof4

* narrowed in on regexp-splitting on IFS/IPS as perf-hit

* neaten

* channelize nidx

* cmd/mprof5

* channelize CSV reader

* channelize NIDX reader

* Dedupe DKVP-reader and NIDX-reader source files

* channelize CSV-lite reader

* channelize XTAB reader

* batchify JSON reader

* channelize GEN pseudo-reader

* scripts for perf-testing on larger files

* merge with main for #776

* Fix record-batching for join and repl

* Fix comment-handling in channelized XTAB reader

* Fix bug found in positional-rename

* Use --no-hash-records by default
2021-12-14 22:41:40 -05:00
John Kerl
4c3e141df8
Split separators from context (#771)
* Fix mlr -O to return strings for all octal numbers along with 0* numbers like 07 and 08

* Factor separators out of Context struct
2021-12-06 22:47:58 -05:00
John Kerl
cef753c232
Performance improvement: buffered output (#765)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support

* Performance optmization: less frequent syscall.write on output
2021-12-01 20:12:31 -05:00
John Kerl
d9dbb1e92e
Improvements for shebang-script handling (#758)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support
2021-11-24 01:15:28 -05:00
John Kerl
f097a8dcd2 merge 2021-11-22 22:39:28 -05:00
John Kerl
6a41f73328 Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
John Kerl
4394819cf8
Approximate-match feature for online help (#754)
* Explicitly support approximate-match help

* Unit tests for exact and approximate help
2021-11-17 23:37:48 -05:00
John Kerl
b14c917a79
Neaten output of mlr stats1 --help (#751) 2021-11-15 07:46:11 -05:00
John Kerl
dba3ed5dc4 Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
John Kerl
9bb11a63b9 Make sureoan/man1/mlr.1 copy happens 2021-11-13 00:48:11 -05:00
John Kerl
c0ae15a288 Ensure 'make man' and 'make docs' use in-tree mlr executable 2021-11-12 22:41:40 -05:00
John Kerl
bc72cd1857
More Go-package restructuring (#748) 2021-11-12 12:49:55 -05:00
John Kerl
227a37f124 minor neaten of ./configure 2021-11-11 19:06:55 -05:00
Stephen Kitt
3423f61bda
Support DESTDIR when installing (#745)
In autoconf-style builds, DESTDIR is used to install to somewhere
other than /; this is used in particular by packaging systems to
"install" to a staging area before archiving the package contents.

See https://www.gnu.org/prep/standards/html_node/DESTDIR.html for the
specification.

Signed-off-by: Stephen Kitt <steve@sk2.org>
2021-11-11 14:47:09 -05:00
John Kerl
e2b6ec2391
Standardize Go-package structure (#746) 2021-11-11 14:15:13 -05:00
John Kerl
0d4fc143ad rename make precommit to make dev 2021-11-11 00:02:24 -05:00
John Kerl
c5a0531189 update man/Makefile .PHONY targets 2021-11-10 12:44:05 -05:00
John Kerl
db69402e24 make sure manpage gets updated on make build check install 2021-11-10 10:13:14 -05:00
John Kerl
92bc0f3b00
'make release_tarball' target, Go analog of C 'make distcheck' (#742) 2021-11-10 09:09:49 -05:00