Commit graph

68 commits

Author SHA1 Message Date
John Kerl
23aefb5646
Fix issue 1032 (#1048)
* Fix issue 1032

* test files
2022-07-04 16:07:12 -04:00
John Kerl
52ce2473fb
Fix issue 1037 (#1047)
* Fix issue 1037

* test files
2022-07-04 15:40:42 -04:00
John Kerl
e91d19de25 typofix 2022-05-14 14:47:14 -04:00
John Kerl
18a6977749
Fix ASCII vs UTF-8 in TSV writer (#1023)
* Fix ASCII vs UTF-8 in TSV writer

* regression-test case
2022-05-02 20:52:34 -04:00
John Kerl
d50f22924a
Allow x ** - y and x ** + y in the DSL grammar (#1021)
* Allow x ** - y in the DSL grammar

* Parser-generator artifacts

* AST-builder support

* regression-test cases

* comments
2022-05-02 01:03:24 -04:00
John Kerl
2e727829c4
Accept + in exponent of scientific-notation floating-point DSL literals (#1020)
* Accept + in scientific-notation floating-point DSL literals

* Parser-generator artifacts; unit-test update; go mod update
2022-05-01 23:39:03 -04:00
John Kerl
d03ef16cfc
Add line/column info for DSL runtime non-parse failures (#998)
* Add line/column info for DSL runtime non-parse failures

* Other related callsites

* test cases

* Update already-existing test cases
2022-03-20 21:57:11 -04:00
John Kerl
2408915160
DSL functions and verbs for UTF-8 <-> Latin-1 (#997)
* latin1_to_utf8 and utf8_to_latin1 DSL functions

* doc-build artifacts for previous commit

* Test cases for latin1_to_utf8 and utf8_to_latin1

* extend on-line help

* latin1_to_utf8 and utf8_to_latin1 verbs

* unit-test cases for verbs

* Keep with kebab-case naming convention for verbs

* webdocs
2022-03-20 17:29:40 -04:00
John Kerl
f9e3256367
gssub DSL function (#989)
* gssub DSL function

* build artifacts for gssub source-code change

* unit-test files

* gssub / Latin 1 example in docs

* code-dedupe ssub and gssub
2022-03-18 23:48:27 -04:00
John Kerl
42a39a86ac
Use fixed OFMT for multi-platform regression-testing (#988)
* Use fixed OFMT for multi-platform regression-testing

* Update regression tests to use fixed OFMT
2022-03-16 14:44:42 -04:00
John Kerl
8f04d7671d
Restore --tsvlite (#984)
* Restore --tsvlite flag

* todo

* doc-build artifacts

* doc note on --tsv vs --tsvlite and backslashed data
2022-03-15 09:01:20 -04:00
John Kerl
47ef5de0bb
Let dhms2sec accept input like "8h" (#983)
* Let dhms2sec accept input like "8h"

* Regression-test cases
2022-03-14 23:47:50 -04:00
John Kerl
3aebb68ad6 test cases and doc-build artifacts 2022-02-24 09:57:34 -05:00
John Kerl
9b806f9561
Add --left-keep-fields option for mlr join (#967)
* Add --left-keep-fields option for mlr join

* on-line help for mlr join --lk

* doc-build artifacts

* test cases
2022-02-23 23:32:19 -05:00
John Kerl
bfd2ec14c0 Fix test cases to match the new reality 2022-02-21 23:37:05 -05:00
John Kerl
763ad96b87 Fix test cases to match the new reality 2022-02-21 23:22:50 -05:00
John Kerl
228f73415e
Add --implicit-tsv-header as alias for --implicit-csv-header, etc (#952)
* Add -implicit-tsv-header as aliias for --implicit-csv-header, etc

* doc-build artifacts for previous commit
2022-02-21 12:48:43 -05:00
John Kerl
47a427b00c
Fix "%%" in strptime; more test cases for strptime (#951)
* strptime debug mode

* Fix strptime %% format code

* internal/pkg/pbnjay-strptime/strptime_test.go; reg-test files

* Web-doc improvements for strftime and strptime

* doc-build artifacts
2022-02-21 12:21:04 -05:00
John Kerl
bb95f37066
New fmtifnum DSL function; make fmtnum/fmtifnum recursive over maps and arrays (#946)
* New fmtifnum DSL function

* doc-build artifacts for previous commit

* Make fmtnum/fmtifnum recursive over maps and arrays

* Online-help examples for fmtnum/fmtifnum

* doc-build artifacts for previous commit

* unit-test cases

* code-dedupe
2022-02-14 23:57:14 -05:00
John Kerl
9d0159700c
Support %F, %T, and more in strptime (#944)
* Support %F, %T, and more in strptime

* Unit-test cases

* code-neaten
2022-02-13 19:38:17 -05:00
John Kerl
f444459b25
Fix handling of mlr nest abbrevs (#937)
* Fix handling of mlr nest abbrevs

* expanded test cases
2022-02-10 10:17:39 -05:00
John Kerl
d67868bd33
Add Inf and NaN literals to the DSL (#933)
* Add Inf and NaN literals to the DSL

* Parser-build artifacts

* is_nan DSL function

* doc-build artifacts

* webdoc material
2022-02-08 09:58:50 -05:00
John Kerl
ca9505dfaf
Natural sort (#932)
* Add natural sort order as an option for the sort verb

* Add natural sort order as an option for the sort DSL function

* doc-build artifacts for on-line help

* webdocs

* codespell fix

* unit-test files for sort verb

* unit-test files for sort DSL function
2022-02-08 00:35:28 -05:00
John Kerl
12e457bc96
strptime %j format for 3-digit day in year (#930)
* strptime %j format for 3-digit day in year

* doc mods
2022-02-07 09:10:27 -05:00
John Kerl
b983f825c0 Clarify time on-line help 2022-02-06 13:25:35 -05:00
John Kerl
9f3b1c8711
Fix is_non_empty for absent case (#928) 2022-02-06 13:10:36 -05:00
John Kerl
9f5a11f707
New --lazy-quotes flag for helping with malformed CSV (#925)
* Lazy-quotes option for CSV parser

* doc-build artifacts

* test cases

* doc-proofreads
2022-02-06 01:05:35 -05:00
John Kerl
66c4a077fd
Make TSV finally true TSV (#923)
* Spec-TSV

* doc mods; more test cases
2022-02-06 00:13:55 -05:00
John Kerl
9b61ccf05c fix merge 2022-01-30 14:14:01 -05:00
John Kerl
1a8d7edfd0 fix merge 2022-01-30 12:14:25 -05:00
John Kerl
971255ff2b typofix 2022-01-30 12:06:23 -05:00
Stephen Kitt
d536318ed6
Use int64 wherever "64-bit integer" is assumed (#902)
Miller assumes 64-bit integers, but in Go, the int type varies in size
depending on the architecture: 32-bit architectures have int
equivalent to int32. As a result, the supported range of integer
values is greatly reduced on 32-bit architectures compared to what is
suggested by the documentation.

This patch explicitly uses int64 wherever 64-bit integers are
assumed.

Test cases affected by the behaviour of the random generator are
updated to reflect the new values (the existing seed doesn't produce
the same behaviour since the way random values are generated has
changed).

Signed-off-by: Stephen Kitt <steve@sk2.org>
2022-01-27 12:06:25 -05:00
John Kerl
f7ff63124b
mlr split verb (#898)
* mlr split

* regression-test cases

* doc-build artifacts
2022-01-26 23:16:25 -05:00
John Kerl
62a50fb9a5 Fix slwin-7-2 -> slwin_7_2 doc info 2022-01-24 16:33:05 -05:00
John Kerl
b4c50470a2 typofix 2022-01-23 23:18:23 -05:00
John Kerl
77811a4788
Sliding window averages (#894)
* todo

* Neaten existing DSL sketch

* rebase on #893, and sketch

* code-complete

* build artifacts for previous commit

* replace - with _ in shift and slwin
2022-01-23 23:03:46 -05:00
John Kerl
a2a9118ad8
Implement shift-lead option for mlr step (#893)
* iterating

* stepper-input refactor in prep for sliding-window PR

* window-keeper util class

* integrate window-keeper into step-transformer
2022-01-23 00:54:39 -05:00
John Kerl
b6bad96caf
Fix #891 (#892)
* Fix #891

* update tests; artifacts for previous commit
2022-01-20 13:34:58 -05:00
John Kerl
4fb0b716ba
Make is_null/is_not_null DSL functions include new JSON-null type (#883)
* Make is_null/is_not_null DSL functions include new JSON-null type

* regression-test files
2022-01-18 08:25:03 -05:00
John Kerl
eb7e29d207 neaten 2022-01-17 22:57:19 -05:00
Stephen Kitt
af7bacf00e
Avoid assuming ./mlr is the mlr to test (#876)
In test cases, support a ${MLR} placeholder for the mlr binary under
test, instead of assuming it's ./mlr (or its equivalent on platforms
not using forward slashes).

This ensures that wrapped mlr invocations all use the same binary,
either the default or the binary specified by the user, avoiding
surprises when ./mlr doesn't exist or is a different version.

Signed-off-by: Stephen Kitt <steve@sk2.org>
2022-01-17 17:01:40 -05:00
John Kerl
d25cf6fd70
Improve mlr top documentation for #861 (#875)
* Doc improvements for mlr top -a

* Build-artifacts for previous commit
2022-01-16 17:00:28 -05:00
John Kerl
a25e34bab7 neaten 2022-01-13 10:34:11 -05:00
John Kerl
1785f8d111 doc-build artifacts for previous commit 2022-01-13 09:46:39 -05:00
John Kerl
e53dee0871 regression tests 2022-01-13 09:28:46 -05:00
John Kerl
ae722de887 neaten tree structure of a regression-test case 2022-01-12 22:44:05 -05:00
John Kerl
a0048f0393
New format DSL function (#869)
* New format DSL function

* Updated affected test cases involving on-line help on "for" prefix

* doc-build artifacts for previous commit

* regression-test cases
2022-01-12 22:40:59 -05:00
John Kerl
1e1e03e4b3
New concat DSL function for arrays (#868)
* New concat DSL function for arrays

* Documentation artifacts for previous commit

* Regression-test cases
2022-01-12 21:14:27 -05:00
John Kerl
67179eb791
Allow 0o... octal literals in the DSL (#864)
* Continue from #856

* Update expected-fail messages in test cases

* Allow 0o... octal literals in the DSL

* Build artifacts for previous commit

* go.mod/go.sum for goccmack/gocc

* Regression-test case

* Doc updates
2022-01-11 19:46:45 -05:00
John Kerl
b903227a5c
Continue #856 (#865)
* Continue from #856

* Update expected-fail messages in test cases
2022-01-11 19:42:08 -05:00