John Kerl
2bcf8813d3
Add a --files option ( #1426 )
...
* mlr --files
* doc mods
2023-11-11 19:09:02 -05:00
John Kerl
5b6a1d4713
JSONL output does not properly handle keys with quotes ( #1425 )
...
* mlr --l2j, --j2l
* make dev for previous commit
* fix #1424
* unit-test cases
* iterate
2023-11-11 18:58:49 -05:00
dependabot[bot]
f2a9ae5ca4
Bump golang.org/x/term from 0.13.0 to 0.14.0 ( #1423 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/term/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-08 08:26:13 -05:00
dependabot[bot]
dd12026fba
Bump golang.org/x/sys from 0.13.0 to 0.14.0 ( #1420 )
...
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/sys/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-06 09:35:40 -05:00
dependabot[bot]
e4882b11ed
Bump golang.org/x/text from 0.13.0 to 0.14.0 ( #1419 )
...
Bumps [golang.org/x/text](https://github.com/golang/text ) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/golang/text/releases )
- [Commits](https://github.com/golang/text/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/text
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-06 09:35:23 -05:00
Eng Zer Jun
4b34f80f6a
transformers/grep: avoid allocations with (*regexp.Regexp).MatchString ( #1416 )
...
We should use `(*regexp.Regexp).MatchString` instead of
`(*regexp.Regexp).Match([]byte(...))` when matching string to avoid
unnecessary `[]byte` conversions and reduce allocations.
Example benchmark:
var grepRegex = regexp.MustCompile("foo.*")
func BenchmarkMatch(b *testing.B) {
for i := 0; i < b.N; i++ {
if match := grepRegex.Match([]byte("foo bar baz")); !match {
b.Fail()
}
}
}
func BenchmarkMatchString(b *testing.B) {
for i := 0; i < b.N; i++ {
if match := grepRegex.MatchString("foo bar baz"); !match {
b.Fail()
}
}
}
goos: linux
goarch: amd64
pkg: github.com/johnkerl/miller/pkg/transformers
cpu: AMD Ryzen 7 PRO 4750U with Radeon Graphics
BenchmarkMatch-16 5700908 210.3 ns/op 16 B/op 1 allocs/op
BenchmarkMatchString-16 8006731 156.4 ns/op 0 B/op 0 allocs/op
PASS
ok github.com/johnkerl/miller/pkg/transformers 2.857s
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-10-27 09:15:12 -04:00
John Kerl
6aab161cb0
neaten README.md
2023-10-24 09:12:47 -04:00
Ralph Ursprung
d3798c5aee
add winget to README ( #1414 )
...
@teo-tsirpanis added miller to `winget` with
microsoft/winget-pkgs#123507 (thanks!).
accordingly it should also be mentioned in the README so that people are
aware of it.
fixes #1331
2023-10-24 09:10:18 -04:00
dependabot[bot]
9a8951fc78
Bump actions/checkout from 4.1.0 to 4.1.1 ( #1412 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 4.1.0 to 4.1.1.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](8ade135a41...b4ffde65f4
2023-10-18 09:36:53 -04:00
dependabot[bot]
a343d0f34c
Bump github.com/mattn/go-isatty from 0.0.19 to 0.0.20 ( #1411 )
...
Bumps [github.com/mattn/go-isatty](https://github.com/mattn/go-isatty ) from 0.0.19 to 0.0.20.
- [Commits](https://github.com/mattn/go-isatty/compare/v0.0.19...v0.0.20 )
---
updated-dependencies:
- dependency-name: github.com/mattn/go-isatty
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-17 09:44:39 -04:00
dependabot[bot]
d785ea3e55
Bump golang.org/x/term from 0.12.0 to 0.13.0 ( #1404 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.12.0 to 0.13.0.
- [Commits](https://github.com/golang/term/compare/v0.12.0...v0.13.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-06 08:29:25 -04:00
dependabot[bot]
654577c776
Bump actions/checkout from 4.0.0 to 4.1.0 ( #1400 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 4.0.0 to 4.1.0.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](3df4ab11eb...8ade135a41
2023-09-25 09:02:02 -04:00
dependabot[bot]
d19b91ec6b
Bump goreleaser/goreleaser-action from 4.6.0 to 5.0.0 ( #1396 )
...
Bumps [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action ) from 4.6.0 to 5.0.0.
- [Release notes](https://github.com/goreleaser/goreleaser-action/releases )
- [Commits](5fdedb94ab...7ec5c2b0c6
2023-09-12 08:36:06 -04:00
John Kerl
087f4bb4c9
Include null in any typemask ( #1395 )
2023-09-11 17:15:37 -04:00
John Kerl
5136507192
Name-neaten for #1392 ( #1393 )
2023-09-10 20:01:41 -04:00
John Kerl
39fa3a19bc
Better API example ( #1392 )
2023-09-10 19:47:42 -04:00
John Kerl
03eed305f9
doc tweaks
2023-09-10 17:23:50 -04:00
John Kerl
268a96d002
Export library code in pkg/ ( #1391 )
...
* Export library code in `pkg/`
* new doc page
2023-09-10 17:15:13 -04:00
dependabot[bot]
93b7c8eac0
Bump actions/cache from 3.3.1 to 3.3.2 ( #1390 )
...
Bumps [actions/cache](https://github.com/actions/cache ) from 3.3.1 to 3.3.2.
- [Release notes](https://github.com/actions/cache/releases )
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md )
- [Commits](88522ab9f3...704facf57e
2023-09-08 10:01:26 -04:00
dependabot[bot]
5519179122
Bump actions/upload-artifact from 3.1.2 to 3.1.3 ( #1387 )
...
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact ) from 3.1.2 to 3.1.3.
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](0b7f8abb15...a8a3f3ad30
2023-09-07 09:09:23 -04:00
dependabot[bot]
2b77328b0f
Bump goreleaser/goreleaser-action from 4.4.0 to 4.6.0 ( #1385 )
...
Bumps [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action ) from 4.4.0 to 4.6.0.
- [Release notes](https://github.com/goreleaser/goreleaser-action/releases )
- [Commits](3fa32b8bb5...5fdedb94ab
2023-09-06 09:45:47 -04:00
dependabot[bot]
587b7ce313
Bump actions/checkout from 3.6.0 to 4.0.0 ( #1383 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 3.6.0 to 4.0.0.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](f43a0e5ff2...3df4ab11eb
2023-09-05 09:36:21 -04:00
dependabot[bot]
67bd565a53
Bump golang.org/x/term from 0.11.0 to 0.12.0 ( #1380 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.11.0 to 0.12.0.
- [Commits](https://github.com/golang/term/compare/v0.11.0...v0.12.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 20:29:51 -04:00
dependabot[bot]
9ab9c2f4e8
Bump golang.org/x/sys from 0.11.0 to 0.12.0 ( #1381 )
...
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.11.0 to 0.12.0.
- [Commits](https://github.com/golang/sys/compare/v0.11.0...v0.12.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 17:22:41 -04:00
dependabot[bot]
717189b6b1
Bump golang.org/x/text from 0.12.0 to 0.13.0 ( #1382 )
...
Bumps [golang.org/x/text](https://github.com/golang/text ) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/golang/text/releases )
- [Commits](https://github.com/golang/text/compare/v0.12.0...v0.13.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/text
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 17:21:23 -04:00
John Kerl
80bb82df6b
macos -> darwin in .goreleaser.yml (#1377 )
2023-08-31 10:51:07 -04:00
John Kerl
640dbdc730
Remove replacements from .goreleaser.yaml ( #1376 )
2023-08-31 10:15:29 -04:00
John Kerl
acc10cdc37
miller 6.9.0
2023-08-31 09:00:29 -04:00
John Kerl
0493a0debd
Fatal-on-data-error mlr -x option ( #1373 )
...
* Fatal-on-data-error `mlr -x` option [WIP]
* arithmetic.go error-reason propagation
* more
* more
* more
* renames
* doc page
* namefix
* fix broken test
* make dev
2023-08-30 19:39:22 -04:00
John Kerl
879f272f79
Typofix in uif/uof percentiles ( #1375 )
...
* typofix in uif/uof percentiles
* fix regression-test data
2023-08-30 11:13:35 -04:00
John Kerl
2fd353c6be
docmods for typofix
2023-08-30 09:00:24 -04:00
John Kerl
4c26b479f0
typofix
2023-08-30 07:32:04 -04:00
John Kerl
5146dd7f90
New contains DSL function ( #1374 )
...
* New `contains` DSL function
* unit-test files, and docs
2023-08-27 21:46:24 -04:00
John Kerl
5b29169b08
Update 2015-era Python sketch to Python 3 ( #1372 )
2023-08-27 10:08:34 -04:00
John Kerl
71171bc04c
Treat empty like absent in + - * ( #1371 )
...
* empty plus value is value
* unit-test cases
* make-docs output
* docs files
* on-line table for null-handling arithmetic rules
* doc mods
2023-08-26 23:41:50 -04:00
John Kerl
c7b4ed59d0
Merge branch 'main' of https://github.com/johnkerl/miller
2023-08-26 22:49:52 -04:00
John Kerl
67d16c89c1
typofix
2023-08-26 22:49:28 -04:00
John Kerl
069c068298
Summing up empty data ( #1370 )
...
* empty plus value is value
* unit-test cases
* make-docs output
* docs files
* on-line table for null-handling arithmetic rules
* doc mods
2023-08-26 21:24:34 -04:00
John Kerl
fccb7c63bb
doc-neaten
2023-08-26 16:51:44 -04:00
John Kerl
fb3e3d15cd
make dev
2023-08-26 16:47:19 -04:00
John Kerl
44e3a62373
typofix
2023-08-26 16:44:39 -04:00
John Kerl
077fc3702d
more doc-neatens for percentiles on-line help
2023-08-26 16:41:37 -04:00
John Kerl
4cfb0ba112
neaten online help for the percentiles function
2023-08-26 16:30:21 -04:00
John Kerl
deb5d692a8
typofixes
2023-08-26 16:23:48 -04:00
John Kerl
d341cc6dd3
DSL functions for summary stats over arrays / maps ( #1364 )
...
* DSL stats functions [WIP]
* refactor
* move percentile computation to bifs module; iterate
* mode and antimode
* percentile iterate
* percentile sketching
* neaten
* unit-test iterate
* unify old & new min & max functions
* unit-test cases
* code-dedupe between mode and antimode
* make mode/antimode ties deterministic via first-found-wins rule
* online help strings for new stats DSL functions
* artifacts from `make dev`
* help info on how min/max now recurse into collections
* artifacts from `make dev`
* typofix
2023-08-26 16:02:30 -04:00
dependabot[bot]
392b34fd04
Bump actions/checkout from 3.5.3 to 3.6.0 ( #1369 )
...
Bumps [actions/checkout](https://github.com/actions/checkout ) from 3.5.3 to 3.6.0.
- [Release notes](https://github.com/actions/checkout/releases )
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md )
- [Commits](c85c95e3d7...f43a0e5ff2
2023-08-25 09:06:03 -04:00
John Kerl
4405f732a1
make-dev artifacts from previous commit
2023-08-23 16:19:37 -04:00
John Kerl
deda2a967e
1366 follow-up
2023-08-23 16:09:40 -04:00
Mr. Lance E Sloan
e2338195ba
filename options for split (iss. #1365 ) ( #1366 )
...
* #1365 - filename options for `split`
* Don't use joiner string when prefix is empty.
* Add option to specify joiner string.
* Add option to not URL-escape file names.
* #1365 - update documentation
* #1365 - don't URL-escape file name prefix
I **_thought_** it'd be cool to apply URL-escaping to the file name prefix as well, just in case it included spaces or other characters. I forgot that a common use for the prefix is to specify a directory path that will contain the file. When the slashes ("`/`") of the path are URL-escaped, they become "`%2F`" and the directories will not be created. So, I moved the prefix handling code to come after the URL-escaping.
* #1365 - new `split` options for CLI help output
* #1365 - fix escape/suffix logic error
Trying to make the `return` statement cleaner, I thought it'd be good to add the file name suffix immediately after the file name is URL-escaped. I'd forgotten that the suffix will not be added if the new `-e` option is used to skip URL-escaping. So, I put the suffix back where I had it.
* #1365 - add `split` to the "10 minutes" document
Not strictly part of this issue, but as I was checking for docs that I should update as a result of my changes, I noticed this document showed how to split data using the `put` and `tee` combination, but not about the `split` verb.
* #1365 - updated manpage
When I ran `make dev`, generating `data-diving-examples.md` failed. The two `manpage.txt` files ended up empty, but `mlr.1` seems to be correct.
---------
Co-authored-by: Mr. Lance E Sloan (sloanlance) <sloanlance@users.noreply.github.com>
2023-08-23 16:08:48 -04:00
Eng Zer Jun
12f3b14ce6
Remove redundant nil check ( #1367 )
...
From the Go docs [1]:
"1. For a nil slice, the number of iterations is 0."
"3. If the map is nil, the number of iterations is 0."
Therefore, an additional nil check for before the loop is unnecessary.
[1]: https://go.dev/ref/spec#For_range
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-08-23 10:18:22 -04:00
