John Kerl
3893268f94
sort-link doc update
2024-02-05 09:40:06 -05:00
John Kerl
dba71136e9
Update release docs
2024-01-23 18:32:38 -05:00
John Kerl
2582ee7ea6
6.11.0 docs for readthedocs
2024-01-23 17:49:34 -05:00
John Kerl
6f24fb3999
miller.spec typofix
2024-01-23 17:35:31 -05:00
John Kerl
1834a925b3
Miller 6.11.0 ( #1481 )
...
* miller 6.11.0
* Artifacts from `make dev`
2024-01-23 17:31:58 -05:00
John Kerl
e5ec9f67bd
Implement all/by-regex field selection (-a/-r) for mlr sub, gsub, and ssub ( #1480 )
...
* Code-dedupe `sub`, `gsub`, and `ssub` verbs
* More dedupe
* Start with -a
* Implement -r
* unit-test cases
* Windows command-line parsing
2024-01-23 17:18:13 -05:00
John Kerl
81d11365a0
mlr reorder with regex support [WIP] (#1473 )
...
* mlr reorder with regex support for field-name selection
* neaten
* -r -b/-a; unit-test cases
2024-01-21 15:17:33 -05:00
John Kerl
ac65675ab1
Auto-unsparsify CSV and TSV on output ( #1479 )
...
* Auto-unsparsify CSV
* Update unit-test cases
* More unit-test cases
* Key-change handling for CSV output
* Same for TSV, with unit-test and doc updates
2024-01-20 18:43:49 -05:00
John Kerl
af021f28d7
Support markdown format on input ( #1478 )
...
* Support markdown on input
* unit-test files
* doc mods
* Unit-test cases for I/O-format keystroke-savers
* -i/-o md as well as -i/-o markdown
2024-01-20 16:51:15 -05:00
John Kerl
2abb9b4729
Don't run regression tests twice in GitHub CI ( #1477 )
2024-01-20 14:24:12 -05:00
John Kerl
36b4654445
Fix typos in tests for PPRINT barred input ( #1476 )
2024-01-20 14:07:27 -05:00
John Kerl
bfc829a381
Internal name-neatens ( #1475 )
2024-01-20 13:36:28 -05:00
John Kerl
aff07efe3a
typofix
2024-01-20 13:01:37 -05:00
John Kerl
794a754c36
Support PPRINT barred input ( #1472 )
...
* Support PPRINT barred input
* regression-test files
* output from `make dev`
* doc updates
2024-01-20 12:59:12 -05:00
dependabot[bot]
76408f3358
Bump actions/upload-artifact from 4.1.0 to 4.2.0 ( #1471 )
...
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact ) from 4.1.0 to 4.2.0.
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](1eb3cb2b3e...694cdabd8b
2024-01-19 09:17:18 -05:00
dependabot[bot]
ee30154c6f
Bump actions/cache from 3.3.3 to 4.0.0 ( #1470 )
...
Bumps [actions/cache](https://github.com/actions/cache ) from 3.3.3 to 4.0.0.
- [Release notes](https://github.com/actions/cache/releases )
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md )
- [Commits](e12d46a63a...13aacd865c
2024-01-17 09:30:49 -05:00
dependabot[bot]
4c0bd62b64
Bump actions/upload-artifact from 4.0.0 to 4.1.0 ( #1469 )
...
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact ) from 4.0.0 to 4.1.0.
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](c7d193f32e...1eb3cb2b3e
2024-01-15 15:24:47 -05:00
dependabot[bot]
f2be82b7bb
Bump actions/cache from 3.3.2 to 3.3.3 ( #1468 )
...
Bumps [actions/cache](https://github.com/actions/cache ) from 3.3.2 to 3.3.3.
- [Release notes](https://github.com/actions/cache/releases )
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md )
- [Commits](704facf57e...e12d46a63a
2024-01-12 09:42:38 -05:00
dependabot[bot]
664a84fadb
Bump golang.org/x/term from 0.15.0 to 0.16.0 ( #1466 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.15.0 to 0.16.0.
- [Commits](https://github.com/golang/term/compare/v0.15.0...v0.16.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-05 07:41:39 -05:00
John Kerl
d2559b8387
Have clean_whitespace re-run type inference ( #1464 )
...
* Have `clean_whitespace` re-infer types
* make dev output
* unit-test files
* drive-by typofix
* make dev output
2024-01-01 18:39:27 -05:00
John Kerl
2f42c6f508
Fix #1462 : remove limit of 1000 on dedupe field names ( #1463 )
...
* Fix #1462 : remove limit of 1000 on dedupe field names
* make dev output
2024-01-01 17:50:56 -05:00
John Kerl
e3b98cd621
On-line help info for mlr join --lk "" ( #1458 )
...
* Doc info for `mlr join --lk ""`
* make dev output
2023-12-24 12:43:26 -05:00
John Kerl
0e3a54ed68
Implement mlr uniq -x ( #1457 )
...
* mlr uniq -x
* unit-test cases
* make dev
2023-12-23 16:20:11 -05:00
Eng Zer Jun
f4cf166358
Replace deprecated io/ioutil functions ( #1452 )
...
The io/ioutil package has been deprecated as of Go 1.16 [1]. This commit
replaces the existing io/ioutil functions with their new definitions in
io and os packages.
[1]: https://golang.org/doc/go1.16#ioutil
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-12-20 09:44:02 -05:00
John Kerl
c6b745537a
New strmatch/strmatchx DSL functions ( #1448 )
...
* New `match`/`matchx` DSL functions
* unit-test cases
* match/matchx -> strmatch/strmatchx
* help strings for strmatch and strmatchx
* update regex doc page re strmatch/strmatchx
* unit-test update
2023-12-19 14:34:54 -05:00
John Kerl
211b15ad4f
make docs
2023-12-19 09:52:16 -05:00
John Kerl
4706b4bb78
Document and unit-test regex-capture reset logic ( #1451 )
...
* mlr --norc cat was erroring
* Document and unit-test regex-capture reset logic
2023-12-19 09:47:59 -05:00
John Kerl
b13adbe6c0
mlr --norc cat was erroring ( #1450 )
2023-12-19 09:33:34 -05:00
John Kerl
4053d7684c
Preserve regex captures across stack frames ( #1447 )
...
* privatize state.RegexCaptures
* stack frame for regex captures
* merge
* unit-test case
* docs re stack frames for regex captures
* more
2023-12-18 10:21:09 -05:00
John Kerl
1ae670fd4a
Rename internal regex functions ( #1446 )
2023-12-17 12:46:28 -05:00
dependabot[bot]
b5dbd7a751
Bump actions/upload-artifact from 3.1.3 to 4.0.0 ( #1445 )
...
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact ) from 3.1.3 to 4.0.0.
- [Release notes](https://github.com/actions/upload-artifact/releases )
- [Commits](a8a3f3ad30...c7d193f32e
2023-12-15 09:42:47 -05:00
John Kerl
4e60ef58ae
release docs including 6.9.0 and 6.10.0
2023-12-13 20:51:37 -05:00
John Kerl
856131f7a2
6.10.0-dev
2023-12-13 19:31:59 -05:00
John Kerl
c680f3316e
add doc note re snag found on last commit
2023-12-13 19:04:48 -05:00
John Kerl
34abb952a4
update go 1.18 -> 1.19 in more spots
2023-12-13 19:00:57 -05:00
John Kerl
fbf320d88a
update path in create_release_tarball
2023-12-13 18:46:16 -05:00
John Kerl
1f0e9be581
Merge branch 'main' of github.com:johnkerl/miller
2023-12-13 18:43:21 -05:00
John Kerl
9caa24d7f1
miller 6.10.0 ( #1442 )
...
* neaten
* miller 6.10.0
2023-12-13 18:43:00 -05:00
John Kerl
f1bc1dace9
neaten
2023-12-13 17:58:07 -05:00
John Kerl
8750d0e3c4
Update to Go 1.19 ( #1441 )
2023-12-11 17:38:13 -05:00
dependabot[bot]
b1e2438b28
Bump actions/setup-go from 4.1.0 to 5.0.0 ( #1436 )
...
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 4.1.0 to 5.0.0.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](93397bea11...0c52d547c9
2023-12-07 07:56:29 -05:00
John Kerl
bae1daf847
Absent variable on left side of boolean OR (||) expression makes it absent ( #1434 )
...
* Absent-handling with short-circuiting operators `&&` and `||`
* add a missing file
* artifacts from make dev
* type-errors
* doc content
* artifacts from make dev
2023-12-02 16:00:05 -05:00
dependabot[bot]
3a3595e404
Bump golang.org/x/term from 0.14.0 to 0.15.0 ( #1432 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.14.0 to 0.15.0.
- [Commits](https://github.com/golang/term/compare/v0.14.0...v0.15.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-28 09:25:11 -05:00
John Kerl
18a9eaa377
Fix ragged-CSV auto-pad ( #1428 )
2023-11-19 23:53:53 -05:00
John Kerl
2bcf8813d3
Add a --files option ( #1426 )
...
* mlr --files
* doc mods
2023-11-11 19:09:02 -05:00
John Kerl
5b6a1d4713
JSONL output does not properly handle keys with quotes ( #1425 )
...
* mlr --l2j, --j2l
* make dev for previous commit
* fix #1424
* unit-test cases
* iterate
2023-11-11 18:58:49 -05:00
dependabot[bot]
f2a9ae5ca4
Bump golang.org/x/term from 0.13.0 to 0.14.0 ( #1423 )
...
Bumps [golang.org/x/term](https://github.com/golang/term ) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/term/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/term
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-08 08:26:13 -05:00
dependabot[bot]
dd12026fba
Bump golang.org/x/sys from 0.13.0 to 0.14.0 ( #1420 )
...
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/sys/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-06 09:35:40 -05:00
dependabot[bot]
e4882b11ed
Bump golang.org/x/text from 0.13.0 to 0.14.0 ( #1419 )
...
Bumps [golang.org/x/text](https://github.com/golang/text ) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/golang/text/releases )
- [Commits](https://github.com/golang/text/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/text
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-06 09:35:23 -05:00
Eng Zer Jun
4b34f80f6a
transformers/grep: avoid allocations with (*regexp.Regexp).MatchString ( #1416 )
...
We should use `(*regexp.Regexp).MatchString` instead of
`(*regexp.Regexp).Match([]byte(...))` when matching string to avoid
unnecessary `[]byte` conversions and reduce allocations.
Example benchmark:
var grepRegex = regexp.MustCompile("foo.*")
func BenchmarkMatch(b *testing.B) {
for i := 0; i < b.N; i++ {
if match := grepRegex.Match([]byte("foo bar baz")); !match {
b.Fail()
}
}
}
func BenchmarkMatchString(b *testing.B) {
for i := 0; i < b.N; i++ {
if match := grepRegex.MatchString("foo bar baz"); !match {
b.Fail()
}
}
}
goos: linux
goarch: amd64
pkg: github.com/johnkerl/miller/pkg/transformers
cpu: AMD Ryzen 7 PRO 4750U with Radeon Graphics
BenchmarkMatch-16 5700908 210.3 ns/op 16 B/op 1 allocs/op
BenchmarkMatchString-16 8006731 156.4 ns/op 0 B/op 0 allocs/op
PASS
ok github.com/johnkerl/miller/pkg/transformers 2.857s
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-10-27 09:15:12 -04:00
