Commit graph

9394 commits

Author SHA1 Message Date
John Kerl
f8a8f29584
Experiment with mlr script (#2009) 2026-03-05 20:14:32 -05:00
John Kerl
d0079a9dac
Simplify positional-indexing syntax in mlr.bnf; push logic to .go source (#2008)
* Move `$[[...]]` and `$[[[...]]]` out of the grammar and into Go

* Update pkg/parsing/mlr.bnf

* Update Go source

* update test files

* Fix NPE

* .gitignore

* more
2026-03-04 21:48:09 -05:00
John Kerl
ed84aeb300 yet more staticcheck 2026-03-03 10:17:01 -05:00
John Kerl
718ec1685a
More staticcheck fixes (#2007)
* more staticcheck

* more staticcheck
2026-03-03 10:07:12 -05:00
John Kerl
761b46219c
Some fixes for staticcheck (#2006)
* Implement some staticcheck fixes

* make fmt

* more

* more staticcheck
2026-03-03 09:27:03 -05:00
John Kerl
1efadc9ea8 CLAUDE.md 2026-03-03 08:39:37 -05:00
John Kerl
ed0ae66ac2
Fix #1998 (#2005) 2026-03-02 23:49:31 -05:00
John Kerl
56add7d1f0
Fix #1784: inconsistent mapexcept behavior (#2004)
* Fix #1784

* test/cases/dsl-mapsum-mapdiff-mapexcept/0033/
2026-03-02 23:41:32 -05:00
John Kerl
5f14dbc752
Add LRU-caching for split (#2003) 2026-03-02 23:31:44 -05:00
John Kerl
102c624cee
Add DKVPX file format (#2002)
* Initial DKVPX parser

* pkg/input/record_reader_dkvpx*go

* pkg/output/record_writer_dkvpx.go

* docs update

* make fmt

* perf note
2026-03-02 22:35:08 -05:00
dependabot[bot]
2e179e7a14
Bump github/codeql-action from 4.32.4 to 4.32.5 (#2001)
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 4.32.4 to 4.32.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](89a39a4e59...c793b717bc)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-version: 4.32.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-02 08:57:27 -05:00
John Kerl
b7ee4500af
Language-timings reorg (#2000)
* reorg

* naive

* optimizing

* .gitignore

* more
2026-03-01 18:13:58 -05:00
Balki
de31cb1fc8
Add fixed width support for pprint reader (#1999)
* Add fixed width support for pprint reader

* fix windows fail

* fix windows fail 2
2026-03-01 11:25:17 -05:00
dependabot[bot]
e9ec42abef
Bump actions/upload-artifact from 6.0.0 to 7.0.0 (#1996)
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 6.0.0 to 7.0.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](b7c566a772...bbbca2ddaa)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-version: 7.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-27 09:18:56 -05:00
dependabot[bot]
61f8114a0b
Bump actions/setup-go from 6.2.0 to 6.3.0 (#1995)
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 6.2.0 to 6.3.0.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](7a3fe6cf4c...4b73464bb3)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-version: 6.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-26 10:41:22 -05:00
dependabot[bot]
be8cdfa4cc
Bump goreleaser/goreleaser-action from 6.4.0 to 7.0.0 (#1992)
Bumps [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action) from 6.4.0 to 7.0.0.
- [Release notes](https://github.com/goreleaser/goreleaser-action/releases)
- [Commits](e435ccd777...ec59f474b9)

---
updated-dependencies:
- dependency-name: goreleaser/goreleaser-action
  dependency-version: 7.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-23 08:29:29 -05:00
dependabot[bot]
cd16b2dee5
Bump github/codeql-action from 4.32.3 to 4.32.4 (#1993)
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 4.32.3 to 4.32.4.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](9e907b5e64...89a39a4e59)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-version: 4.32.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-23 08:29:23 -05:00
John Kerl
763b4d8f71 typofix 2026-02-22 17:08:15 -05:00
John Kerl
f60314daaf
Update performance docs (#1991)
* Organize perf-stats runs

* reorg

* scripts/perf/timings-2026-02-22.txt

* iterating

* iterating

* more

* .gitignore

* more

* link checks
2026-02-22 17:04:35 -05:00
John Kerl
9cae7d2b1e
Update DeepWiki badge placement in README.md (#1987) 2026-02-22 15:20:45 -05:00
John Kerl
3103b11323 typofix 2026-02-22 13:06:10 -05:00
John Kerl
2e3f0b3a2f typofix 2026-02-22 13:05:08 -05:00
John Kerl
b10e6e3d34
Update performance numbers (#1990)
* wip

* re-run
2026-02-22 12:58:52 -05:00
John Kerl
8a84388b11
Add docs example on custom record-output formatting (#1989) 2026-02-22 12:45:45 -05:00
John Kerl
5815ab1cea
Add record-templating example to docs (#1988) 2026-02-22 12:01:03 -05:00
Andrea Borruso
fe491c0337
Add badge for DeepWiki to README (#1986)
If you put this badge in the main readme, you will have the fantastic Deepwiki wiki updated every week. I find it an excellent service. 
While now the latest update is this: April 18, 2025 (121dd9)
2026-02-22 10:44:33 -05:00
John Kerl
cd39c4e1bd
make dev ater PR 1984 (#1985) 2026-02-21 23:24:20 -05:00
Balki
d9ee24460c
Add unicode printing support for barred output (#1984) 2026-02-21 23:15:03 -05:00
John Kerl
4535922db0 Update release docs 2026-02-21 09:44:23 -05:00
John Kerl
47ca5eb88a Post-6.17.0 2026-02-21 09:40:15 -05:00
John Kerl
dc00aa3e16 Miller 6.17.0 2026-02-21 09:16:55 -05:00
John Kerl
8d85b46404
Follow-up for #1981 (#1982) 2026-02-18 10:25:21 -05:00
Stephen Kitt
f0a7c5832f
Performance and style fixes (#1981)
* Switch to integer ranges in for loops

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Switch to slices functions where appropriate

A number of utility functions can be replaced outright; since Miller
can technically be used as a library, these are deprecated rather than
removed. go:fix directives ensure that they can be replaced
automatically.

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Switch to reflect.TypeFor

This is slightly more efficient than TypeOf when the type is known at
compile time.

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Switch to strings.SplitSeq instead of strings.Split

SplitSeq results in fewer allocations.

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Drop obsolete build directives

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Use min/max instead of explicit comparisons

Signed-off-by: Stephen Kitt <steve@sk2.org>

* Append slices instead of looping

Signed-off-by: Stephen Kitt <steve@sk2.org>

---------

Signed-off-by: Stephen Kitt <steve@sk2.org>
2026-02-18 09:19:31 -05:00
John Kerl
e8c4187e67
Fix: mlr -i nonesuch cat says mlr: empty IRS (#1980)
* Fix: `mlr -i nonesuch cat` says `mlr: empty IRS`

* fix experr
2026-02-17 15:30:28 -05:00
John Kerl
5c8c3b132a
Handle control-C in mlr repl (#1979) 2026-02-17 09:18:40 -05:00
John Kerl
1f459824f0
Handle control-C in mlr repl (#1977) 2026-02-16 17:17:30 -05:00
John Kerl
45d2104771
No exit from mlr repl when function is not found (#1976) 2026-02-16 17:07:22 -05:00
John Kerl
e1346691da
Improve error propagation (#1975) 2026-02-16 16:48:41 -05:00
John Kerl
1e762d7c4c
test/README.md (#1972) 2026-02-16 16:44:31 -05:00
John Kerl
5eb40c9e7b
Multiple style updates (#1974)
* Comment style

* IRecordTransformer -> RecordTransfomer

* make fmt

* else-return style mod

* snake-case -> camel-case

* Remove redundant err = nil and similar zero-value initializations.

* redundant break;

* bugfix

* neaten

* typofix

* simplify/standardize init of zero-length slices

* Standardize fmt.Fprintf w/ errors

* fix double print of "mlr:"

* neatening

* Uniformize error messages

* make docs

* avoid shadowing package names

* shorten some receiver names
2026-02-16 15:49:21 -05:00
John Kerl
a3b5d25933
Neaten some comments (#1973)
* comment-neaten

* comment-neaten

* more
2026-02-16 13:38:49 -05:00
dependabot[bot]
077cbf0d96
Bump golang.org/x/crypto from 0.40.0 to 0.45.0 (#1971)
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.40.0 to 0.45.0.
- [Commits](https://github.com/golang/crypto/compare/v0.40.0...v0.45.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-version: 0.45.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-16 11:17:53 -05:00
John Kerl
daae7ff7f0
Add DCF (Debian Control Format) as supported file type (#1970)
* reader

* record writer

* pkg/output/record_writer_dcf.go

* test/input/test.dcf

* test/cases/io-dcf/

* pkg/cli/option_parse.go

* make fmt

* make dev

* docs and `make dev`
2026-02-16 11:10:39 -05:00
dependabot[bot]
a5f4c9d895
Bump github/codeql-action from 4.32.2 to 4.32.3 (#1969)
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 4.32.2 to 4.32.3.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](45cbd0c69e...9e907b5e64)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-version: 4.32.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-16 11:08:35 -05:00
John Kerl
6894ad3d56
Improve parsing of variable-length fractional seconds using strptime (#1968) 2026-02-15 16:43:44 -05:00
John Kerl
9399de5f6c
Fix strptime with zero-padded and non-zero-padded months/days (#1967)
* new test input

* first pass

* more tests

* iterating

* make fmt
2026-02-15 15:29:08 -05:00
John Kerl
271e558d4b
Fix bug with both %f and %z in strptime (#1966) 2026-02-15 14:51:42 -05:00
John Kerl
f375440bd4
Support YAML I/O (#1963)
* docs/src/proposal-yaml-io.md

* initial step

* Add `--y2c` etc

* test cases

* docs

* more testing

* more

* more test cases

* git rm docs/src/proposal-yaml-io.md

* make dev

* ylistwrap -> yarray
2026-02-15 09:24:38 -05:00
John Kerl
0003b83654
mlr split with --folder (#1962) 2026-02-14 20:22:24 -05:00
John Kerl
26600f77aa
Add -r (for regex field-name matching) to mlr nest (#1961)
* initial attempt

* fix up cli flag

* make dev
2026-02-14 19:59:51 -05:00