The --lp/--rp prefixes and -j output-field rename were applied only to
paired records, leaving unpaired records emitted via --ul/--ur with their
original (left/right) field names. This broke downstream operations like
unsparsify that expected consistent column names across paired and
unpaired output.
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The implicit-header readers for TSV and CSV-lite were missing the
`for` loop in their `nh < nd` branch, so when a data row had more
fields than the auto-generated header, only one extra field was
captured and the rest were dropped. Restore the loop, matching the
explicit-header readers and the pprint reader.
When using --fr (regex field selector) with stats1 -a null_count, void
(empty) field values were unconditionally skipped in
ingestWithValueFieldRegexes, causing null_count to always report 0.
The non-regex path (ingestWithoutValueFieldRegexes) already had a special
case that allows void values through for null_count accumulators. This
commit adds the same exception to the regex path.
Fixes#1639
Co-authored-by: cobyfrombrooklyn-bot <cobyfrombrooklyn-bot@users.noreply.github.com>
* reader
* record writer
* pkg/output/record_writer_dcf.go
* test/input/test.dcf
* test/cases/io-dcf/
* pkg/cli/option_parse.go
* make fmt
* make dev
* docs and `make dev`
Add a surv verb to estimate a survival curve using Kaplan-Meier. It
requires duration and status (event or censored) columns, and outputs
each distinct duration and corresponding probability of survival.
* DSL stats functions [WIP]
* refactor
* move percentile computation to bifs module; iterate
* mode and antimode
* percentile iterate
* percentile sketching
* neaten
* unit-test iterate
* unify old & new min & max functions
* unit-test cases
* code-dedupe between mode and antimode
* make mode/antimode ties deterministic via first-found-wins rule
* online help strings for new stats DSL functions
* artifacts from `make dev`
* help info on how min/max now recurse into collections
* artifacts from `make dev`
* typofix
* DSL functions for 64-bit nano-epoch timestamps
* strfntime
* nsec2gmt; move sec/nsec pairs adjacent to one another
* update on-line help
* artifacts from `make dev`
* unit-test files
* latin1_to_utf8 and utf8_to_latin1 DSL functions
* doc-build artifacts for previous commit
* Test cases for latin1_to_utf8 and utf8_to_latin1
* extend on-line help
* latin1_to_utf8 and utf8_to_latin1 verbs
* unit-test cases for verbs
* Keep with kebab-case naming convention for verbs
* webdocs
* Add natural sort order as an option for the sort verb
* Add natural sort order as an option for the sort DSL function
* doc-build artifacts for on-line help
* webdocs
* codespell fix
* unit-test files for sort verb
* unit-test files for sort DSL function
* todo
* Neaten existing DSL sketch
* rebase on #893, and sketch
* code-complete
* build artifacts for previous commit
* replace - with _ in shift and slwin
