Commit graph

157 commits

Author SHA1 Message Date
John Kerl
58d9ad19bc
Record hashing perf (#781)
* todo

* Rename inputChannel,outputChannel to readerChannel,writerChannel

* Rename inputChannel,outputChannel to readerChannel,writerChannel (#772)

* Start batched-reader API mods

* Singleton-list step for reader-batching at input

* CLI options for records-per-batch and hash-records

* Push channelized-reader logic into DKVP reader

* Push batching logic into chain-transformer, transformers, and channel-writer

* foo

* cmd/mprof and cmd/mprof2

* cmd/mprof3 and cmd/mprof4

* narrowed in on regexp-splitting on IFS/IPS as perf-hit

* neaten

* channelize nidx

* cmd/mprof5

* channelize CSV reader

* channelize NIDX reader

* Dedupe DKVP-reader and NIDX-reader source files

* channelize CSV-lite reader

* channelize XTAB reader

* batchify JSON reader

* channelize GEN pseudo-reader

* scripts for perf-testing on larger files

* merge with main for #776

* Fix record-batching for join and repl

* Fix comment-handling in channelized XTAB reader

* Fix bug found in positional-rename

* Use --no-hash-records by default
2021-12-14 22:41:40 -05:00
Andrea Borruso
08cf55f9d5
Updated the edit PATH (#775) 2021-12-12 23:01:44 -05:00
John Kerl
4c3e141df8
Split separators from context (#771)
* Fix mlr -O to return strings for all octal numbers along with 0* numbers like 07 and 08

* Factor separators out of Context struct
2021-12-06 22:47:58 -05:00
John Kerl
cef753c232
Performance improvement: buffered output (#765)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support

* Performance optmization: less frequent syscall.write on output
2021-12-01 20:12:31 -05:00
John Kerl
d9dbb1e92e
Improvements for shebang-script handling (#758)
* Experimental #!/usr/bin/env mlr -s feature

* Allow flags after verbs, for shebang support
2021-11-24 01:15:28 -05:00
John Kerl
191bdfa159 merge 2021-11-22 22:43:15 -05:00
John Kerl
49863a5db5 Merge branch 'main' of git+ssh://github.com/johnkerl/miller 2021-11-22 22:39:33 -05:00
John Kerl
f097a8dcd2 merge 2021-11-22 22:39:28 -05:00
Andrea Borruso
8ca1d56f7c
To enable 404 'age (#757) 2021-11-22 22:37:47 -05:00
John Kerl
6a41f73328 Update webdocs for latest mlr compile 2021-11-19 13:55:57 -05:00
John Kerl
4394819cf8
Approximate-match feature for online help (#754)
* Explicitly support approximate-match help

* Unit tests for exact and approximate help
2021-11-17 23:37:48 -05:00
John Kerl
bff6890a9e Unit tests for exact and approximate help 2021-11-17 23:22:41 -05:00
John Kerl
2ea267eaa9 Link to10.3 release notes 2021-11-17 20:06:26 -05:00
John Kerl
b14c917a79
Neaten output of mlr stats1 --help (#751) 2021-11-15 07:46:11 -05:00
John Kerl
dba3ed5dc4 Reorganization of new-in-miller-6 docpage (#750) 2021-11-13 23:18:35 -05:00
John Kerl
5f1b0ecf05
Getting-started doc material for spaces in field names (#749) 2021-11-13 10:29:30 -05:00
John Kerl
c0ae15a288 Ensure 'make man' and 'make docs' use in-tree mlr executable 2021-11-12 22:41:40 -05:00
John Kerl
bc72cd1857
More Go-package restructuring (#748) 2021-11-12 12:49:55 -05:00
John Kerl
0d4fc143ad rename make precommit to make dev 2021-11-11 00:02:24 -05:00
John Kerl
bf25cec435
Update draft release notes (#743) 2021-11-10 23:59:28 -05:00
John Kerl
feec887738 rename docs title from Miller 6 to Miller 6.0.0 2021-11-10 13:27:25 -05:00
John Kerl
c5a0531189 update man/Makefile .PHONY targets 2021-11-10 12:44:05 -05:00
John Kerl
db69402e24 make sure manpage gets updated on make build check install 2021-11-10 10:13:14 -05:00
John Kerl
fe9a70e225 Merge branch 'configure-and-miller-spec-experiments' 2021-11-09 23:31:35 -05:00
John Kerl
6fd2382706
emit1 for emitting arbitrary map-valued expressions (#739) 2021-11-09 14:45:10 -05:00
John Kerl
4162da1dd6 neaten non-install location for miller manual page 2021-11-08 22:47:19 -05:00
John Kerl
950337fde1
Simplify release & dev build processes (#735) 2021-11-07 23:41:15 -05:00
John Kerl
91def6906f More Miller 6 release prep 2021-11-06 12:57:24 -04:00
Andrea Borruso
18dda9e01e
to have back to top botton (#733)
It's very useful for long pages
2021-11-05 11:28:23 -04:00
John Kerl
3105beb742 Fix some doc links 2021-11-05 11:14:14 -04:00
John Kerl
1e4f58bca7 Set theme jekyll-theme-leap-day 2021-11-05 09:41:44 -04:00
John Kerl
584fa3446b trying https://github.com/squidfunk/mkdocs-material/issues/43 2021-11-04 19:05:15 -04:00
John Kerl
432c1250b9 trying to fix readthedocs rendering 2021-11-04 18:39:36 -04:00
John Kerl
e6e198f12a Merge branch 'aborruso-patch-2' 2021-11-04 18:16:12 -04:00
John Kerl
847b422b6b merge 2021-11-04 18:10:55 -04:00
John Kerl
970fc43b81 Merge branch 'patch-2' of github.com:aborruso/miller into aborruso-patch-2 2021-11-04 18:09:56 -04:00
John Kerl
7578b789f6
Remove Miller-5 source/doc/manpage directories, along with C-build files (#731) 2021-11-04 00:45:44 -04:00
John Kerl
d7b112c4c3 Path-component examples -> docs 2021-09-08 23:04:16 -04:00
John Kerl
14dd5592e7 $quanity -> $quantity in docs 2021-09-05 20:04:45 -04:00
John Kerl
07e77b86d2 Move install page higher up in Miller5 docs 2021-08-25 20:56:28 -04:00
John Kerl
afd3c9c149
Replace miller-6 sphinx docs with mkdocs docs (#618) 2021-08-04 22:03:01 -04:00
John Kerl
f7dc5d83b0 pixel-tune previous commit 2021-06-28 23:39:39 -04:00
John Kerl
279be4c4f2
Neaten on-line help (#586)
* More neatening of on-line help

* Separate adjacent code blocks in Sphinx docs
2021-06-28 23:16:08 -04:00
John Kerl
0d19fa728d Separate adjacent code blocks in Sphinx docs 2021-06-28 09:48:50 -04:00
John Kerl
4fce7a8079
mlr --help split up (#582)
* Remove leading "$ " from code examples, now that highlighting is in place
* avoid package dependency cycle between auxents and cli
* transforming/transformers package merge
* pivotable lib.DOC_URL
* unexpose auxent usage funcs
* major refactor
2021-06-28 00:06:22 -04:00
John Kerl
2a99e521a4 doc-build after previous merge 2021-06-25 23:33:23 -04:00
John Kerl
bab6e1ae3f Ongoing Miller-6 doc updates 2021-06-25 23:22:33 -04:00
John Kerl
a14ddd764e Miller-6 docs iteration (#576)
* Windows screenshots
* Miller-on-Windows page
* Iterating
2021-06-25 23:22:33 -04:00
John Kerl
25ce4a520a better TOC icon 2021-06-25 23:22:33 -04:00
John Kerl
17761849e1 Make docs more mobile-friendly (#572) 2021-06-25 23:22:33 -04:00