diff --git a/README-profiling.md b/README-profiling.md index fb86fb095..ea925e670 100644 --- a/README-profiling.md +++ b/README-profiling.md @@ -2,6 +2,7 @@ * [https://github.com/johnkerl/miller/blob/readme-profiling/README-go-port.md#performance-optimizations](https://github.com/johnkerl/miller/blob/readme-profiling/README-go-port.md#performance-optimizations) * [https://miller.readthedocs.io/en/latest/new-in-miller-6/#performance-benchmarks](https://miller.readthedocs.io/en/latest/new-in-miller-6/#performance-benchmarks). +* `make bench` to run Go benchmarks for Miller # How to view profile data diff --git a/docs/src/index.md b/docs/src/index.md index cdfdcb3cf..99051aed3 100644 --- a/docs/src/index.md +++ b/docs/src/index.md @@ -14,7 +14,6 @@ Quick links: Release docs - # Introduction **Miller is a command-line tool for querying, shaping, and reformatting data files in various formats including CSV, TSV, and JSON.** @@ -51,3 +50,5 @@ which allow you to succintly express your own logic. In the following you can see how CSV, TSV, tabular, JSON, and other **file formats** share a common theme which is **lists of key-value-pairs**. Miller embraces this common theme. ![coverart/cover-combined.png](coverart/cover-combined.png) + +**The big picture:** Even well into the 21st century, our world is full of text-formatted data like CSV. Google _CSV memes_, for example. We need tooling to _thrive in this world_, nimbly manipulating data which is in CSVs. And we need tooling to _move beyond CSV_, to be able to pull data out and into other storage and processing systems. Miller is designed for both these goals. diff --git a/todo.txt b/todo.txt index 1a9112363..11ba4ffaf 100644 --- a/todo.txt +++ b/todo.txt @@ -2,17 +2,10 @@ PUNCHDOWN LIST * blockers: - - fractional-strptime - improved regex doc w/ lots of examples - cmp-matrices - - all-contribs: twi dm - https://github.com/all-contributors/all-contributors - yarn all-contributors add namegoeshere ideas - - license triple-checks - `mlr put` -> coverart -* nikos materials -> fold in - * cases/dsl-min-max-types: cmp-matrices need to be fixed to follow the advertised rule for mixed types NUMERICS < BOOL < VOID < STRING @@ -23,18 +16,6 @@ PUNCHDOWN LIST o reference-main-regular-expressions: separate escaping for "\t" etc in arg-2/regex position -- "\t"."\t" example as well ... -* datetime - o sysdate, sysdate_local; datediff ... - o .6S bugfix -- separate PR -- ? - o strptime w/ ...00.Z -> error - o strptime/strftime experiments ... - - verb sec2gmtdate - > leaves non-numbers as-is -- ? - > check sec2gmt as well -- ? - ! strptime: - strptime("1970-01-01T00:00:00.Z", "%Y-%m-%dT%H:%M:%SZ") - (error) - * doc o new-in-miller-6: missings: - dump syntax -- ? @@ -70,8 +51,12 @@ PUNCHDOWN LIST ================================================================ NON-BLOCKERS +* sysdate, sysdate_local; datediff ... + * JSON perf -- try alternate packages to encoding/json +* strptime w/ ...00.Z -> error + * pos/neg 0x/0b/0o UTs * 0o into BNF @@ -362,6 +347,9 @@ no need to bootstrap a parser for the parser-generator language ---------------------------------------------------------------- INFO +i https://github.com/all-contributors/all-contributors + yarn all-contributors add namegoeshere ideas + i go tool nm -size mlr | sort -nrk 2 ----------------------------------------------------------------