miller/doc/internationalization.html

102 lines
4.1 KiB
HTML

<!DOCTYPE html>
<html lang="en">
<!-- PAGE GENERATED FROM template.html and content-for-internationalization.html BY poki. -->
<!-- PLEASE MAKE CHANGES THERE AND THEN RE-RUN poki. -->
<head>
<meta http-equiv="Content-type" content="text/html;charset=UTF-8"/>
<meta name="description" content="Miller documentation"/>
<meta name="viewport" content="width=device-width, initial-scale=1.0"/> <!-- mobile-friendly -->
<meta name="keywords"
content="John Kerl, Kerl, Miller, miller, mlr, OLAP, data analysis software, regression, correlation, variance, data tools, " />
<title> Internationalization </title>
<link rel="stylesheet" type="text/css" href="css/miller.css"/>
<link rel="stylesheet" type="text/css" href="css/poki-callbacks.css"/>
</head>
<!-- ================================================================ -->
<script type="text/javascript">
var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");
document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));
</script>
<script type="text/javascript">
try {
var pageTracker = _gat._getTracker("UA-15651652-1");
pageTracker._trackPageview();
} catch(err) {}
</script>
<!-- ================================================================ -->
<body bgcolor="#ffffff">
<!-- ================================================================ -->
<!-- navbar -->
<div class="pokinav">
<center><titleinbody>Miller</titleinbody></center>
<!-- NAVBAR GENERATED FROM template.html BY poki -->
<br/>
<a class="poki-navbar-element" href="index.html"><b>Overview</b></a>
&nbsp;
<a class="poki-navbar-element" href="faq.html">Using</a>
&nbsp;
<a class="poki-navbar-element" href="reference.html">Reference</a>
&nbsp;
<a class="poki-navbar-element" href="why.html">Background</a>
&nbsp;
<a class="poki-navbar-element" href="contact.html">Repository</a>
&nbsp;
<br/>
<br/><a href="index.html">About</a>
<br/><a href="10-min.html">10-minute intro</a>
<br/><a href="file-formats.html">File formats</a>
<br/><a href="feature-comparison.html">Unix-toolkit context</a>
<br/><a href="record-heterogeneity.html">Record-heterogeneity</a>
<br/><a href="internationalization.html"><b>Internationalization</b></a>
</div>
<!-- page body -->
<p/>
<!-- BODY COPIED FROM content-for-internationalization.html BY poki -->
<div class="pokitoc">
<center><titleinbody>Internationalization</titleinbody></center>
</div>
<p/>
<p/>Miller handles strings with any characters other than 0x00 or 0xff, using
explicit UTF-8-friendly string-length computations. (I have no plans to
support UTF-16 or ISO-8859-1.)
<p/>
By and large, Miller treats strings as sequences of non-null bytes without need
to interpret them semantically. Intentional support for internationalization includes:
<ul>
<li/> <a href="file-formats.html">Tabular output formats</a> (pprint and xtab) are aligned correctly.
<li/> The <a href="reference-dsl.html#strlen">strlen</a> function correctly counts UTF-8 codepoints rather than bytes.
<li/> The <a href="reference-dsl.html#toupper">toupper</a>, <a href="reference-dsl.html#tolower">tolower</a>, and <a href="reference-dsl.html#capitalize">capitalize</a> DSL functions within the capabilities of <a href="https://github.com/sheredom/utf8.h">https://github.com/sheredom/utf8.h</a>.
</ul>
<p/>Meanwhile, regular expressions and the <a href="reference-dsl.html#sub">sub</a> and <a href="reference-dsl.html#gsub">gsub</a> function correctly, albeit without explicit intentional support.
<p/> Please file an issue at <a href="https://github.com/johnkerl/miller">https://github.com/johnkerl/miller</a> if you encounter bugs related to internationalization (or anything else for
that matter).
<!-- ================================================================ -->
<script type="text/javascript" src="js/jko-toggler.js"></script>
<!-- wtf -->
<script type="text/javascript">
// Put this at the bottom of the page since its constructor scans the
// document's div tags to find the toggleables.
const bodyToggler = new JKOToggler(
"body_section_toggle_",
'maroon',
'maroon',
);
</script>
</body>
</html>