blob: d67e5eacc9129575fcf72e0ddb4a3378b0bb2307 [file] [log] [blame]
Nigel Tao1b073492020-02-16 22:11:36 +11001// Copyright 2020 The Wuffs Authors.
2//
3// Licensed under the Apache License, Version 2.0 (the "License");
4// you may not use this file except in compliance with the License.
5// You may obtain a copy of the License at
6//
7// https://www.apache.org/licenses/LICENSE-2.0
8//
9// Unless required by applicable law or agreed to in writing, software
10// distributed under the License is distributed on an "AS IS" BASIS,
11// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12// See the License for the specific language governing permissions and
13// limitations under the License.
14
15// ----------------
16
Nigel Taob55d5392020-09-11 08:11:02 +100017// jsonptr is discussed extensively at
18// https://nigeltao.github.io/blog/2020/jsonptr.html
19
Nigel Tao1b073492020-02-16 22:11:36 +110020/*
Nigel Tao0cd2f982020-03-03 23:03:02 +110021jsonptr is a JSON formatter (pretty-printer) that supports the JSON Pointer
Nigel Tao0291a472020-08-13 22:40:10 +100022(RFC 6901) query syntax. It reads UTF-8 JSON from stdin and writes
23canonicalized, formatted UTF-8 JSON to stdout.
Nigel Tao0cd2f982020-03-03 23:03:02 +110024
Nigel Taod60815c2020-03-26 14:32:35 +110025See the "const char* g_usage" string below for details.
Nigel Tao0cd2f982020-03-03 23:03:02 +110026
27----
28
29JSON Pointer (and this program's implementation) is one of many JSON query
30languages and JSON tools, such as jq, jql and JMESPath. This one is relatively
31simple and fewer-featured compared to those others.
32
Nigel Tao0291a472020-08-13 22:40:10 +100033One benefit of simplicity is that this program's JSON and JSON Pointer
Nigel Tao0cd2f982020-03-03 23:03:02 +110034implementations do not dynamically allocate or free memory (yet it does not
35require that the entire input fits in memory at once). They are therefore
36trivially protected against certain bug classes: memory leaks, double-frees and
37use-after-frees.
38
Nigel Tao0291a472020-08-13 22:40:10 +100039The core JSON implementation is also written in the Wuffs programming language
40(and then transpiled to C/C++), which is memory-safe (e.g. array indexing is
41bounds-checked) but also guards against integer arithmetic overflows.
Nigel Tao0cd2f982020-03-03 23:03:02 +110042
Nigel Taofe0cbbd2020-03-05 22:01:30 +110043For defense in depth, on Linux, this program also self-imposes a
44SECCOMP_MODE_STRICT sandbox before reading (or otherwise processing) its input
45or writing its output. Under this sandbox, the only permitted system calls are
46read, write, exit and sigreturn.
47
Nigel Tao0291a472020-08-13 22:40:10 +100048All together, this program aims to safely handle untrusted JSON files without
49fear of security bugs such as remote code execution.
Nigel Tao0cd2f982020-03-03 23:03:02 +110050
51----
Nigel Tao1b073492020-02-16 22:11:36 +110052
Nigel Taoc5b3a9e2020-02-24 11:54:35 +110053As of 2020-02-24, this program passes all 318 "test_parsing" cases from the
54JSON test suite (https://github.com/nst/JSONTestSuite), an appendix to the
55"Parsing JSON is a Minefield" article (http://seriot.ch/parsing_json.php) that
56was first published on 2016-10-26 and updated on 2018-03-30.
57
Nigel Tao0cd2f982020-03-03 23:03:02 +110058After modifying this program, run "build-example.sh example/jsonptr/" and then
59"script/run-json-test-suite.sh" to catch correctness regressions.
60
61----
62
Nigel Taod0b16cb2020-03-14 10:15:54 +110063This program uses Wuffs' JSON decoder at a relatively low level, processing the
64decoder's token-stream output individually. The core loop, in pseudo-code, is
65"for_each_token { handle_token(etc); }", where the handle_token function
Nigel Taod60815c2020-03-26 14:32:35 +110066changes global state (e.g. the `g_depth` and `g_ctx` variables) and prints
Nigel Taod0b16cb2020-03-14 10:15:54 +110067output text based on that state and the token's source text. Notably,
68handle_token is not recursive, even though JSON values can nest.
69
70This approach is centered around JSON tokens. Each JSON 'thing' (e.g. number,
71string, object) comprises one or more JSON tokens.
72
73An alternative, higher-level approach is in the sibling example/jsonfindptrs
74program. Neither approach is better or worse per se, but when studying this
75program, be aware that there are multiple ways to use Wuffs' JSON decoder.
76
77The two programs, jsonfindptrs and jsonptr, also demonstrate different
78trade-offs with regard to JSON object duplicate keys. The JSON spec permits
79different implementations to allow or reject duplicate keys. It is not always
80clear which approach is safer. Rejecting them is certainly unambiguous, and
81security bugs can lurk in ambiguous corners of a file format, if two different
82implementations both silently accept a file but differ on how to interpret it.
83On the other hand, in the worst case, detecting duplicate keys requires O(N)
84memory, where N is the size of the (potentially untrusted) input.
85
86This program (jsonptr) allows duplicate keys and requires only O(1) memory. As
87mentioned above, it doesn't dynamically allocate memory at all, and on Linux,
88it runs in a SECCOMP_MODE_STRICT sandbox.
89
90----
91
Nigel Tao50bfab92020-08-05 11:39:09 +100092To run:
Nigel Tao1b073492020-02-16 22:11:36 +110093
94$CXX jsonptr.cc && ./a.out < ../../test/data/github-tags.json; rm -f a.out
95
96for a C++ compiler $CXX, such as clang++ or g++.
97*/
98
Nigel Tao721190a2020-04-03 22:25:21 +110099#if defined(__cplusplus) && (__cplusplus < 201103L)
100#error "This C++ program requires -std=c++11 or later"
101#endif
102
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100103#include <errno.h>
Nigel Tao01abc842020-03-06 21:42:33 +1100104#include <fcntl.h>
105#include <stdio.h>
Nigel Tao9cc2c252020-02-23 17:05:49 +1100106#include <string.h>
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100107#include <unistd.h>
Nigel Tao1b073492020-02-16 22:11:36 +1100108
109// Wuffs ships as a "single file C library" or "header file library" as per
110// https://github.com/nothings/stb/blob/master/docs/stb_howto.txt
111//
112// To use that single file as a "foo.c"-like implementation, instead of a
113// "foo.h"-like header, #define WUFFS_IMPLEMENTATION before #include'ing or
114// compiling it.
115#define WUFFS_IMPLEMENTATION
116
117// Defining the WUFFS_CONFIG__MODULE* macros are optional, but it lets users of
118// release/c/etc.c whitelist which parts of Wuffs to build. That file contains
119// the entire Wuffs standard library, implementing a variety of codecs and file
120// formats. Without this macro definition, an optimizing compiler or linker may
121// very well discard Wuffs code for unused codecs, but listing the Wuffs
122// modules we use makes that process explicit. Preprocessing means that such
123// code simply isn't compiled.
124#define WUFFS_CONFIG__MODULES
125#define WUFFS_CONFIG__MODULE__BASE
126#define WUFFS_CONFIG__MODULE__JSON
127
128// If building this program in an environment that doesn't easily accommodate
129// relative includes, you can use the script/inline-c-relative-includes.go
130// program to generate a stand-alone C++ file.
131#include "../../release/c/wuffs-unsupported-snapshot.c"
132
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100133#if defined(__linux__)
134#include <linux/prctl.h>
135#include <linux/seccomp.h>
136#include <sys/prctl.h>
137#include <sys/syscall.h>
138#define WUFFS_EXAMPLE_USE_SECCOMP
139#endif
140
Nigel Tao2cf76db2020-02-27 22:42:01 +1100141#define TRY(error_msg) \
142 do { \
143 const char* z = error_msg; \
144 if (z) { \
145 return z; \
146 } \
147 } while (false)
148
Nigel Taod60815c2020-03-26 14:32:35 +1100149static const char* g_eod = "main: end of data";
Nigel Tao2cf76db2020-02-27 22:42:01 +1100150
Nigel Taod60815c2020-03-26 14:32:35 +1100151static const char* g_usage =
Nigel Tao01abc842020-03-06 21:42:33 +1100152 "Usage: jsonptr -flags input.json\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100153 "\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100154 "Flags:\n"
Nigel Tao3690e832020-03-12 16:52:26 +1100155 " -c -compact-output\n"
Nigel Tao94440cf2020-04-02 22:28:24 +1100156 " -d=NUM -max-output-depth=NUM\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100157 " -q=STR -query=STR\n"
Nigel Taoecadf722020-07-13 08:22:34 +1000158 " -s=NUM -spaces=NUM\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100159 " -t -tabs\n"
160 " -fail-if-unsandboxed\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000161 " -input-allow-comments\n"
162 " -input-allow-extra-comma\n"
163 " -input-allow-inf-nan-numbers\n"
Nigel Tao21042052020-08-19 23:13:54 +1000164 " -jwcc\n"
165 " -output-comments\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000166 " -output-extra-comma\n"
Nigel Tao75682542020-08-22 21:40:18 +1000167 " -output-inf-nan-numbers\n"
Nigel Taoecadf722020-07-13 08:22:34 +1000168 " -strict-json-pointer-syntax\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100169 "\n"
Nigel Tao01abc842020-03-06 21:42:33 +1100170 "The input.json filename is optional. If absent, it reads from stdin.\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100171 "\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100172 "----\n"
173 "\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100174 "jsonptr is a JSON formatter (pretty-printer) that supports the JSON\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000175 "Pointer (RFC 6901) query syntax. It reads UTF-8 JSON from stdin and\n"
176 "writes canonicalized, formatted UTF-8 JSON to stdout.\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100177 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000178 "Canonicalized means that e.g. \"abc\\u000A\\tx\\u0177z\" is re-written\n"
179 "as \"abc\\n\\txÅ·z\". It does not sort object keys, nor does it reject\n"
Nigel Tao01abc842020-03-06 21:42:33 +1100180 "duplicate keys. Canonicalization does not imply Unicode normalization.\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100181 "\n"
182 "Formatted means that arrays' and objects' elements are indented, each\n"
Nigel Taoecadf722020-07-13 08:22:34 +1000183 "on its own line. Configure this with the -c / -compact-output, -s=NUM /\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000184 "-spaces=NUM (for NUM ranging from 0 to 8) and -t / -tabs flags.\n"
Nigel Tao168f60a2020-07-14 13:19:33 +1000185 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000186 "The -input-allow-comments flag allows \"/*slash-star*/\" and\n"
187 "\"//slash-slash\" C-style comments within JSON input. Such comments are\n"
Nigel Tao21042052020-08-19 23:13:54 +1000188 "stripped from the output unless -output-comments was also set.\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100189 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000190 "The -input-allow-extra-comma flag allows input like \"[1,2,]\", with a\n"
191 "comma after the final element of a JSON list or dictionary.\n"
Nigel Tao3c8589b2020-07-19 21:49:00 +1000192 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000193 "The -input-allow-inf-nan-numbers flag allows non-finite floating point\n"
Nigel Tao75682542020-08-22 21:40:18 +1000194 "numbers (infinities and not-a-numbers) within JSON input. This flag\n"
195 "requires that -output-inf-nan-numbers also be set.\n"
Nigel Tao3c8589b2020-07-19 21:49:00 +1000196 "\n"
Nigel Tao21042052020-08-19 23:13:54 +1000197 "The -output-comments flag copies any input comments to the output. It\n"
198 "has no effect unless -input-allow-comments was also set. Comments look\n"
199 "better after commas than before them, but a closing \"]\" or \"}\" can\n"
200 "occur after arbitrarily many comments, so -output-comments also requires\n"
201 "that one or both of -compact-output and -output-extra-comma be set.\n"
202 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000203 "The -output-extra-comma flag writes output like \"[1,2,]\", with a comma\n"
204 "after the final element of a JSON list or dictionary. Such commas are\n"
205 "non-compliant with the JSON specification but many parsers accept them\n"
206 "and they can produce simpler line-based diffs. This flag is ignored when\n"
207 "-compact-output is set.\n"
Nigel Taof8dfc762020-07-23 23:35:44 +1000208 "\n"
Nigel Tao21042052020-08-19 23:13:54 +1000209 "The -jwcc flag (JSON With Commas and Comments) enables all of:\n"
210 " -input-allow-comments\n"
211 " -input-allow-extra-comma\n"
212 " -output-comments\n"
213 " -output-extra-comma\n"
214 "\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100215 "----\n"
216 "\n"
217 "The -q=STR or -query=STR flag gives an optional JSON Pointer query, to\n"
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100218 "print a subset of the input. For example, given RFC 6901 section 5's\n"
Nigel Tao01abc842020-03-06 21:42:33 +1100219 "sample input (https://tools.ietf.org/rfc/rfc6901.txt), this command:\n"
220 " jsonptr -query=/foo/1 rfc-6901-json-pointer.json\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100221 "will print:\n"
222 " \"baz\"\n"
223 "\n"
224 "An absent query is equivalent to the empty query, which identifies the\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100225 "entire input (the root value). Unlike a file system, the \"/\" query\n"
Nigel Taod0b16cb2020-03-14 10:15:54 +1100226 "does not identify the root. Instead, \"\" is the root and \"/\" is the\n"
227 "child (the value in a key-value pair) of the root whose key is the empty\n"
228 "string. Similarly, \"/xyz\" and \"/xyz/\" are two different nodes.\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100229 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000230 "If the query found a valid JSON value, this program will return a zero\n"
231 "exit code even if the rest of the input isn't valid JSON. If the query\n"
Nigel Tao0cd2f982020-03-03 23:03:02 +1100232 "did not find a value, or found an invalid one, this program returns a\n"
233 "non-zero exit code, but may still print partial output to stdout.\n"
234 "\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000235 "The JSON specification (https://json.org/) permits implementations that\n"
236 "allow duplicate keys, as this one does. This JSON Pointer implementation\n"
237 "is also greedy, following the first match for each fragment without\n"
238 "back-tracking. For example, the \"/foo/bar\" query will fail if the root\n"
239 "object has multiple \"foo\" children but the first one doesn't have a\n"
240 "\"bar\" child, even if later ones do.\n"
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100241 "\n"
Nigel Taoecadf722020-07-13 08:22:34 +1000242 "The -strict-json-pointer-syntax flag restricts the -query=STR string to\n"
243 "exactly RFC 6901, with only two escape sequences: \"~0\" and \"~1\" for\n"
Nigel Tao904004e2020-11-15 20:56:04 +1100244 "\"~\" and \"/\". Without this flag, this program also lets \"~n\",\n"
245 "\"~r\" and \"~t\" escape the New Line, Carriage Return and Horizontal\n"
246 "Tab ASCII control characters, which can work better with line oriented\n"
247 "(and tab separated) Unix tools that assume exactly one record (e.g. one\n"
248 "JSON Pointer string) per line.\n"
Nigel Taod6fdfb12020-03-11 12:24:14 +1100249 "\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100250 "----\n"
251 "\n"
Nigel Tao94440cf2020-04-02 22:28:24 +1100252 "The -d=NUM or -max-output-depth=NUM flag gives the maximum (inclusive)\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000253 "output depth. JSON containers ([] arrays and {} objects) can hold other\n"
254 "containers. When this flag is set, containers at depth NUM are replaced\n"
255 "with \"[…]\" or \"{…}\". A bare -d or -max-output-depth is equivalent to\n"
256 "-d=1. The flag's absence is equivalent to an unlimited output depth.\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100257 "\n"
258 "The -max-output-depth flag only affects the program's output. It doesn't\n"
Nigel Tao0291a472020-08-13 22:40:10 +1000259 "affect whether or not the input is considered valid JSON. The JSON\n"
260 "specification permits implementations to set their own maximum input\n"
261 "depth. This JSON implementation sets it to 1024.\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100262 "\n"
263 "Depth is measured in terms of nested containers. It is unaffected by the\n"
264 "number of spaces or tabs used to indent.\n"
265 "\n"
266 "When both -max-output-depth and -query are set, the output depth is\n"
267 "measured from when the query resolves, not from the input root. The\n"
268 "input depth (measured from the root) is still limited to 1024.\n"
269 "\n"
270 "----\n"
271 "\n"
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100272 "The -fail-if-unsandboxed flag causes the program to exit if it does not\n"
273 "self-impose a sandbox. On Linux, it self-imposes a SECCOMP_MODE_STRICT\n"
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100274 "sandbox, regardless of whether this flag was set.";
Nigel Tao0cd2f982020-03-03 23:03:02 +1100275
Nigel Tao2cf76db2020-02-27 22:42:01 +1100276// ----
277
Nigel Tao63441812020-08-21 14:05:48 +1000278// ascii_escapes was created by script/print-json-ascii-escapes.go.
279const uint8_t ascii_escapes[1024] = {
280 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x30, 0x00, // 0x00: "\\u0000"
281 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x31, 0x00, // 0x01: "\\u0001"
282 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x32, 0x00, // 0x02: "\\u0002"
283 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x33, 0x00, // 0x03: "\\u0003"
284 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x34, 0x00, // 0x04: "\\u0004"
285 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x35, 0x00, // 0x05: "\\u0005"
286 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x36, 0x00, // 0x06: "\\u0006"
287 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x37, 0x00, // 0x07: "\\u0007"
288 0x02, 0x5C, 0x62, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x08: "\\b"
289 0x02, 0x5C, 0x74, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x09: "\\t"
290 0x02, 0x5C, 0x6E, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x0A: "\\n"
291 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x42, 0x00, // 0x0B: "\\u000B"
292 0x02, 0x5C, 0x66, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x0C: "\\f"
293 0x02, 0x5C, 0x72, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x0D: "\\r"
294 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x45, 0x00, // 0x0E: "\\u000E"
295 0x06, 0x5C, 0x75, 0x30, 0x30, 0x30, 0x46, 0x00, // 0x0F: "\\u000F"
296 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x30, 0x00, // 0x10: "\\u0010"
297 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x31, 0x00, // 0x11: "\\u0011"
298 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x32, 0x00, // 0x12: "\\u0012"
299 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x33, 0x00, // 0x13: "\\u0013"
300 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x34, 0x00, // 0x14: "\\u0014"
301 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x35, 0x00, // 0x15: "\\u0015"
302 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x36, 0x00, // 0x16: "\\u0016"
303 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x37, 0x00, // 0x17: "\\u0017"
304 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x38, 0x00, // 0x18: "\\u0018"
305 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x39, 0x00, // 0x19: "\\u0019"
306 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x41, 0x00, // 0x1A: "\\u001A"
307 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x42, 0x00, // 0x1B: "\\u001B"
308 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x43, 0x00, // 0x1C: "\\u001C"
309 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x44, 0x00, // 0x1D: "\\u001D"
310 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x45, 0x00, // 0x1E: "\\u001E"
311 0x06, 0x5C, 0x75, 0x30, 0x30, 0x31, 0x46, 0x00, // 0x1F: "\\u001F"
312 0x06, 0x5C, 0x75, 0x30, 0x30, 0x32, 0x30, 0x00, // 0x20: "\\u0020"
313 0x01, 0x21, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x21: "!"
314 0x02, 0x5C, 0x22, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x22: "\\\""
315 0x01, 0x23, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x23: "#"
316 0x01, 0x24, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x24: "$"
317 0x01, 0x25, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x25: "%"
318 0x01, 0x26, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x26: "&"
319 0x01, 0x27, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x27: "'"
320 0x01, 0x28, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x28: "("
321 0x01, 0x29, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x29: ")"
322 0x01, 0x2A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2A: "*"
323 0x01, 0x2B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2B: "+"
324 0x01, 0x2C, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2C: ","
325 0x01, 0x2D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2D: "-"
326 0x01, 0x2E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2E: "."
327 0x01, 0x2F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x2F: "/"
328 0x01, 0x30, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x30: "0"
329 0x01, 0x31, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x31: "1"
330 0x01, 0x32, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x32: "2"
331 0x01, 0x33, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x33: "3"
332 0x01, 0x34, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x34: "4"
333 0x01, 0x35, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x35: "5"
334 0x01, 0x36, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x36: "6"
335 0x01, 0x37, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x37: "7"
336 0x01, 0x38, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x38: "8"
337 0x01, 0x39, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x39: "9"
338 0x01, 0x3A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3A: ":"
339 0x01, 0x3B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3B: ";"
340 0x01, 0x3C, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3C: "<"
341 0x01, 0x3D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3D: "="
342 0x01, 0x3E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3E: ">"
343 0x01, 0x3F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x3F: "?"
344 0x01, 0x40, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x40: "@"
345 0x01, 0x41, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x41: "A"
346 0x01, 0x42, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x42: "B"
347 0x01, 0x43, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x43: "C"
348 0x01, 0x44, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x44: "D"
349 0x01, 0x45, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x45: "E"
350 0x01, 0x46, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x46: "F"
351 0x01, 0x47, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x47: "G"
352 0x01, 0x48, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x48: "H"
353 0x01, 0x49, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x49: "I"
354 0x01, 0x4A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4A: "J"
355 0x01, 0x4B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4B: "K"
356 0x01, 0x4C, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4C: "L"
357 0x01, 0x4D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4D: "M"
358 0x01, 0x4E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4E: "N"
359 0x01, 0x4F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x4F: "O"
360 0x01, 0x50, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x50: "P"
361 0x01, 0x51, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x51: "Q"
362 0x01, 0x52, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x52: "R"
363 0x01, 0x53, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x53: "S"
364 0x01, 0x54, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x54: "T"
365 0x01, 0x55, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x55: "U"
366 0x01, 0x56, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x56: "V"
367 0x01, 0x57, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x57: "W"
368 0x01, 0x58, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x58: "X"
369 0x01, 0x59, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x59: "Y"
370 0x01, 0x5A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5A: "Z"
371 0x01, 0x5B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5B: "["
372 0x02, 0x5C, 0x5C, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5C: "\\\\"
373 0x01, 0x5D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5D: "]"
374 0x01, 0x5E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5E: "^"
375 0x01, 0x5F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x5F: "_"
376 0x01, 0x60, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x60: "`"
377 0x01, 0x61, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x61: "a"
378 0x01, 0x62, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x62: "b"
379 0x01, 0x63, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x63: "c"
380 0x01, 0x64, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x64: "d"
381 0x01, 0x65, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x65: "e"
382 0x01, 0x66, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x66: "f"
383 0x01, 0x67, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x67: "g"
384 0x01, 0x68, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x68: "h"
385 0x01, 0x69, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x69: "i"
386 0x01, 0x6A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6A: "j"
387 0x01, 0x6B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6B: "k"
388 0x01, 0x6C, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6C: "l"
389 0x01, 0x6D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6D: "m"
390 0x01, 0x6E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6E: "n"
391 0x01, 0x6F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x6F: "o"
392 0x01, 0x70, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x70: "p"
393 0x01, 0x71, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x71: "q"
394 0x01, 0x72, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x72: "r"
395 0x01, 0x73, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x73: "s"
396 0x01, 0x74, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x74: "t"
397 0x01, 0x75, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x75: "u"
398 0x01, 0x76, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x76: "v"
399 0x01, 0x77, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x77: "w"
400 0x01, 0x78, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x78: "x"
401 0x01, 0x79, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x79: "y"
402 0x01, 0x7A, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7A: "z"
403 0x01, 0x7B, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7B: "{"
404 0x01, 0x7C, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7C: "|"
405 0x01, 0x7D, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7D: "}"
406 0x01, 0x7E, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7E: "~"
407 0x01, 0x7F, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, // 0x7F: "<DEL>"
408};
409
Nigel Taof3146c22020-03-26 08:47:42 +1100410// Wuffs allows either statically or dynamically allocated work buffers. This
411// program exercises static allocation.
412#define WORK_BUFFER_ARRAY_SIZE \
413 WUFFS_JSON__DECODER_WORKBUF_LEN_MAX_INCL_WORST_CASE
414#if WORK_BUFFER_ARRAY_SIZE > 0
Nigel Taod60815c2020-03-26 14:32:35 +1100415uint8_t g_work_buffer_array[WORK_BUFFER_ARRAY_SIZE];
Nigel Taof3146c22020-03-26 08:47:42 +1100416#else
417// Not all C/C++ compilers support 0-length arrays.
Nigel Taod60815c2020-03-26 14:32:35 +1100418uint8_t g_work_buffer_array[1];
Nigel Taof3146c22020-03-26 08:47:42 +1100419#endif
420
Nigel Taod60815c2020-03-26 14:32:35 +1100421bool g_sandboxed = false;
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100422
Nigel Taod60815c2020-03-26 14:32:35 +1100423int g_input_file_descriptor = 0; // A 0 default means stdin.
Nigel Tao01abc842020-03-06 21:42:33 +1100424
Nigel Tao0a0c7d62020-08-18 23:31:27 +1000425#define NEW_LINE_THEN_256_SPACES \
426 "\n " \
427 " " \
428 " " \
429 " "
430#define NEW_LINE_THEN_256_TABS \
431 "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
432 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
433 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
434 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
435 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
436 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t" \
437 "\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
438
439const char* g_new_line_then_256_indent_bytes;
440uint32_t g_bytes_per_indent_depth;
Nigel Tao107f0ef2020-03-01 21:35:02 +1100441
Nigel Taofdac24a2020-03-06 21:53:08 +1100442#ifndef DST_BUFFER_ARRAY_SIZE
443#define DST_BUFFER_ARRAY_SIZE (32 * 1024)
Nigel Tao1b073492020-02-16 22:11:36 +1100444#endif
Nigel Taofdac24a2020-03-06 21:53:08 +1100445#ifndef SRC_BUFFER_ARRAY_SIZE
446#define SRC_BUFFER_ARRAY_SIZE (32 * 1024)
Nigel Tao1b073492020-02-16 22:11:36 +1100447#endif
Nigel Tao63e67962020-08-26 00:00:32 +1000448// 1 token is 8 bytes. 4Ki tokens is 32KiB.
Nigel Taofdac24a2020-03-06 21:53:08 +1100449#ifndef TOKEN_BUFFER_ARRAY_SIZE
450#define TOKEN_BUFFER_ARRAY_SIZE (4 * 1024)
Nigel Tao1b073492020-02-16 22:11:36 +1100451#endif
452
Nigel Taod60815c2020-03-26 14:32:35 +1100453uint8_t g_dst_array[DST_BUFFER_ARRAY_SIZE];
454uint8_t g_src_array[SRC_BUFFER_ARRAY_SIZE];
455wuffs_base__token g_tok_array[TOKEN_BUFFER_ARRAY_SIZE];
Nigel Tao1b073492020-02-16 22:11:36 +1100456
Nigel Taod60815c2020-03-26 14:32:35 +1100457wuffs_base__io_buffer g_dst;
458wuffs_base__io_buffer g_src;
459wuffs_base__token_buffer g_tok;
Nigel Tao1b073492020-02-16 22:11:36 +1100460
Nigel Tao991bd512020-08-19 09:38:16 +1000461// g_cursor_index is the g_src.data.ptr index between the previous and current
462// token. An invariant is that (g_cursor_index <= g_src.meta.ri).
463size_t g_cursor_index;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100464
Nigel Taod60815c2020-03-26 14:32:35 +1100465uint32_t g_depth;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100466
467enum class context {
468 none,
469 in_list_after_bracket,
470 in_list_after_value,
471 in_dict_after_brace,
472 in_dict_after_key,
473 in_dict_after_value,
Nigel Taocd4cbc92020-09-22 22:22:15 +1000474 end_of_data,
Nigel Taod60815c2020-03-26 14:32:35 +1100475} g_ctx;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100476
Nigel Tao0cd2f982020-03-03 23:03:02 +1100477bool //
478in_dict_before_key() {
Nigel Taod60815c2020-03-26 14:32:35 +1100479 return (g_ctx == context::in_dict_after_brace) ||
480 (g_ctx == context::in_dict_after_value);
Nigel Tao0cd2f982020-03-03 23:03:02 +1100481}
482
Nigel Tao21042052020-08-19 23:13:54 +1000483bool g_is_after_comment;
484
Nigel Taod60815c2020-03-26 14:32:35 +1100485uint32_t g_suppress_write_dst;
486bool g_wrote_to_dst;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100487
Nigel Tao0291a472020-08-13 22:40:10 +1000488wuffs_json__decoder g_dec;
Nigel Taoea532452020-07-27 00:03:00 +1000489
Nigel Tao0cd2f982020-03-03 23:03:02 +1100490// ----
491
492// Query is a JSON Pointer query. After initializing with a NUL-terminated C
493// string, its multiple fragments are consumed as the program walks the JSON
494// data from stdin. For example, letting "$" denote a NUL, suppose that we
495// started with a query string of "/apple/banana/12/durian" and are currently
Nigel Taob48ee752020-03-13 09:27:33 +1100496// trying to match the second fragment, "banana", so that Query::m_depth is 2:
Nigel Tao0cd2f982020-03-03 23:03:02 +1100497//
498// +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
499// / a p p l e / b a n a n a / 1 2 / d u r i a n $
500// +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
501// ^ ^
Nigel Taob48ee752020-03-13 09:27:33 +1100502// m_frag_i m_frag_k
Nigel Tao0cd2f982020-03-03 23:03:02 +1100503//
Nigel Taob48ee752020-03-13 09:27:33 +1100504// The two pointers m_frag_i and m_frag_k (abbreviated as mfi and mfk) are the
505// start (inclusive) and end (exclusive) of the query fragment. They satisfy
506// (mfi <= mfk) and may be equal if the fragment empty (note that "" is a valid
507// JSON object key).
Nigel Tao0cd2f982020-03-03 23:03:02 +1100508//
Nigel Taob48ee752020-03-13 09:27:33 +1100509// The m_frag_j (mfj) pointer moves between these two, or is nullptr. An
510// invariant is that (((mfi <= mfj) && (mfj <= mfk)) || (mfj == nullptr)).
Nigel Tao0cd2f982020-03-03 23:03:02 +1100511//
512// Wuffs' JSON tokenizer can portray a single JSON string as multiple Wuffs
513// tokens, as backslash-escaped values within that JSON string may each get
514// their own token.
515//
Nigel Taob48ee752020-03-13 09:27:33 +1100516// At the start of each object key (a JSON string), mfj is set to mfi.
Nigel Tao0cd2f982020-03-03 23:03:02 +1100517//
Nigel Taob48ee752020-03-13 09:27:33 +1100518// While mfj remains non-nullptr, each token's unescaped contents are then
519// compared to that part of the fragment from mfj to mfk. If it is a prefix
520// (including the case of an exact match), then mfj is advanced by the
521// unescaped length. Otherwise, mfj is set to nullptr.
Nigel Tao0cd2f982020-03-03 23:03:02 +1100522//
523// Comparison accounts for JSON Pointer's escaping notation: "~0" and "~1" in
524// the query (not the JSON value) are unescaped to "~" and "/" respectively.
Nigel Taob48ee752020-03-13 09:27:33 +1100525// "~n" and "~r" are also unescaped to "\n" and "\r". The program is
526// responsible for calling Query::validate (with a strict_json_pointer_syntax
527// argument) before otherwise using this class.
Nigel Tao0cd2f982020-03-03 23:03:02 +1100528//
Nigel Taob48ee752020-03-13 09:27:33 +1100529// The mfj pointer therefore advances from mfi to mfk, or drops out, as we
530// incrementally match the object key with the query fragment. For example, if
531// we have already matched the "ban" of "banana", then we would accept any of
532// an "ana" token, an "a" token or a "\u0061" token, amongst others. They would
533// advance mfj by 3, 1 or 1 bytes respectively.
Nigel Tao0cd2f982020-03-03 23:03:02 +1100534//
Nigel Taob48ee752020-03-13 09:27:33 +1100535// mfj
Nigel Tao0cd2f982020-03-03 23:03:02 +1100536// v
537// +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
538// / a p p l e / b a n a n a / 1 2 / d u r i a n $
539// +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
540// ^ ^
Nigel Taob48ee752020-03-13 09:27:33 +1100541// mfi mfk
Nigel Tao0cd2f982020-03-03 23:03:02 +1100542//
543// At the end of each object key (or equivalently, at the start of each object
Nigel Taob48ee752020-03-13 09:27:33 +1100544// value), if mfj is non-nullptr and equal to (but not less than) mfk then we
545// have a fragment match: the query fragment equals the object key. If there is
546// a next fragment (in this example, "12") we move the frag_etc pointers to its
547// start and end and increment Query::m_depth. Otherwise, we have matched the
548// complete query, and the upcoming JSON value is the result of that query.
Nigel Tao0cd2f982020-03-03 23:03:02 +1100549//
550// The discussion above centers on object keys. If the query fragment is
551// numeric then it can also match as an array index: the string fragment "12"
552// will match an array's 13th element (starting counting from zero). See RFC
553// 6901 for its precise definition of an "array index" number.
554//
Nigel Taob48ee752020-03-13 09:27:33 +1100555// Array index fragment match is represented by the Query::m_array_index field,
Nigel Tao0cd2f982020-03-03 23:03:02 +1100556// whose type (wuffs_base__result_u64) is a result type. An error result means
557// that the fragment is not an array index. A value result holds the number of
558// list elements remaining. When matching a query fragment in an array (instead
559// of in an object), each element ticks this number down towards zero. At zero,
560// the upcoming JSON value is the one that matches the query fragment.
561class Query {
562 private:
Nigel Taob48ee752020-03-13 09:27:33 +1100563 uint8_t* m_frag_i;
564 uint8_t* m_frag_j;
565 uint8_t* m_frag_k;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100566
Nigel Taob48ee752020-03-13 09:27:33 +1100567 uint32_t m_depth;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100568
Nigel Taob48ee752020-03-13 09:27:33 +1100569 wuffs_base__result_u64 m_array_index;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100570
571 public:
572 void reset(char* query_c_string) {
Nigel Taob48ee752020-03-13 09:27:33 +1100573 m_frag_i = (uint8_t*)query_c_string;
574 m_frag_j = (uint8_t*)query_c_string;
575 m_frag_k = (uint8_t*)query_c_string;
576 m_depth = 0;
577 m_array_index.status.repr = "#main: not an array index query fragment";
578 m_array_index.value = 0;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100579 }
580
Nigel Taob48ee752020-03-13 09:27:33 +1100581 void restart_fragment(bool enable) { m_frag_j = enable ? m_frag_i : nullptr; }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100582
Nigel Taob48ee752020-03-13 09:27:33 +1100583 bool is_at(uint32_t depth) { return m_depth == depth; }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100584
585 // tick returns whether the fragment is a valid array index whose value is
586 // zero. If valid but non-zero, it decrements it and returns false.
587 bool tick() {
Nigel Taob48ee752020-03-13 09:27:33 +1100588 if (m_array_index.status.is_ok()) {
Nigel Tao0291a472020-08-13 22:40:10 +1000589 if (m_array_index.value == 0) {
Nigel Tao0cd2f982020-03-03 23:03:02 +1100590 return true;
591 }
Nigel Tao0291a472020-08-13 22:40:10 +1000592 m_array_index.value--;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100593 }
594 return false;
595 }
596
597 // next_fragment moves to the next fragment, returning whether it existed.
598 bool next_fragment() {
Nigel Taob48ee752020-03-13 09:27:33 +1100599 uint8_t* k = m_frag_k;
600 uint32_t d = m_depth;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100601
602 this->reset(nullptr);
603
604 if (!k || (*k != '/')) {
605 return false;
606 }
607 k++;
608
609 bool all_digits = true;
610 uint8_t* i = k;
611 while ((*k != '\x00') && (*k != '/')) {
612 all_digits = all_digits && ('0' <= *k) && (*k <= '9');
613 k++;
614 }
Nigel Taob48ee752020-03-13 09:27:33 +1100615 m_frag_i = i;
616 m_frag_j = i;
617 m_frag_k = k;
618 m_depth = d + 1;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100619 if (all_digits) {
620 // wuffs_base__parse_number_u64 rejects leading zeroes, e.g. "00", "07".
Nigel Tao6b7ce302020-07-07 16:19:46 +1000621 m_array_index = wuffs_base__parse_number_u64(
622 wuffs_base__make_slice_u8(i, k - i),
623 WUFFS_BASE__PARSE_NUMBER_XXX__DEFAULT_OPTIONS);
Nigel Tao0cd2f982020-03-03 23:03:02 +1100624 }
625 return true;
626 }
627
Nigel Taob48ee752020-03-13 09:27:33 +1100628 bool matched_all() { return m_frag_k == nullptr; }
Nigel Tao52c4d6a2020-03-08 21:12:38 +1100629
Nigel Taob48ee752020-03-13 09:27:33 +1100630 bool matched_fragment() { return m_frag_j && (m_frag_j == m_frag_k); }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100631
632 void incremental_match_slice(uint8_t* ptr, size_t len) {
Nigel Taob48ee752020-03-13 09:27:33 +1100633 if (!m_frag_j) {
Nigel Tao0cd2f982020-03-03 23:03:02 +1100634 return;
635 }
Nigel Taob48ee752020-03-13 09:27:33 +1100636 uint8_t* j = m_frag_j;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100637 while (true) {
638 if (len == 0) {
Nigel Taob48ee752020-03-13 09:27:33 +1100639 m_frag_j = j;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100640 return;
641 }
642
643 if (*j == '\x00') {
644 break;
645
646 } else if (*j == '~') {
647 j++;
648 if (*j == '0') {
649 if (*ptr != '~') {
650 break;
651 }
652 } else if (*j == '1') {
653 if (*ptr != '/') {
654 break;
655 }
Nigel Taod6fdfb12020-03-11 12:24:14 +1100656 } else if (*j == 'n') {
657 if (*ptr != '\n') {
658 break;
659 }
660 } else if (*j == 'r') {
661 if (*ptr != '\r') {
662 break;
663 }
Nigel Tao904004e2020-11-15 20:56:04 +1100664 } else if (*j == 't') {
665 if (*ptr != '\t') {
666 break;
667 }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100668 } else {
669 break;
670 }
671
672 } else if (*j != *ptr) {
673 break;
674 }
675
676 j++;
677 ptr++;
678 len--;
679 }
Nigel Taob48ee752020-03-13 09:27:33 +1100680 m_frag_j = nullptr;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100681 }
682
683 void incremental_match_code_point(uint32_t code_point) {
Nigel Taob48ee752020-03-13 09:27:33 +1100684 if (!m_frag_j) {
Nigel Tao0cd2f982020-03-03 23:03:02 +1100685 return;
686 }
687 uint8_t u[WUFFS_BASE__UTF_8__BYTE_LENGTH__MAX_INCL];
688 size_t n = wuffs_base__utf_8__encode(
689 wuffs_base__make_slice_u8(&u[0],
690 WUFFS_BASE__UTF_8__BYTE_LENGTH__MAX_INCL),
691 code_point);
692 if (n > 0) {
693 this->incremental_match_slice(&u[0], n);
694 }
695 }
696
697 // validate returns whether the (ptr, len) arguments form a valid JSON
698 // Pointer. In particular, it must be valid UTF-8, and either be empty or
699 // start with a '/'. Any '~' within must immediately be followed by either
Nigel Taod6fdfb12020-03-11 12:24:14 +1100700 // '0' or '1'. If strict_json_pointer_syntax is false, a '~' may also be
Nigel Tao904004e2020-11-15 20:56:04 +1100701 // followed by either 'n', 'r' or 't'.
Nigel Taod6fdfb12020-03-11 12:24:14 +1100702 static bool validate(char* query_c_string,
703 size_t length,
704 bool strict_json_pointer_syntax) {
Nigel Tao0cd2f982020-03-03 23:03:02 +1100705 if (length <= 0) {
706 return true;
707 }
708 if (query_c_string[0] != '/') {
709 return false;
710 }
711 wuffs_base__slice_u8 s =
712 wuffs_base__make_slice_u8((uint8_t*)query_c_string, length);
713 bool previous_was_tilde = false;
714 while (s.len > 0) {
Nigel Tao702c7b22020-07-22 15:42:54 +1000715 wuffs_base__utf_8__next__output o = wuffs_base__utf_8__next(s.ptr, s.len);
Nigel Tao0cd2f982020-03-03 23:03:02 +1100716 if (!o.is_valid()) {
717 return false;
718 }
Nigel Taod6fdfb12020-03-11 12:24:14 +1100719
720 if (previous_was_tilde) {
721 switch (o.code_point) {
722 case '0':
723 case '1':
724 break;
725 case 'n':
726 case 'r':
Nigel Tao904004e2020-11-15 20:56:04 +1100727 case 't':
Nigel Taod6fdfb12020-03-11 12:24:14 +1100728 if (strict_json_pointer_syntax) {
729 return false;
730 }
731 break;
732 default:
733 return false;
734 }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100735 }
736 previous_was_tilde = o.code_point == '~';
Nigel Taod6fdfb12020-03-11 12:24:14 +1100737
Nigel Tao0cd2f982020-03-03 23:03:02 +1100738 s.ptr += o.byte_length;
739 s.len -= o.byte_length;
740 }
741 return !previous_was_tilde;
742 }
Nigel Taod60815c2020-03-26 14:32:35 +1100743} g_query;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100744
745// ----
746
Nigel Tao68920952020-03-03 11:25:18 +1100747struct {
748 int remaining_argc;
749 char** remaining_argv;
750
Nigel Tao3690e832020-03-12 16:52:26 +1100751 bool compact_output;
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100752 bool fail_if_unsandboxed;
Nigel Tao0291a472020-08-13 22:40:10 +1000753 bool input_allow_comments;
754 bool input_allow_extra_comma;
755 bool input_allow_inf_nan_numbers;
Nigel Tao21042052020-08-19 23:13:54 +1000756 bool output_comments;
Nigel Tao0291a472020-08-13 22:40:10 +1000757 bool output_extra_comma;
Nigel Tao75682542020-08-22 21:40:18 +1000758 bool output_inf_nan_numbers;
Nigel Taod6fdfb12020-03-11 12:24:14 +1100759 bool strict_json_pointer_syntax;
Nigel Tao68920952020-03-03 11:25:18 +1100760 bool tabs;
Nigel Tao0a0c7d62020-08-18 23:31:27 +1000761
762 uint32_t max_output_depth;
763 uint32_t spaces;
764
765 char* query_c_string;
Nigel Taod60815c2020-03-26 14:32:35 +1100766} g_flags = {0};
Nigel Tao68920952020-03-03 11:25:18 +1100767
768const char* //
769parse_flags(int argc, char** argv) {
Nigel Taoecadf722020-07-13 08:22:34 +1000770 g_flags.spaces = 4;
Nigel Taod60815c2020-03-26 14:32:35 +1100771 g_flags.max_output_depth = 0xFFFFFFFF;
Nigel Tao68920952020-03-03 11:25:18 +1100772
773 int c = (argc > 0) ? 1 : 0; // Skip argv[0], the program name.
774 for (; c < argc; c++) {
775 char* arg = argv[c];
776 if (*arg++ != '-') {
777 break;
778 }
779
780 // A double-dash "--foo" is equivalent to a single-dash "-foo". As special
781 // cases, a bare "-" is not a flag (some programs may interpret it as
782 // stdin) and a bare "--" means to stop parsing flags.
783 if (*arg == '\x00') {
784 break;
785 } else if (*arg == '-') {
786 arg++;
787 if (*arg == '\x00') {
788 c++;
789 break;
790 }
791 }
792
Nigel Tao3690e832020-03-12 16:52:26 +1100793 if (!strcmp(arg, "c") || !strcmp(arg, "compact-output")) {
Nigel Taod60815c2020-03-26 14:32:35 +1100794 g_flags.compact_output = true;
Nigel Tao68920952020-03-03 11:25:18 +1100795 continue;
796 }
Nigel Tao94440cf2020-04-02 22:28:24 +1100797 if (!strcmp(arg, "d") || !strcmp(arg, "max-output-depth")) {
798 g_flags.max_output_depth = 1;
799 continue;
800 } else if (!strncmp(arg, "d=", 2) ||
801 !strncmp(arg, "max-output-depth=", 16)) {
802 while (*arg++ != '=') {
803 }
804 wuffs_base__result_u64 u = wuffs_base__parse_number_u64(
Nigel Tao6b7ce302020-07-07 16:19:46 +1000805 wuffs_base__make_slice_u8((uint8_t*)arg, strlen(arg)),
806 WUFFS_BASE__PARSE_NUMBER_XXX__DEFAULT_OPTIONS);
Nigel Taoaf757722020-07-18 17:27:11 +1000807 if (u.status.is_ok() && (u.value <= 0xFFFFFFFF)) {
Nigel Tao94440cf2020-04-02 22:28:24 +1100808 g_flags.max_output_depth = (uint32_t)(u.value);
809 continue;
810 }
811 return g_usage;
812 }
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100813 if (!strcmp(arg, "fail-if-unsandboxed")) {
Nigel Taod60815c2020-03-26 14:32:35 +1100814 g_flags.fail_if_unsandboxed = true;
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100815 continue;
816 }
Nigel Tao0291a472020-08-13 22:40:10 +1000817 if (!strcmp(arg, "input-allow-comments")) {
818 g_flags.input_allow_comments = true;
Nigel Tao4e193592020-07-15 12:48:57 +1000819 continue;
820 }
Nigel Tao0291a472020-08-13 22:40:10 +1000821 if (!strcmp(arg, "input-allow-extra-comma")) {
822 g_flags.input_allow_extra_comma = true;
Nigel Tao4e193592020-07-15 12:48:57 +1000823 continue;
824 }
Nigel Tao0291a472020-08-13 22:40:10 +1000825 if (!strcmp(arg, "input-allow-inf-nan-numbers")) {
826 g_flags.input_allow_inf_nan_numbers = true;
Nigel Tao3c8589b2020-07-19 21:49:00 +1000827 continue;
828 }
Nigel Tao21042052020-08-19 23:13:54 +1000829 if (!strcmp(arg, "jwcc")) {
830 g_flags.input_allow_comments = true;
831 g_flags.input_allow_extra_comma = true;
832 g_flags.output_comments = true;
833 g_flags.output_extra_comma = true;
834 continue;
835 }
836 if (!strcmp(arg, "output-comments")) {
837 g_flags.output_comments = true;
838 continue;
839 }
Nigel Tao0291a472020-08-13 22:40:10 +1000840 if (!strcmp(arg, "output-extra-comma")) {
841 g_flags.output_extra_comma = true;
Nigel Taodd114692020-07-25 21:54:12 +1000842 continue;
843 }
Nigel Tao75682542020-08-22 21:40:18 +1000844 if (!strcmp(arg, "output-inf-nan-numbers")) {
845 g_flags.output_inf_nan_numbers = true;
846 continue;
847 }
Nigel Tao0cd2f982020-03-03 23:03:02 +1100848 if (!strncmp(arg, "q=", 2) || !strncmp(arg, "query=", 6)) {
849 while (*arg++ != '=') {
850 }
Nigel Taod60815c2020-03-26 14:32:35 +1100851 g_flags.query_c_string = arg;
Nigel Taod6fdfb12020-03-11 12:24:14 +1100852 continue;
853 }
Nigel Taoecadf722020-07-13 08:22:34 +1000854 if (!strncmp(arg, "s=", 2) || !strncmp(arg, "spaces=", 7)) {
855 while (*arg++ != '=') {
856 }
857 if (('0' <= arg[0]) && (arg[0] <= '8') && (arg[1] == '\x00')) {
858 g_flags.spaces = arg[0] - '0';
859 continue;
860 }
861 return g_usage;
862 }
863 if (!strcmp(arg, "strict-json-pointer-syntax")) {
Nigel Taod60815c2020-03-26 14:32:35 +1100864 g_flags.strict_json_pointer_syntax = true;
Nigel Taod6fdfb12020-03-11 12:24:14 +1100865 continue;
Nigel Tao68920952020-03-03 11:25:18 +1100866 }
867 if (!strcmp(arg, "t") || !strcmp(arg, "tabs")) {
Nigel Taod60815c2020-03-26 14:32:35 +1100868 g_flags.tabs = true;
Nigel Tao68920952020-03-03 11:25:18 +1100869 continue;
870 }
871
Nigel Taod60815c2020-03-26 14:32:35 +1100872 return g_usage;
Nigel Tao68920952020-03-03 11:25:18 +1100873 }
874
Nigel Taod60815c2020-03-26 14:32:35 +1100875 if (g_flags.query_c_string &&
876 !Query::validate(g_flags.query_c_string, strlen(g_flags.query_c_string),
877 g_flags.strict_json_pointer_syntax)) {
Nigel Taod6fdfb12020-03-11 12:24:14 +1100878 return "main: bad JSON Pointer (RFC 6901) syntax for the -query=STR flag";
879 }
880
Nigel Taod60815c2020-03-26 14:32:35 +1100881 g_flags.remaining_argc = argc - c;
882 g_flags.remaining_argv = argv + c;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100883 return nullptr;
Nigel Tao68920952020-03-03 11:25:18 +1100884}
885
Nigel Tao2cf76db2020-02-27 22:42:01 +1100886const char* //
887initialize_globals(int argc, char** argv) {
Nigel Taod60815c2020-03-26 14:32:35 +1100888 g_dst = wuffs_base__make_io_buffer(
889 wuffs_base__make_slice_u8(g_dst_array, DST_BUFFER_ARRAY_SIZE),
Nigel Tao2cf76db2020-02-27 22:42:01 +1100890 wuffs_base__empty_io_buffer_meta());
Nigel Tao1b073492020-02-16 22:11:36 +1100891
Nigel Taod60815c2020-03-26 14:32:35 +1100892 g_src = wuffs_base__make_io_buffer(
893 wuffs_base__make_slice_u8(g_src_array, SRC_BUFFER_ARRAY_SIZE),
Nigel Tao2cf76db2020-02-27 22:42:01 +1100894 wuffs_base__empty_io_buffer_meta());
895
Nigel Taod60815c2020-03-26 14:32:35 +1100896 g_tok = wuffs_base__make_token_buffer(
897 wuffs_base__make_slice_token(g_tok_array, TOKEN_BUFFER_ARRAY_SIZE),
Nigel Tao2cf76db2020-02-27 22:42:01 +1100898 wuffs_base__empty_token_buffer_meta());
899
Nigel Tao991bd512020-08-19 09:38:16 +1000900 g_cursor_index = 0;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100901
Nigel Taod60815c2020-03-26 14:32:35 +1100902 g_depth = 0;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100903
Nigel Taod60815c2020-03-26 14:32:35 +1100904 g_ctx = context::none;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100905
Nigel Tao21042052020-08-19 23:13:54 +1000906 g_is_after_comment = false;
907
Nigel Tao68920952020-03-03 11:25:18 +1100908 TRY(parse_flags(argc, argv));
Nigel Taod60815c2020-03-26 14:32:35 +1100909 if (g_flags.fail_if_unsandboxed && !g_sandboxed) {
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100910 return "main: unsandboxed";
911 }
Nigel Tao21042052020-08-19 23:13:54 +1000912 if (g_flags.output_comments && !g_flags.compact_output &&
913 !g_flags.output_extra_comma) {
914 return "main: -output-comments requires one or both of -compact-output and "
915 "-output-extra-comma";
916 }
Nigel Tao75682542020-08-22 21:40:18 +1000917 if (g_flags.input_allow_inf_nan_numbers && !g_flags.output_inf_nan_numbers) {
918 return "main: -input-allow-inf-nan-numbers requires "
919 "-output-inf-nan-numbers";
920 }
Nigel Tao01abc842020-03-06 21:42:33 +1100921 const int stdin_fd = 0;
Nigel Taod60815c2020-03-26 14:32:35 +1100922 if (g_flags.remaining_argc >
923 ((g_input_file_descriptor != stdin_fd) ? 1 : 0)) {
924 return g_usage;
Nigel Tao107f0ef2020-03-01 21:35:02 +1100925 }
926
Nigel Tao0a0c7d62020-08-18 23:31:27 +1000927 g_new_line_then_256_indent_bytes =
928 g_flags.tabs ? NEW_LINE_THEN_256_TABS : NEW_LINE_THEN_256_SPACES;
929 g_bytes_per_indent_depth = g_flags.tabs ? 1 : g_flags.spaces;
930
Nigel Taod60815c2020-03-26 14:32:35 +1100931 g_query.reset(g_flags.query_c_string);
Nigel Tao0cd2f982020-03-03 23:03:02 +1100932
Nigel Taoc96b31c2020-07-27 22:37:23 +1000933 // If the query is non-empty, suppress writing to stdout until we've
Nigel Tao0cd2f982020-03-03 23:03:02 +1100934 // completed the query.
Nigel Taod60815c2020-03-26 14:32:35 +1100935 g_suppress_write_dst = g_query.next_fragment() ? 1 : 0;
936 g_wrote_to_dst = false;
Nigel Tao0cd2f982020-03-03 23:03:02 +1100937
Nigel Tao0291a472020-08-13 22:40:10 +1000938 TRY(g_dec.initialize(sizeof__wuffs_json__decoder(), WUFFS_VERSION, 0)
939 .message());
Nigel Tao4b186b02020-03-18 14:25:21 +1100940
Nigel Tao0291a472020-08-13 22:40:10 +1000941 if (g_flags.input_allow_comments) {
942 g_dec.set_quirk_enabled(WUFFS_JSON__QUIRK_ALLOW_COMMENT_BLOCK, true);
943 g_dec.set_quirk_enabled(WUFFS_JSON__QUIRK_ALLOW_COMMENT_LINE, true);
Nigel Tao3c8589b2020-07-19 21:49:00 +1000944 }
Nigel Tao0291a472020-08-13 22:40:10 +1000945 if (g_flags.input_allow_extra_comma) {
946 g_dec.set_quirk_enabled(WUFFS_JSON__QUIRK_ALLOW_EXTRA_COMMA, true);
Nigel Taoc766bb72020-07-09 12:59:32 +1000947 }
Nigel Tao0291a472020-08-13 22:40:10 +1000948 if (g_flags.input_allow_inf_nan_numbers) {
949 g_dec.set_quirk_enabled(WUFFS_JSON__QUIRK_ALLOW_INF_NAN_NUMBERS, true);
Nigel Tao51a38292020-07-19 22:43:17 +1000950 }
Nigel Taoc766bb72020-07-09 12:59:32 +1000951
Nigel Taocd4cbc92020-09-22 22:22:15 +1000952 // Consume any optional trailing whitespace and comments. This isn't part of
953 // the JSON spec, but it works better with line oriented Unix tools (such as
954 // "echo 123 | jsonptr" where it's "echo", not "echo -n") or hand-edited JSON
955 // files which can accidentally contain trailing whitespace.
956 g_dec.set_quirk_enabled(WUFFS_JSON__QUIRK_ALLOW_TRAILING_FILLER, true);
Nigel Tao4b186b02020-03-18 14:25:21 +1100957
958 return nullptr;
Nigel Tao2cf76db2020-02-27 22:42:01 +1100959}
Nigel Tao1b073492020-02-16 22:11:36 +1100960
961// ----
962
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100963// ignore_return_value suppresses errors from -Wall -Werror.
964static void //
965ignore_return_value(int ignored) {}
966
Nigel Tao2914bae2020-02-26 09:40:30 +1100967const char* //
968read_src() {
Nigel Taod60815c2020-03-26 14:32:35 +1100969 if (g_src.meta.closed) {
Nigel Tao9cc2c252020-02-23 17:05:49 +1100970 return "main: internal error: read requested on a closed source";
Nigel Taoa8406922020-02-19 12:22:00 +1100971 }
Nigel Taod60815c2020-03-26 14:32:35 +1100972 g_src.compact();
973 if (g_src.meta.wi >= g_src.data.len) {
974 return "main: g_src buffer is full";
Nigel Tao1b073492020-02-16 22:11:36 +1100975 }
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100976 while (true) {
Nigel Taod6a10df2020-07-27 11:47:47 +1000977 ssize_t n = read(g_input_file_descriptor, g_src.writer_pointer(),
978 g_src.writer_length());
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100979 if (n >= 0) {
Nigel Taod60815c2020-03-26 14:32:35 +1100980 g_src.meta.wi += n;
981 g_src.meta.closed = n == 0;
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100982 break;
983 } else if (errno != EINTR) {
984 return strerror(errno);
985 }
Nigel Tao1b073492020-02-16 22:11:36 +1100986 }
987 return nullptr;
988}
989
Nigel Tao2914bae2020-02-26 09:40:30 +1100990const char* //
991flush_dst() {
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100992 while (true) {
Nigel Taod6a10df2020-07-27 11:47:47 +1000993 size_t n = g_dst.reader_length();
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100994 if (n == 0) {
995 break;
Nigel Tao1b073492020-02-16 22:11:36 +1100996 }
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100997 const int stdout_fd = 1;
Nigel Taod6a10df2020-07-27 11:47:47 +1000998 ssize_t i = write(stdout_fd, g_dst.reader_pointer(), n);
Nigel Taofe0cbbd2020-03-05 22:01:30 +1100999 if (i >= 0) {
Nigel Taod60815c2020-03-26 14:32:35 +11001000 g_dst.meta.ri += i;
Nigel Taofe0cbbd2020-03-05 22:01:30 +11001001 } else if (errno != EINTR) {
1002 return strerror(errno);
1003 }
Nigel Tao1b073492020-02-16 22:11:36 +11001004 }
Nigel Taod60815c2020-03-26 14:32:35 +11001005 g_dst.compact();
Nigel Tao1b073492020-02-16 22:11:36 +11001006 return nullptr;
1007}
1008
Nigel Tao2914bae2020-02-26 09:40:30 +11001009const char* //
Nigel Tao6b86cbc2020-08-19 11:39:56 +10001010write_dst_slow(const void* s, size_t n) {
Nigel Tao1b073492020-02-16 22:11:36 +11001011 const uint8_t* p = static_cast<const uint8_t*>(s);
1012 while (n > 0) {
Nigel Taod6a10df2020-07-27 11:47:47 +10001013 size_t i = g_dst.writer_length();
Nigel Tao1b073492020-02-16 22:11:36 +11001014 if (i == 0) {
1015 const char* z = flush_dst();
1016 if (z) {
1017 return z;
1018 }
Nigel Taod6a10df2020-07-27 11:47:47 +10001019 i = g_dst.writer_length();
Nigel Tao1b073492020-02-16 22:11:36 +11001020 if (i == 0) {
Nigel Taod60815c2020-03-26 14:32:35 +11001021 return "main: g_dst buffer is full";
Nigel Tao1b073492020-02-16 22:11:36 +11001022 }
1023 }
1024
1025 if (i > n) {
1026 i = n;
1027 }
Nigel Taod60815c2020-03-26 14:32:35 +11001028 memcpy(g_dst.data.ptr + g_dst.meta.wi, p, i);
1029 g_dst.meta.wi += i;
Nigel Tao1b073492020-02-16 22:11:36 +11001030 p += i;
1031 n -= i;
Nigel Taod60815c2020-03-26 14:32:35 +11001032 g_wrote_to_dst = true;
Nigel Tao1b073492020-02-16 22:11:36 +11001033 }
1034 return nullptr;
1035}
1036
Nigel Tao6b86cbc2020-08-19 11:39:56 +10001037inline const char* //
1038write_dst(const void* s, size_t n) {
1039 if (g_suppress_write_dst > 0) {
1040 return nullptr;
1041 } else if (n <= (DST_BUFFER_ARRAY_SIZE - g_dst.meta.wi)) {
1042 memcpy(g_dst.data.ptr + g_dst.meta.wi, s, n);
1043 g_dst.meta.wi += n;
1044 g_wrote_to_dst = true;
1045 return nullptr;
1046 }
1047 return write_dst_slow(s, n);
1048}
1049
Nigel Tao21042052020-08-19 23:13:54 +10001050#define TRY_INDENT_WITH_LEADING_NEW_LINE \
1051 do { \
1052 uint32_t indent = g_depth * g_bytes_per_indent_depth; \
1053 TRY(write_dst(g_new_line_then_256_indent_bytes, 1 + (indent & 0xFF))); \
1054 for (indent >>= 8; indent > 0; indent--) { \
1055 TRY(write_dst(g_new_line_then_256_indent_bytes + 1, 0x100)); \
1056 } \
1057 } while (false)
1058
1059// TRY_INDENT_SANS_LEADING_NEW_LINE is used after comments, which print their
1060// own "\n".
1061#define TRY_INDENT_SANS_LEADING_NEW_LINE \
1062 do { \
1063 uint32_t indent = g_depth * g_bytes_per_indent_depth; \
1064 TRY(write_dst(g_new_line_then_256_indent_bytes + 1, (indent & 0xFF))); \
1065 for (indent >>= 8; indent > 0; indent--) { \
1066 TRY(write_dst(g_new_line_then_256_indent_bytes + 1, 0x100)); \
1067 } \
1068 } while (false)
1069
Nigel Tao1b073492020-02-16 22:11:36 +11001070// ----
1071
Nigel Tao2914bae2020-02-26 09:40:30 +11001072const char* //
Nigel Tao7cb76542020-07-19 22:19:04 +10001073handle_unicode_code_point(uint32_t ucp) {
Nigel Tao63441812020-08-21 14:05:48 +10001074 if (ucp < 0x80) {
1075 return write_dst(&ascii_escapes[8 * ucp + 1], ascii_escapes[8 * ucp]);
Nigel Tao7cb76542020-07-19 22:19:04 +10001076 }
Nigel Tao7cb76542020-07-19 22:19:04 +10001077 uint8_t u[WUFFS_BASE__UTF_8__BYTE_LENGTH__MAX_INCL];
1078 size_t n = wuffs_base__utf_8__encode(
1079 wuffs_base__make_slice_u8(&u[0],
1080 WUFFS_BASE__UTF_8__BYTE_LENGTH__MAX_INCL),
1081 ucp);
1082 if (n == 0) {
1083 return "main: internal error: unexpected Unicode code point";
1084 }
Nigel Tao0291a472020-08-13 22:40:10 +10001085 return write_dst(&u[0], n);
Nigel Tao168f60a2020-07-14 13:19:33 +10001086}
1087
Nigel Taod191a3f2020-07-19 22:14:54 +10001088// ----
1089
Nigel Tao50db4a42020-08-20 11:31:28 +10001090inline const char* //
Nigel Tao2ef39992020-04-09 17:24:39 +10001091handle_token(wuffs_base__token t, bool start_of_token_chain) {
Nigel Tao2cf76db2020-02-27 22:42:01 +11001092 do {
Nigel Tao462f8662020-04-01 23:01:51 +11001093 int64_t vbc = t.value_base_category();
Nigel Tao2cf76db2020-02-27 22:42:01 +11001094 uint64_t vbd = t.value_base_detail();
Nigel Taoee6927f2020-07-27 12:08:33 +10001095 uint64_t token_length = t.length();
Nigel Tao991bd512020-08-19 09:38:16 +10001096 // The "- token_length" is because we incremented g_cursor_index before
1097 // calling handle_token.
Nigel Taoee6927f2020-07-27 12:08:33 +10001098 wuffs_base__slice_u8 tok = wuffs_base__make_slice_u8(
Nigel Tao991bd512020-08-19 09:38:16 +10001099 g_src.data.ptr + g_cursor_index - token_length, token_length);
Nigel Tao1b073492020-02-16 22:11:36 +11001100
1101 // Handle ']' or '}'.
Nigel Tao9f7a2502020-02-23 09:42:02 +11001102 if ((vbc == WUFFS_BASE__TOKEN__VBC__STRUCTURE) &&
Nigel Tao2cf76db2020-02-27 22:42:01 +11001103 (vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__POP)) {
Nigel Taod60815c2020-03-26 14:32:35 +11001104 if (g_query.is_at(g_depth)) {
Nigel Tao0cd2f982020-03-03 23:03:02 +11001105 return "main: no match for query";
1106 }
Nigel Taod60815c2020-03-26 14:32:35 +11001107 if (g_depth <= 0) {
1108 return "main: internal error: inconsistent g_depth";
Nigel Tao1b073492020-02-16 22:11:36 +11001109 }
Nigel Taod60815c2020-03-26 14:32:35 +11001110 g_depth--;
Nigel Tao1b073492020-02-16 22:11:36 +11001111
Nigel Taod60815c2020-03-26 14:32:35 +11001112 if (g_query.matched_all() && (g_depth >= g_flags.max_output_depth)) {
1113 g_suppress_write_dst--;
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001114 // '…' is U+2026 HORIZONTAL ELLIPSIS, which is 3 UTF-8 bytes.
Nigel Tao0291a472020-08-13 22:40:10 +10001115 TRY(write_dst((vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__FROM_LIST)
1116 ? "\"[…]\""
1117 : "\"{…}\"",
1118 7));
1119 } else {
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001120 // Write preceding whitespace.
Nigel Taod60815c2020-03-26 14:32:35 +11001121 if ((g_ctx != context::in_list_after_bracket) &&
1122 (g_ctx != context::in_dict_after_brace) &&
1123 !g_flags.compact_output) {
Nigel Tao21042052020-08-19 23:13:54 +10001124 if (g_is_after_comment) {
1125 TRY_INDENT_SANS_LEADING_NEW_LINE;
1126 } else {
1127 if (g_flags.output_extra_comma) {
1128 TRY(write_dst(",", 1));
1129 }
1130 TRY_INDENT_WITH_LEADING_NEW_LINE;
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001131 }
Nigel Tao1b073492020-02-16 22:11:36 +11001132 }
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001133
1134 TRY(write_dst(
1135 (vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__FROM_LIST) ? "]" : "}",
1136 1));
Nigel Tao1b073492020-02-16 22:11:36 +11001137 }
1138
Nigel Taod60815c2020-03-26 14:32:35 +11001139 g_ctx = (vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__TO_LIST)
1140 ? context::in_list_after_value
1141 : context::in_dict_after_key;
Nigel Tao1b073492020-02-16 22:11:36 +11001142 goto after_value;
1143 }
1144
Nigel Taod1c928a2020-02-28 12:43:53 +11001145 // Write preceding whitespace and punctuation, if it wasn't ']', '}' or a
Nigel Tao0291a472020-08-13 22:40:10 +10001146 // continuation of a multi-token chain.
1147 if (start_of_token_chain) {
Nigel Tao21042052020-08-19 23:13:54 +10001148 if (g_is_after_comment) {
1149 TRY_INDENT_SANS_LEADING_NEW_LINE;
1150 } else if (g_ctx == context::in_dict_after_key) {
Nigel Taod60815c2020-03-26 14:32:35 +11001151 TRY(write_dst(": ", g_flags.compact_output ? 1 : 2));
1152 } else if (g_ctx != context::none) {
Nigel Tao0291a472020-08-13 22:40:10 +10001153 if ((g_ctx != context::in_list_after_bracket) &&
1154 (g_ctx != context::in_dict_after_brace)) {
Nigel Tao0cd2f982020-03-03 23:03:02 +11001155 TRY(write_dst(",", 1));
Nigel Tao107f0ef2020-03-01 21:35:02 +11001156 }
Nigel Taod60815c2020-03-26 14:32:35 +11001157 if (!g_flags.compact_output) {
Nigel Tao21042052020-08-19 23:13:54 +10001158 TRY_INDENT_WITH_LEADING_NEW_LINE;
Nigel Tao0cd2f982020-03-03 23:03:02 +11001159 }
1160 }
1161
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001162 bool query_matched_fragment = false;
Nigel Taod60815c2020-03-26 14:32:35 +11001163 if (g_query.is_at(g_depth)) {
1164 switch (g_ctx) {
Nigel Tao0cd2f982020-03-03 23:03:02 +11001165 case context::in_list_after_bracket:
1166 case context::in_list_after_value:
Nigel Taod60815c2020-03-26 14:32:35 +11001167 query_matched_fragment = g_query.tick();
Nigel Tao0cd2f982020-03-03 23:03:02 +11001168 break;
1169 case context::in_dict_after_key:
Nigel Taod60815c2020-03-26 14:32:35 +11001170 query_matched_fragment = g_query.matched_fragment();
Nigel Tao0cd2f982020-03-03 23:03:02 +11001171 break;
Nigel Tao18ef5b42020-03-16 10:37:47 +11001172 default:
1173 break;
Nigel Tao0cd2f982020-03-03 23:03:02 +11001174 }
1175 }
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001176 if (!query_matched_fragment) {
Nigel Tao0cd2f982020-03-03 23:03:02 +11001177 // No-op.
Nigel Taod60815c2020-03-26 14:32:35 +11001178 } else if (!g_query.next_fragment()) {
Nigel Tao0cd2f982020-03-03 23:03:02 +11001179 // There is no next fragment. We have matched the complete query, and
1180 // the upcoming JSON value is the result of that query.
1181 //
Nigel Taod60815c2020-03-26 14:32:35 +11001182 // Un-suppress writing to stdout and reset the g_ctx and g_depth as if
1183 // we were about to decode a top-level value. This makes any subsequent
1184 // indentation be relative to this point, and we will return g_eod
1185 // after the upcoming JSON value is complete.
1186 if (g_suppress_write_dst != 1) {
1187 return "main: internal error: inconsistent g_suppress_write_dst";
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001188 }
Nigel Taod60815c2020-03-26 14:32:35 +11001189 g_suppress_write_dst = 0;
1190 g_ctx = context::none;
1191 g_depth = 0;
Nigel Tao0cd2f982020-03-03 23:03:02 +11001192 } else if ((vbc != WUFFS_BASE__TOKEN__VBC__STRUCTURE) ||
1193 !(vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__PUSH)) {
1194 // The query has moved on to the next fragment but the upcoming JSON
1195 // value is not a container.
1196 return "main: no match for query";
Nigel Tao1b073492020-02-16 22:11:36 +11001197 }
1198 }
1199
1200 // Handle the token itself: either a container ('[' or '{') or a simple
Nigel Tao85fba7f2020-02-29 16:28:06 +11001201 // value: string (a chain of raw or escaped parts), literal or number.
Nigel Tao1b073492020-02-16 22:11:36 +11001202 switch (vbc) {
Nigel Tao85fba7f2020-02-29 16:28:06 +11001203 case WUFFS_BASE__TOKEN__VBC__STRUCTURE:
Nigel Taod60815c2020-03-26 14:32:35 +11001204 if (g_query.matched_all() && (g_depth >= g_flags.max_output_depth)) {
1205 g_suppress_write_dst++;
Nigel Tao0291a472020-08-13 22:40:10 +10001206 } else {
Nigel Tao52c4d6a2020-03-08 21:12:38 +11001207 TRY(write_dst(
1208 (vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__TO_LIST) ? "[" : "{",
1209 1));
1210 }
Nigel Taod60815c2020-03-26 14:32:35 +11001211 g_depth++;
1212 g_ctx = (vbd & WUFFS_BASE__TOKEN__VBD__STRUCTURE__TO_LIST)
1213 ? context::in_list_after_bracket
1214 : context::in_dict_after_brace;
Nigel Tao85fba7f2020-02-29 16:28:06 +11001215 return nullptr;
1216
Nigel Tao2cf76db2020-02-27 22:42:01 +11001217 case WUFFS_BASE__TOKEN__VBC__STRING:
Nigel Tao0291a472020-08-13 22:40:10 +10001218 if (start_of_token_chain) {
1219 TRY(write_dst("\"", 1));
1220 g_query.restart_fragment(in_dict_before_key() &&
1221 g_query.is_at(g_depth));
1222 }
1223
Nigel Taoade01652020-08-21 15:57:51 +10001224 if (vbd & WUFFS_BASE__TOKEN__VBD__STRING__CONVERT_1_DST_1_SRC_COPY) {
Nigel Tao0291a472020-08-13 22:40:10 +10001225 TRY(write_dst(tok.ptr, tok.len));
1226 g_query.incremental_match_slice(tok.ptr, tok.len);
Nigel Tao0291a472020-08-13 22:40:10 +10001227 }
1228
Nigel Tao496e88b2020-04-09 22:10:08 +10001229 if (t.continued()) {
Nigel Tao2cf76db2020-02-27 22:42:01 +11001230 return nullptr;
1231 }
Nigel Tao0291a472020-08-13 22:40:10 +10001232 TRY(write_dst("\"", 1));
Nigel Tao2cf76db2020-02-27 22:42:01 +11001233 goto after_value;
1234
1235 case WUFFS_BASE__TOKEN__VBC__UNICODE_CODE_POINT:
Nigel Tao496e88b2020-04-09 22:10:08 +10001236 if (!t.continued()) {
1237 return "main: internal error: unexpected non-continued UCP token";
Nigel Tao0cd2f982020-03-03 23:03:02 +11001238 }
1239 TRY(handle_unicode_code_point(vbd));
Nigel Taod60815c2020-03-26 14:32:35 +11001240 g_query.incremental_match_code_point(vbd);
Nigel Tao0cd2f982020-03-03 23:03:02 +11001241 return nullptr;
Nigel Tao1b073492020-02-16 22:11:36 +11001242 }
1243
Nigel Tao3f688b22020-08-21 15:51:48 +10001244 // We have a literal or a number.
1245 TRY(write_dst(tok.ptr, tok.len));
1246 goto after_value;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001247 } while (0);
Nigel Tao1b073492020-02-16 22:11:36 +11001248
Nigel Tao2cf76db2020-02-27 22:42:01 +11001249 // Book-keeping after completing a value (whether a container value or a
1250 // simple value). Empty parent containers are no longer empty. If the parent
1251 // container is a "{...}" object, toggle between keys and values.
1252after_value:
Nigel Taod60815c2020-03-26 14:32:35 +11001253 if (g_depth == 0) {
1254 return g_eod;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001255 }
Nigel Taod60815c2020-03-26 14:32:35 +11001256 switch (g_ctx) {
Nigel Tao2cf76db2020-02-27 22:42:01 +11001257 case context::in_list_after_bracket:
Nigel Taod60815c2020-03-26 14:32:35 +11001258 g_ctx = context::in_list_after_value;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001259 break;
1260 case context::in_dict_after_brace:
Nigel Taod60815c2020-03-26 14:32:35 +11001261 g_ctx = context::in_dict_after_key;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001262 break;
1263 case context::in_dict_after_key:
Nigel Taod60815c2020-03-26 14:32:35 +11001264 g_ctx = context::in_dict_after_value;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001265 break;
1266 case context::in_dict_after_value:
Nigel Taod60815c2020-03-26 14:32:35 +11001267 g_ctx = context::in_dict_after_key;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001268 break;
Nigel Tao18ef5b42020-03-16 10:37:47 +11001269 default:
1270 break;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001271 }
1272 return nullptr;
1273}
1274
1275const char* //
1276main1(int argc, char** argv) {
1277 TRY(initialize_globals(argc, argv));
1278
Nigel Taocd183f92020-07-14 12:11:05 +10001279 bool start_of_token_chain = true;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001280 while (true) {
Nigel Tao0291a472020-08-13 22:40:10 +10001281 wuffs_base__status status = g_dec.decode_tokens(
Nigel Taod60815c2020-03-26 14:32:35 +11001282 &g_tok, &g_src,
1283 wuffs_base__make_slice_u8(g_work_buffer_array, WORK_BUFFER_ARRAY_SIZE));
Nigel Tao2cf76db2020-02-27 22:42:01 +11001284
Nigel Taod60815c2020-03-26 14:32:35 +11001285 while (g_tok.meta.ri < g_tok.meta.wi) {
1286 wuffs_base__token t = g_tok.data.ptr[g_tok.meta.ri++];
Nigel Tao991bd512020-08-19 09:38:16 +10001287 uint64_t token_length = t.length();
1288 if ((g_src.meta.ri - g_cursor_index) < token_length) {
Nigel Taod60815c2020-03-26 14:32:35 +11001289 return "main: internal error: inconsistent g_src indexes";
Nigel Tao2cf76db2020-02-27 22:42:01 +11001290 }
Nigel Tao991bd512020-08-19 09:38:16 +10001291 g_cursor_index += token_length;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001292
Nigel Tao21042052020-08-19 23:13:54 +10001293 // Handle filler tokens (e.g. whitespace, punctuation and comments).
1294 // These are skipped, unless -output-comments is enabled.
Nigel Tao3c8589b2020-07-19 21:49:00 +10001295 if (t.value_base_category() == WUFFS_BASE__TOKEN__VBC__FILLER) {
Nigel Tao21042052020-08-19 23:13:54 +10001296 if (g_flags.output_comments &&
1297 (t.value_base_detail() &
1298 WUFFS_BASE__TOKEN__VBD__FILLER__COMMENT_ANY)) {
1299 if (g_flags.compact_output) {
1300 TRY(write_dst(g_src.data.ptr + g_cursor_index - token_length,
1301 token_length));
1302 } else {
1303 if (start_of_token_chain) {
1304 if (g_is_after_comment) {
1305 TRY_INDENT_SANS_LEADING_NEW_LINE;
1306 } else if (g_ctx != context::none) {
1307 if (g_ctx == context::in_dict_after_key) {
1308 TRY(write_dst(":", 1));
1309 } else if ((g_ctx != context::in_list_after_bracket) &&
Nigel Taocd4cbc92020-09-22 22:22:15 +10001310 (g_ctx != context::in_dict_after_brace) &&
1311 (g_ctx != context::end_of_data)) {
Nigel Tao21042052020-08-19 23:13:54 +10001312 TRY(write_dst(",", 1));
1313 }
1314 if (!g_flags.compact_output) {
1315 TRY_INDENT_WITH_LEADING_NEW_LINE;
1316 }
1317 }
1318 }
1319 TRY(write_dst(g_src.data.ptr + g_cursor_index - token_length,
1320 token_length));
1321 if (!t.continued() &&
1322 (t.value_base_detail() &
1323 WUFFS_BASE__TOKEN__VBD__FILLER__COMMENT_BLOCK)) {
1324 TRY(write_dst("\n", 1));
1325 }
1326 g_is_after_comment = true;
1327 }
1328 }
Nigel Tao496e88b2020-04-09 22:10:08 +10001329 start_of_token_chain = !t.continued();
Nigel Tao2cf76db2020-02-27 22:42:01 +11001330 continue;
1331 }
1332
Nigel Tao2ef39992020-04-09 17:24:39 +10001333 const char* z = handle_token(t, start_of_token_chain);
Nigel Tao21042052020-08-19 23:13:54 +10001334 g_is_after_comment = false;
Nigel Tao496e88b2020-04-09 22:10:08 +10001335 start_of_token_chain = !t.continued();
Nigel Tao2cf76db2020-02-27 22:42:01 +11001336 if (z == nullptr) {
1337 continue;
Nigel Taocd4cbc92020-09-22 22:22:15 +10001338 } else if (z != g_eod) {
1339 return z;
1340 } else if (g_flags.query_c_string && *g_flags.query_c_string) {
1341 // With a non-empty g_query, don't try to consume trailing filler or
1342 // confirm that we've processed all the tokens.
1343 return nullptr;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001344 }
Nigel Taocd4cbc92020-09-22 22:22:15 +10001345 g_ctx = context::end_of_data;
Nigel Tao1b073492020-02-16 22:11:36 +11001346 }
Nigel Tao2cf76db2020-02-27 22:42:01 +11001347
1348 if (status.repr == nullptr) {
Nigel Taocd4cbc92020-09-22 22:22:15 +10001349 if (g_ctx != context::end_of_data) {
1350 return "main: internal error: unexpected end of token stream";
1351 }
1352 // Check that we've exhausted the input.
1353 if ((g_src.meta.ri == g_src.meta.wi) && !g_src.meta.closed) {
1354 TRY(read_src());
1355 }
1356 if ((g_src.meta.ri < g_src.meta.wi) || !g_src.meta.closed) {
1357 return "main: valid JSON followed by further (unexpected) data";
1358 }
1359 // All done.
1360 return nullptr;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001361 } else if (status.repr == wuffs_base__suspension__short_read) {
Nigel Tao991bd512020-08-19 09:38:16 +10001362 if (g_cursor_index != g_src.meta.ri) {
Nigel Taod60815c2020-03-26 14:32:35 +11001363 return "main: internal error: inconsistent g_src indexes";
Nigel Tao2cf76db2020-02-27 22:42:01 +11001364 }
1365 TRY(read_src());
Nigel Tao991bd512020-08-19 09:38:16 +10001366 g_cursor_index = g_src.meta.ri;
Nigel Tao2cf76db2020-02-27 22:42:01 +11001367 } else if (status.repr == wuffs_base__suspension__short_write) {
Nigel Taod60815c2020-03-26 14:32:35 +11001368 g_tok.compact();
Nigel Tao2cf76db2020-02-27 22:42:01 +11001369 } else {
1370 return status.message();
Nigel Tao1b073492020-02-16 22:11:36 +11001371 }
1372 }
1373}
1374
Nigel Tao2914bae2020-02-26 09:40:30 +11001375int //
1376compute_exit_code(const char* status_msg) {
Nigel Tao9cc2c252020-02-23 17:05:49 +11001377 if (!status_msg) {
1378 return 0;
1379 }
Nigel Tao01abc842020-03-06 21:42:33 +11001380 size_t n;
Nigel Taod60815c2020-03-26 14:32:35 +11001381 if (status_msg == g_usage) {
Nigel Tao01abc842020-03-06 21:42:33 +11001382 n = strlen(status_msg);
1383 } else {
Nigel Tao9cc2c252020-02-23 17:05:49 +11001384 n = strnlen(status_msg, 2047);
Nigel Tao01abc842020-03-06 21:42:33 +11001385 if (n >= 2047) {
1386 status_msg = "main: internal error: error message is too long";
1387 n = strnlen(status_msg, 2047);
1388 }
Nigel Tao9cc2c252020-02-23 17:05:49 +11001389 }
Nigel Taofe0cbbd2020-03-05 22:01:30 +11001390 const int stderr_fd = 2;
1391 ignore_return_value(write(stderr_fd, status_msg, n));
1392 ignore_return_value(write(stderr_fd, "\n", 1));
Nigel Tao9cc2c252020-02-23 17:05:49 +11001393 // Return an exit code of 1 for regular (forseen) errors, e.g. badly
1394 // formatted or unsupported input.
1395 //
1396 // Return an exit code of 2 for internal (exceptional) errors, e.g. defensive
1397 // run-time checks found that an internal invariant did not hold.
1398 //
1399 // Automated testing, including badly formatted inputs, can therefore
1400 // discriminate between expected failure (exit code 1) and unexpected failure
1401 // (other non-zero exit codes). Specifically, exit code 2 for internal
1402 // invariant violation, exit code 139 (which is 128 + SIGSEGV on x86_64
1403 // linux) for a segmentation fault (e.g. null pointer dereference).
1404 return strstr(status_msg, "internal error:") ? 2 : 1;
1405}
1406
Nigel Tao2914bae2020-02-26 09:40:30 +11001407int //
1408main(int argc, char** argv) {
Nigel Tao01abc842020-03-06 21:42:33 +11001409 // Look for an input filename (the first non-flag argument) in argv. If there
1410 // is one, open it (but do not read from it) before we self-impose a sandbox.
1411 //
1412 // Flags start with "-", unless it comes after a bare "--" arg.
1413 {
1414 bool dash_dash = false;
1415 int a;
1416 for (a = 1; a < argc; a++) {
1417 char* arg = argv[a];
1418 if ((arg[0] == '-') && !dash_dash) {
1419 dash_dash = (arg[1] == '-') && (arg[2] == '\x00');
1420 continue;
1421 }
Nigel Taod60815c2020-03-26 14:32:35 +11001422 g_input_file_descriptor = open(arg, O_RDONLY);
1423 if (g_input_file_descriptor < 0) {
Nigel Tao01abc842020-03-06 21:42:33 +11001424 fprintf(stderr, "%s: %s\n", arg, strerror(errno));
1425 return 1;
1426 }
1427 break;
1428 }
1429 }
1430
Nigel Taofe0cbbd2020-03-05 22:01:30 +11001431#if defined(WUFFS_EXAMPLE_USE_SECCOMP)
1432 prctl(PR_SET_SECCOMP, SECCOMP_MODE_STRICT);
Nigel Taod60815c2020-03-26 14:32:35 +11001433 g_sandboxed = true;
Nigel Taofe0cbbd2020-03-05 22:01:30 +11001434#endif
1435
Nigel Tao0cd2f982020-03-03 23:03:02 +11001436 const char* z = main1(argc, argv);
Nigel Taod60815c2020-03-26 14:32:35 +11001437 if (g_wrote_to_dst) {
Nigel Taocd4cbc92020-09-22 22:22:15 +10001438 const char* z1 = g_is_after_comment ? nullptr : write_dst("\n", 1);
Nigel Tao0cd2f982020-03-03 23:03:02 +11001439 const char* z2 = flush_dst();
1440 z = z ? z : (z1 ? z1 : z2);
1441 }
1442 int exit_code = compute_exit_code(z);
Nigel Taofe0cbbd2020-03-05 22:01:30 +11001443
1444#if defined(WUFFS_EXAMPLE_USE_SECCOMP)
1445 // Call SYS_exit explicitly, instead of calling SYS_exit_group implicitly by
1446 // either calling _exit or returning from main. SECCOMP_MODE_STRICT allows
1447 // only SYS_exit.
1448 syscall(SYS_exit, exit_code);
1449#endif
Nigel Tao9cc2c252020-02-23 17:05:49 +11001450 return exit_code;
Nigel Tao1b073492020-02-16 22:11:36 +11001451}