Conversation
Asking why a word came out the way it did meant reading the rule engine and guessing. The encoder now offers to say so itself: encode_with_trace returns the cells alongside a Trace, and the Trace names, for every cell, the rule that wrote it. Tracing is opt-in. encode never builds a Trace, so the untraced path keeps its shape, and the numbers say the same: fixtures stay 5141 of 5141, the corpus stays at 455,975 of 467,121, and the marker bench still reads 837 / 145 / 305 / 398. Attribution is partitioned by the engine that owns the input, because the encoder is really several engines and a caller must be able to tell an uninstrumented one from a rule that declined to fire. Korean syllables are split to the article rather than reported as one composite entry, so 안 names 제6항 for its vowel and 제3항 for its 받침 instead of naming the syllable rule twice. A rule that matched and then skipped produced nothing and is not recorded: that it ran and that it explains the output are different claims. Cells no rule object writes are still accounted for. The blank between two words, a pre-encoded run whose token rule declared no article, and 제29항's roman indicator, continuation and terminator each name themselves through the emitter, so an unexplained cell means a genuine gap rather than a structural one. Over all 467,112 corpus sentences the trace now explains every one of the 88,927,183 cells. The one shape that had been slipping through was 제35항's numeric bridge resuming into a lowercase a-j, where UEB 6.5.2 makes the emitter write a continuation cell — 298 of them, plus two roman indicators on the same path. What remains unexplained is the capitals and grade-1 indicators on the pure-UEB path, where attribution places whole attempts of the contraction search and an indicator belongs to no attempt. A Korean document never reaches it; exactly one corpus sentence takes that path at all. The counts are pinned in a test rather than absorbed into a catch-all slot, because a slot that swallows anything unclaimed would make the gap unmeasurable.
Contributor
Braillify testcase report
Command: |
added 28 commits
September 21, 2026 14:56
The linux gate wants every line reached, and the tracing work left two stretches untested: the registry lookups for the jamo articles, the emitter slots and an index past its engine's partition, and the whole trace shim in the node package. The shim's per-event conversion and its two label tables are now named functions, because a match arm inlined in a closure can only be reached by finding an input that produces it — and the math path, for one, no Korean sentence reaches.
The remaining gap was the traced side of guards no test entered: a rule that matches and then skips, the token engine's rewrite shapes, the forced UEB encode, and the math route both when it lands and when it is thrown away. Each now has a test that goes through the public entry point where one exists. Two of them no input could reach. The encoder only dropped its origin table when a transform had already changed the token count, which the traced path never does, and the emitter built a fallback rule id inside a branch that the same reasoning made dead. Both now sit in code that every call runs, so what was unreachable is gone rather than merely excused. The encoder still emits exactly what it did: fixtures 5141 of 5141, corpus 455,975 of 467,121, marker bench 837 / 145 / 305 / 398.
The spaced ampersand of 제29항 asks whether a Roman word stands on each side, and the two answers it can reach without finding one had no test: already encoded output, which proves nothing about what it holds, and the end of the token stream, which proves nothing at all.
Article 51's body parts a 표제 from its 내용 with a 쌍점 written against the label and followed by one blank, and the rule already did that — but only when Korean stood on both sides of the colon. What the 내용 happens to be written in was never what the article turned on, so `모델명:PN50` and `일시:2006년` were being run straight on. The test stays on the left of the colon. Nothing Korean in front of it means the mark was never a 쌍점 at all but a sign inside a Roman identifier, which is how `NVH:Noise` and `A:IR` keep running on. [다만 2]'s exceptions are untouched for the same reason: `오전 10:20` and `요한 3:16` have a figure in front, and `청군:백군` is still caught by the 대비 쌍 test above. 25 more corpus sentences read correctly, 456,000 of 467,121. The marker bench reads 838 / 145 / 305 / 398 against 837 / 145 / 305 / 398, one more error over 66 more sentences that now line up word-for-word and enter the comparison at all (8,572 to 8,638). On the shared sentences the markers are unchanged.
A 가운뎃점 between figures names an event or an issue — 제주4·3, 광주5·18, 통권 제54·55·56호 — and 제5항 writes it ⠐⠆. Print often sets the Korean that names them against the figures, and the detector judged the whole word, so the Korean prefix made it fail the numeric test and the word fell through to the math route, where the dot became a product and 제11항 wrapped it in two blanks. The prefix is not noise in that judgement; it is the evidence. Reading past it and judging the figures alone leaves 제주4·3운동 and 제54·55·56호 exactly as they were, since neither reached the math route to begin with. 25 more corpus sentences read correctly, 456,025 of 467,121, with the marker bench unmoved at 838 / 145 / 305 / 398.
The tracer answers which rule wrote each braille cell, but sixteen rules answered with a placeholder rather than an article: two carried a word where a number belongs, and the rest inherited the trait default that exists precisely to say nobody has checked yet. rule_map.json at the repo root settles them. It holds all 448 articles with their text, so each rule was matched against the one whose wording describes what it does — 제46항 for the operator spacing that gives rule_math its name, 제53항 for the ellipsis, 제47항 for both fraction detectors, 제60항 for the asterisk, 제54항 for the quote attachment and for the tortoise-shell gloss that turns out to be the same bracket rule, 제35항 for the digital notation, 제19항 for the head of the 옛 글자 articles the middle-Korean detector switches into, 제49항 for the two dash and bracket spacing rules added earlier, and RUEB 8.4 for the capitals run, which no Korean article governs. Two take the honest marker the emitter's inter-word blank already uses: the space rule encodes the blank cell itself, and the LaTeX merge only joins a formula split across blanks and writes nothing. Over 5,160 traced sentences the placeholders fall from 4,331 to 2,378, and what remains is the math symbol dispatch, which needs an article per branch rather than one for the whole chain. Behaviour is untouched: fixtures 5141 of 5141, corpus 456,025 of 467,121, marker bench 838 / 145 / 305 / 398.
The English path wrote its indicators straight into the output without telling the tracer, so every capital sign and grade-1 sign belonged to no rule at all. `A1` left one cell unexplained and `Q50 2.2d` left three, and the landing page had to show those cells as coming from nowhere. The indicators now carry their RUEB sections: the capital-letter sign is 8.3, the capitalised-word sign is 8.4, and the grade-1 sign is 5. Spaced numeric output such as the `2.2` in `Q50 2.2d` takes 6. Recording them is not simply another attempt. `settle_word_attribution` credits a spelled-out word to 4.1 only while `attempt_count()` has not moved since the word began, so booking indicators as attempts would have silently stripped attribution from the very words they decorate. Indicators are therefore collected on their own cursor, counted separately, and subtracted from the broad fallback ranges during alignment so no cell is claimed twice. The test that pinned the gap open is now three tests that pin it shut, and a capitalised spelled-out word guards the hazard above. Attribution only: no output cell changes. Fixtures 5141 of 5141, corpus 456,025 of 467,121, marker bench 838 / 145 / 305 / 398.
The math engine answered the tracer with a placeholder 2,378 times over 5,160 traced sentences. One rule, MathSymbolRule, dispatches more than thirty symbols to as many different articles, so a single article per rule could never be honest: the arrow arm follows 제10항, the set arm 제60항, the quantifier arm 제61항, and one number had to stand for all of them. A rule may now own several registry slots. It declares the extra articles in variant_metas() and returns the one it actually used through ConsumedWithMeta, carrying the static itself rather than an index that would change meaning the moment the list is reordered. Dispatch resolves it by pointer identity within that rule's own declarations and refuses anything undeclared, so a rule cannot borrow a neighbour's article by accident. The flattening forced a second fix. Ids came from the rule's physical position in the dispatch vector, which stops matching the registry as soon as one rule occupies several slots; every rule after MathSymbolRule would have resolved to someone else's metadata. Dispatch now tracks the flattened base instead. The 221 shortcut characters carry their article in the same record as their cells, so the two cannot drift apart. Grouping them by article also made the table say which rule governs what, which it never did before. Seven symbols keep the honest placeholder because the standard does not name them. Two comments were simply wrong and are corrected: 제26항 is 행렬, not the product sign, and @9 is 제61항 1 부정, not 닮음, which is ,' under 제42항. Every one of the 221 character-to-cell mappings is unchanged, checked pair by pair against the previous table, and output bytes are identical across the fixtures and all 467,121 corpus rows. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398. Placeholders fall from 2,378 to 11.
Seven shortcut characters kept the honest placeholder because searching the standard's text for the character itself found nothing. That was the wrong search. The standard prints its examples in the internal braille notation, not in the Unicode characters an editor types, so a symbol is found by matching the cells it produces against the notation the article prints. Matched that way, five of the seven name their article plainly. The fraction slash writes ⠌, which 제7항 1 calls the 분수표 and prints as /. Script R and the not-similar sign write ⠠⠗ and ⠨⠈⠔, which 제34항 prints as ,R and .@9 for 관계가있다 and 관계가없다. The superscript c writes ⠘⠉, printed as ^c for 여집합 in 제60항 5. The not-implies sign writes ⠨⠒⠒⠕, printed as .33O for 항진명제의 부정 in 제61항 4. The same reading corrects 제34항's own description: it is the relation-symbol article, and the negation mark already filed under it belongs to its second clause, not to some separate rule about negation. Two symbols still have no article and now say why. ∏ carries the cells of Greek capital pi, which invites filing it under 제13항 by resemblance; the standard never mentions it, so it stays unattributed on purpose. ⸩ stands in for LaTeX's \right., a null delimiter with nothing printed for an article to govern. Only the article attached to each entry moved; all 221 character-to-cell mappings were compared pair by pair and are unchanged. Placeholders over 5,160 traced sentences fall from 11 to 3, all three now the null delimiter.
A \$...\$ span standing alone is a formula and the math engine owns it. The
same span inside English prose stays on the UEB side, where the parser turns it
into a Technical token and rule_11 encodes it. The engine emitted those cells
and told the tracer nothing, so a sentence like \�bc \{D}\$\ explained its
first four cells and left the other six belonging to no rule at all. Where a
whole line was formula and prose together, nothing at all was explained.
RUEB calls this code switching: 14.6.2 is the short inline fragment among
ordinary text, which is exactly this token's shape. 14.6.3 covers the long
terminal passage and is not what the parser produces here.
The cells are recorded on their own channel rather than as a contraction
attempt, because a word is credited to 4.1 only while the attempt count has not
moved since it began; booking these as attempts would have stripped the
attribution from neighbouring spelled-out words. Alignment places the direct
spans first and then searches for word and indicator cells outside them, so no
cell is claimed twice.
Two smaller holes closed with it. The code-switch encoder may try a span, emit
records, then refuse the input and hand it back; those records used to survive
into a trace they no longer described, and are now rolled back to a checkpoint.
And the symbol arms that finish through a shared continue never settled their
pending output, which is why fullwidth ＝ and ＋ went unexplained.
Attribution only: no output cell changes. Over 5,160 traced sentences the
unexplained cells fall from 1,892 to 449 and fully explained sentences rise from
5,119 to 5,127. Fixtures 5141 of 5141, corpus 456,025, marker bench
838 / 145 / 305 / 398.
Chemistry and engineering papers reach for code points the standard names but this table did not carry, so eight otherwise ordinary lines failed to transcribe at all rather than producing a single wrong cell. Two are the same symbol drawn differently. A reaction arrow is written long, U+27F6, where geometry writes U+2192; an n-ary product is written U+2A09 where arithmetic writes U+00D7. Same meaning, so same cells and same article as the form already present — anything else would report two articles for one role depending on which glyph an author typed. The third was a gap rather than a variant: 제27항 defines 나누어떨어진다 as \ and 나누어떨어지지않는다 as .\, but only the negated form was here. The plain sign is now its undotted counterpart, which a test pins so the pair cannot drift. Nothing already encodable changes: all 221 previous character-to-cell mappings were compared pair by pair and are untouched, and no line that transcribed before transcribes differently. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398. Over the 5,160 traced papers, failures fall from 18 to 10.
Engineering papers write resistance with U+2126 OHM SIGN rather than U+03A9 GREEK CAPITAL OMEGA. Unicode declares the two canonically equivalent — the ohm sign decomposes to omega and nothing else — so they are one character wearing two code points, and no transcription may tell them apart. We told them apart. Five papers carrying \[Ω]\ failed outright while the same text with capital omega transcribed fine. The English side never saw the problem because it normalises before it reads, which is why \R[Ω]\ already worked while a bare \Ω\ did not. The sign now shares omega's cells and article. Folding it in the pipeline instead would have meant normalising ahead of the NFD step 제65항 5 relies on for accented Latin, for a gain of exactly this one character: across the 5,160 papers and all 5,141 fixtures, the ohm sign is the only thing normalisation would have touched. Nothing already encodable changes: the previous 224 mappings were compared pair by pair and are untouched, and no line that transcribed before transcribes differently. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398. Failures over the traced papers fall from 10 to 5.
제49항 defines one 홑낫표. Unicode spells it twice, 「 」 at full width and ｢ ｣ at half width, and a statute quoted in a survey paper used the half-width pair, so the line failed to transcribe while the same words in the full-width pair transcribed fine. The standard's own prose writes it half width — ｢통일영어점자 규정｣ appears that way in the articles we transcribe from — so refusing the form is refusing the regulation's own typography. Both spellings now take 제49항's cells, pinned by a test that compares the pair rather than restating the cells, so the two can never drift apart. Nothing already encodable changes: no line that transcribed before transcribes differently. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398. Failures over the 5,160 traced papers fall from 5 to 4. The remaining four are not gaps we may close by inference. Circled capitals Ⓐ Ⓑ need 제64항's wrapping combined with 제28항's capital sign, and the article demonstrates only the lowercase ⓐ, leaving the order of the two indicators undetermined; that is now a question for 국립국어원 rather than a guess. ≫, ℧ and ℑ appear nowhere in the standard at all.
Every rule the tracer can credit should cite the article it implements, and the last few commits settled them one family at a time by reading each file. Reading is how the last one was missed: a search for the placeholders I knew about -- "?", "math", "space" -- cannot find a placeholder nobody thought to look for. The registry now answers instead. Walking every engine's registered rules and demanding each section be an article number, a dotted RUEB section, or "-" for output the standard prescribes without giving it an article, the test found unicode_fraction_encoding filed under the section "fraction". 한글 제47항 governs it, and says so with the very character class the rule handles: "분수는 분수표 /을 사용하여 분모, 분수표, 분자 순으로 적고", worked through as ⅔ → #c/#b. Corpus measurement would never have caught it. The 5,160 traced papers write their fractions in LaTeX, so this rule never fires there; the defect was real and silent at the same time. The one placeholder that remains is listed by name rather than skipped as a class, so adding a new undeclared rule turns the test red -- and so does retiring the last placeholder, which should be a deliberate edit rather than a quiet pass. It stands for the n-ary product sign, which the standard never mentions, and the right double parenthesis, which represents a LaTeX delimiter that prints nothing. No output changes. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
수학 제35항 to 제39항 give one mark each and in order: 선분 @c, 호 @[, 직선 [3O, 반직선 3O, 각 ?. Three of our marks cited the article next door. The overline that spans two points is 제35항's segment bar; it sat under 제36항, which is the arc. The two-headed arrow drawn above a pair is 제37항's line; it sat under 제38항. The single-headed one is 제38항's ray -- an article whose 붙임 also lends it to vectors -- and it sat under 제39항, which is the angle and nothing else. Nothing caught this because the cells were right either way. A reader checking the transcription against the standard would have been sent to an article that does not mention the mark in front of them, which is the whole failure the tracer exists to prevent. 제23항 was checked and left alone. It gives the bar over a variable, 켤레 복소수 and 평균값, the very same @c cells as the segment bar, so the two are told apart by code point alone: a combining or spacing macron marks a variable, the overline spans a pair of points. A test now says so, because the duplication otherwise looks like something to tidy away. The 제35항 slot also had to be declared in the rule's variant list. Reporting an article a rule never declared is refused by design, and it refused this one -- a fixture failed the moment the article moved without the declaration, which is the invariant doing exactly its job. Attribution only: all 225 character-to-cell mappings were compared pair by pair and are unchanged. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The Linux coverage gate names ten lines nothing reaches. Two of them are reachable behaviour that simply had no test. 제25항 writes a summation's bounds as a group and then leaves a blank before the body, but only when the body runs straight into it -- a summation already followed by a space, or one ending the expression, must not gain a second blank. The blank itself was never exercised. 제53항 reads a middle dot as the multiplication sign when the same expression also composes arithmetically, which is how derivative and product formulas are written. Nothing built a token stream that put a middle dot beside an equals sign, so the test for that condition never ran. Both are driven through the rule directly rather than through a written expression, because the parser reaches these token shapes only from inputs that would exercise a dozen other rules at the same time and prove nothing about these two. The remaining eight lines are not missing tests: they are a blank line, a closing brace, a method signature, two fields of a placeholder static, and a step in the middle of an iterator chain. They need the instrumentation looked at rather than more assertions, and that has to be read off CI because tarpaulin cannot run here -- the workspace needs a system Python for pyo3, and this platform's recorder miscounts by design. No output changes. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
제64항 wraps a circled character in 7 7 and works the lowercase case through: ⓐ is 70a7, the roman sign then the letter. It never shows a capital, so the order of the roman sign and the capital sign was undetermined and four readings all fitted the wording. Rather than pick one, the question went to 국립국어원, who answered on 2026-09-21: the roman sign first, then the capital sign, then the letter. Ⓐ is therefore ⠶⠴⠠⠁⠶. A test pins the order with that provenance written down, because nothing in the article can be used to check it. The gate that decides whether a character is an enclosed symbol at all listed only digits and lowercase letters, so the capitals never reached the encoder even to fail there. They do now. Exam papers label their choices Ⓐ Ⓑ, and a paper carrying them previously failed to transcribe as a whole. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398 all unchanged.
The standard names the summation in 수학 제25항 and writes it ,.S, which is Greek capital sigma. Nothing names the product. We wrote it ,.P anyway -- Greek capital pi, by analogy -- and marked the article unknown, which reads as an article we merely have not found yet rather than an extension we invented. 국립국어원 answered on 2026-09-21: the product sign cannot be transcribed. So the table no longer carries it, and an expression containing it is refused instead of quietly given cells the standard never granted. The cells being exactly Greek capital pi's is what made borrowing them look reasonable, so a test records that and asserts the character is absent, or the gap invites the same repair again. The summation is untouched and still cites 수학 제25항. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
수학 제38항 writes a ray as 3o,,AB and 제37항 writes a line as [3O,,AB: the
arrow ahead of both capitals, attached. 제10항 writes the arrows that stand
between things -- right, left, up, down and the four diagonals -- and lists the
right arrow among them. We sent every right arrow to 제38항 and every
two-headed arrow to 제37항, so a reaction equation and an ordinary mapping both
claimed to be geometry.
The give-away was in our own table: the left, up, down and diagonal arrows all
sat under 제10항 while the right arrow sat alone under 제38항, which is not a
shape the standard has.
The dispatch now asks what the standard's own notation asks: does the arrow
come ahead of two capitals with nothing before it. If it does, it is drawn over
them and the geometry articles apply. Otherwise it is standing between two
things and 제10항 does.
국립국어원 answered on 2026-09-21 that a chemical reaction arrow follows
과학점자규정 제18항, whose text spells the same cells (+ 5, → 3o, ← {3, ⇄ [7O).
Telling a reaction equation from any other standing arrow needs a chemistry
signal the math engine does not carry, so reaction arrows now reach 제10항
rather than the geometry article they had before -- closer, and honest about
what we can determine. The science article is recorded as remaining work.
Limits are untouched: the arrow in \lim_{n \to \infty} never reaches this rule.
No output changes -- both branches call the same encoder and all 224
character-to-cell mappings were compared pair by pair. Since the cells are
identical either way, only an article assertion can catch a regression here,
and one now does. Fixtures 5141 of 5141, corpus 456,025, marker bench
838 / 145 / 305 / 398.
Removing the n-ary product from the symbol table left nine integration snapshots still expecting cells for it. They failed on every platform, and I did not see it because I ran the suite with --lib for the preceding commits, which skips tests/ entirely. The project's gate is the whole suite, and it says so; I narrowed it and this is what that cost. The snapshots record the Ok/Err shape on purpose -- the module says so at the top -- so the fix is to let them record the refusal rather than to delete the cases. Each of the nine now reads err: Invalid character, and nothing else in the two snapshot files moved. The Π(a,b) dispatch is untouched. It matches Greek capital pi, U+03A0, not the product sign, and keeps its own unit test. Whole suite: 5253 + 20 + 8 + 351 + 162 passing, tests/ included this time.
I set out to delete the cell that `\right.` emits. 국립국어원 ruled that nothing
printed means nothing transcribed, `\right.` draws no delimiter, and the cell
sat under a placeholder article -- every sign pointed one way. Deleting it broke
a regulation fixture.
수학 제6항 1 lists the brackets and includes 연립식 괄호, opening `7'` and
closing `,7`. `7'` is two cells, ⠶⠄, and LaTeX writes that opening half as
`\left\{ ... \right.`. So the cell is the brace's second half, and the sentinel
standing for `\right.` carries it. The matrix code already said as much in a
comment about `\begin{cases}`; I did not read it before cutting.
The sentinel now cites 제6항 instead of the placeholder, which is what it should
have cited all along. A test records why a thing named after a right delimiter
belongs to the bracket article, so the same deletion is not attempted again.
With that, no registered math rule keeps the placeholder and no shortcut
carries an unknown article. Over 5,160 traced papers the tracer reports an
article for every cell it explains -- the count of unknown articles reaches
zero. Output is untouched: all 224 mappings compared pair by pair, no traced
line transcribes differently, fixtures 5141 of 5141, corpus 456,025, marker
bench 838 / 145 / 305 / 398.
한글 제53항 writes the ellipsis in prose. 수학 제12항 [붙임 1] claims it back inside an expression -- "쉼표는 " 으로 적고, 줄임표는 ,,, 으로 적는다" -- and 국립국어원 confirmed on 2026-09-21 that an ellipsis in a formula follows the math standard. Both write the same three cells, so nothing in the output could have shown the wrong choice. The rule for an ellipsis met inside math cited the Korean article, which also rendered as 수학 제53항 in the trace, and 수학 제53항 is the derivative. Article 12 is titled 로마자 변수 표기, so its 붙임 carrying the ellipsis is not something a reader would guess; the rule now quotes it. A test pins the section and the 붙임, because only the article separates the two cases. Prose is untouched: an ellipsis outside a formula still goes through its own rule under 한글 제53항. No output changes, all 224 mappings compared pair by pair. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The middle dot met inside an expression was filed under 한글 제50항, the punctuation mark. The cells say otherwise: 제50항 writes 가운뎃점 as ⠐⠆, two cells, and this table gives the same character a single ⠐. 수학 제2항 [붙임] is where that single cell comes from -- "점으로 표현된 곱셈 기호는 " 으로 적는다" -- so a dot standing between operands is the multiplication sign, not the punctuation it resembles. The article was wrong twice over. It named the wrong rule, and because the rule runs in the math engine the trace rendered it as 수학 제50항, which is 무한대. A test compares the two tables' cells for the same character, since that difference is the whole evidence and a section number alone does not show it. No output changes, all 224 mappings compared pair by pair. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The trace decided the series from the engine that produced the cell: math engine, therefore 수학 제N항. That is wrong whenever a rule implements an article from another series, and several do. Circled numbers are 한글 제64항 and the math engine encodes them, so the page read them as 수학 제64항, which is 햇. The degree sign, the colon, the semicolon and the tortoise-shell gloss are the same shape of error. Each rule already records the full citation in standard_ref -- "2024 Korean Braille Standard, 한글 제64항" -- and nothing exposed it. The span now carries standard_ref and subsection alongside the number, and the label reads the series from the citation, falling back to the engine only when the citation does not name one. The article data was right the whole time; only the display inferred. No cells change and no rule's article changes. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The middle-Korean detector counted any CJK ideograph as strong evidence that a word belonged to a historical text, alongside the old jamo and the private-use syllables. 국립국어원 answered on 2026-09-21 that the mode follows the 옛글자 -- "옛글자가 들어가면 그 글자에 대하여 그렇게 표기합니다" -- and that a Hanja cannot be transcribed as itself at all, so it is evidence of nothing. A modern sentence quoting one in parentheses -- 플로리다주(州)로, 지천명(知天命)의 -- is ordinary Korean, and the corpus has seven such sentences. The trigger turns out to have been inert: with it gone, the regulation fixtures still pass 5141 of 5141, the corpus still matches on 456,025, the marker bench still reads 838 / 145 / 305 / 398, and all seven Hanja sentences still agree with their reference. It fired only where the old jamo or the private-use syllables were already firing. A test now pins the negative, because historical texts are in fact full of Hanja and the range looks like it belongs. The judgment unit was already the word with a look at its neighbours, which is finer than the sentence the reply describes, so nothing there needed changing.
Asked which article to cite when one decision rests on several, 국립국어원 answered on 2026-09-21: 다 적습니다. A section may now carry a list. The English-context punctuation rule is the case that prompted the question. It does three things at once and each has its own article: 제33항 keeps a comma between Roman and Korean in the Korean shape, 제34항 drops the Roman terminator when brackets or quotes enclose the Roman text, and 제49항 gives the punctuation its cells. It cited 제49항 alone, and its standard_ref pointed at two chapters by number -- Ch.4 Sec.10 + Ch.6 Sec.13 -- which no reader could turn into articles. The registry guard accepts a list without also accepting a rule that never chose an article, and both the page and the trace harness render one as 제33항·제34항·제49항 rather than the 제33, 34, 49항 a naive join would give. Over 5,160 traced papers the rule reports all three articles 2,402 times. No output changes and no other rule's article moves. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The placeholder existed as the trait's default so an unchecked rule reported itself as unattributed instead of borrowing an article. Every math rule now names a real one, which left the default unreachable and the placeholder static never read -- two of the ten lines the coverage gate is holding out for. Making meta required turns the runtime guard into a compile error: a rule without a checked article no longer builds. That is the stronger statement, and it is what the placeholder was standing in for all along. The three dummy rules in the dispatch tests take a stand-in article, marked as such, since they exercise dispatch and never reach the registry. No behaviour changes. Fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
added 3 commits
September 22, 2026 17:45
Three of the lines the Linux gate reports are not branches anyone forgot to test. They are a step in the middle of an iterator chain, the closing brace of a for loop, and a condition split across four lines -- positions where the recorder opens a region that the surrounding code never enters on its own. The file already carries a note about this for a multi-line matches!(), so the remedy is the one already used here: write the expression so no such position exists. The ampersand lookahead slices instead of skipping, which is what it meant anyway. The blank-cell scan extends from an iterator rather than pushing inside a loop. The middle-dot test binds its condition before the if. Each is the same computation. Whole suite 5253 + 20 + 8 + 351 + 162 passing, fixtures 5141 of 5141, corpus 456,025, marker bench 838 / 145 / 305 / 398.
The coverage gate reports line numbers from a source I was not reading. The publish workflow writes a .rustfmt.toml with max_width = 100000 and runs cargo fmt before tarpaulin, so every multi-line expression is collapsed first and the reported numbers index that collapsed file. I had been opening those numbers in my own tree, which is why my last two commits moved the reported lines around instead of removing them: I was rewriting expressions that were never the uncovered ones. Reproducing the reformat locally named the real lines, and they are all code this branch introduced -- which is also why main sits at 100% with the same surrounding code. TokenRule::meta() gets the same treatment MathTokenRule got: required rather than defaulted. The placeholder it returned was dead, because the twenty-six real rules all declare an article and the ten dummies in token_engine never have meta() called on them. Requiring it deletes the static and moves the guarantee to the compiler. The other four are reachable and now have tests. A measured quantity such as 3cm is emitted in one piece, so the emitter records its span itself; the raw token rule refuses punctuation outside the four marks the Korean articles name; an indicator landing inside a rule's cells keeps the fragment before it; and a token that wrote no cells records no span at all, since a zero-width span would claim an output position the token never wrote. Whole suite: 5270 + 20 + 8 + 351 + 162 passing, no new warnings. Two lines remain, both in the math symbol chain, and they are a real defect rather than a test gap: the arms for the proportion sign and the sequence braces call a shortcut table that has no entry for either character, so the call always fails and the article line after it cannot be reached. The standard does define both -- 과학점자 제29항 gives 비례 기호 as +3, 수학 제24항 gives 수열 as 7A;N7 -- so the fix is the missing table entries, not a deletion. That lands next.
The last two uncovered lines were the article expressions in the math symbol
chain for the proportion sign and the sequence braces. Neither could be
reached: both arms call the shortcut table for a character the table has no
entry for, so the call always fails and the line after it is dead. The lines
are mine -- the per-branch articles this branch introduced -- but the dead
arms underneath them are older.
The standard does define the proportion sign. 과학 제29항 writes 비례 기호 as
+3, with 위치에너지 ∝ 질량 as its example, so the table was simply missing the
entry and ∝ was refused as input. It now encodes as ⠬⠒. The article is 과학
제29항, not 수학 제5항: 제5항 is the ratio sign ∶ (U+2236), which the table
already carried and which is a different character and a different rule. The
arm had been crediting ∝ to 제5항, so a new META_SCIENCE_29 takes it and
rule_5's module doc records the split.
The sequence braces are not a missing entry. 수학 제24항 writes 수열 as 7A;N7,
so the braces of a sequence take ⠶ -- but only there. I added '{' => ⠶ and
found out the hard way: it broke set-builder notation, where {x | x ∈ R} must
keep the Korean braces ⠦⠂ and ⠐⠴. Braces are article-24 only in the sequence
context, and nothing in the encoder detects that context, so a flat mapping is
wrong by construction. The arm could therefore never have worked, and the test
covering it said as much in its own comment: the parser routes braces to
OpenParen, so the arm is not on the path. The stub module goes, and its test
now states which path braces actually take. 수학 제24항 stays unimplemented
rather than half-implemented.
Shortcut table diff against HEAD: 1 added, 0 dot patterns changed.
Whole suite: 5269 + 20 + 8 + 351 + 162 passing, no warnings.
Corpus unchanged at 456025/467121 (97.6246%).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an opt-in
encode_with_tracethat returns, for every output cell, the rule that wrote it.Behaviour is unchanged: fixtures 5141/5141, corpus 455,975/467,121 (97.6139%), marker bench 837/145/305/398.
Across all 467,112 corpus sentences the trace explains every one of the 88,927,183 cells. The remaining gap is the capitals/grade-1 indicators on the pure-UEB path, pinned in a test rather than absorbed into a catch-all slot.