tetrak_translit.ka.fold

The Georgian fold: one index form for every spelling of a word.

For what a fold is for, see tetrak_translit.fold. Georgian is a simpler case than Armenian: one orthography, and no pronunciation tradition that swaps consonants. What varies between spellings is the marking of aspirate against ejective (ʻ, ' or nothing, on opposite members of each pair depending on the system), the sibilants (ž/zh, š/sh, č/ch), x/kh, ḡ/gh, and ISO 9984’s c/j for ALA-LC’s ts/dz.

So the rules are: Georgian is rendered through ALA-LC after the archaic letters are folded onto their modern values; Latin is lowercased and stripped of diacritics and apostrophes (which merges each aspirate with its ejective), the sibilant spellings are collapsed, dz and j become one, ts and c become one, q becomes k (so Kazbegi finds ყაზბეგი), y becomes i, w becomes v, doubled letters are collapsed and anything that is not a letter or digit is removed.

Known gaps: Russian-mediated forms (Tiflis for თბილისი, Kutais for ქუთაისი) and translated names (George for გიორგი) do not fold to the Georgian. The test set in tests/data/ka_fold_cases.tsv is the published claim.

Functions

fold_token(token)

Fold one whitespace-free token, Georgian or Latin, to its key.