That is not the latest commit. I have done another commit undoing the previous incorrect implementation.
Also, are some of the test cases bound to fail? Because when I ran runtests.sh, I got the following output :
Running suite(s): core
util
commandline
Using /usr/local/lib/libvarnam.so
Transliterating 'varnam'
വർനം
Using /usr/local/lib/libvarnam.so
ruby: /home/kevin/Projects/libvarnam/words-table.c:97: vwt_optimize_for_huge_transaction: Assertion `(handle->internal)->known_words' failed.
Aborted
Using /usr/local/lib/libvarnam.so
Error at text: not-valid-indic-word. Invalid format. Each line should contain pattern and word separated with a single space
Processed 1 word(s). 0 word(s) passed. 1 word(s) failed.
Failed words are logged to - output/varnamc-train-failures.txt
68%: Checks: 50, Failures: 1, Errors: 15
/home/kevin/Projects/libvarnam/tests/initialization.c:116:E:initialization:initialize_using_lang_code:0: (after this point) Received signal 11 (Segmentation fault)
(null):-1:S:transliteration:basic_transliteration:0: (after this point) Test timeout expired
(null):-1:S:transliteration:dependent_vowel_rendering:0: (after this point) Test timeout expired
(null):-1:S:transliteration:cancellation_character_should_force_independent_vowel_form:0: (after this point) Test timeout expired
(null):-1:S:transliteration:indic_digit_rendering:0: (after this point) Test timeout expired
(null):-1:S:learning:starting_and_trailing_special_chars_should_be_removed:0: (after this point) Test timeout expired
(null):-1:S:learning:words_with_unknown_letters_should_be_rejected:0: (after this point) Test timeout expired
(null):-1:S:learning:basic_learning:0: (after this point) Test timeout expired
(null):-1:S:learning:words_with_repeating_characters_will_not_be_learned:0: (after this point) Test timeout expired
(null):-1:S:learning:numbers_will_be_ignored_while_learning:0: (after this point) Test timeout expired
(null):-1:S:learning:confidence_should_get_updated_for_existing_words:0: (after this point) Test timeout expired
(null):-1:S:learning:is_known_word:0: (after this point) Test timeout expired
(null):-1:S:learning:learn_from_multiple_open_handles:0: (after this point) Test timeout expired
/home/kevin/Projects/libvarnam/tests/vst-compilation.c:39:E:transliteration:get_all_tokens:0: (after this point) Test timeout expired
/home/kevin/Projects/libvarnam/tests/vst-compilation.c:71:E:transliteration:prefix_tree:0: (after this point) Test timeout expired
/home/kevin/Projects/libvarnam/tests/varnamc_tests.c:32:F:varnamc:learn_failures_file_should_be_created_upon_failures:0: Assertion '0==exitcode' failed: 0==0, exitcode==34304
only 68% pass. Is that normal?