Re: [Varnamproject-discuss] stemmer functionality

[Kevin Martin Jose]

And the tests :

https://github.com/lonesword/libvarnam/commit/0bdde115820bbe52389f3dea8c9bfee1b58eac66

On Saturday 14 June 2014 12:56 PM, Kevin Martin wrote:

Sorry, the previous commit would have produced merge conflict. So I removed the branch from origin, solved the conflict (my master in origin did not have strbuf_chars - I forgot to push the changes after fetching into my local master) and pushed the branch again.

Here is the updated commit - https://github.com/lonesword/libvarnam/commit/1d3284bd56f4c492e706ace0ab12255975174efa

On Sat, Jun 14, 2014 at 12:40 PM, Kevin Martin <address@hidden> wrote:

I've added a --stem <word> option to varnamc. It can only do one simple stemming right now : ാ to ്.

for example:

address@hidden ~/Development/libvarnam/examples $ varnamc -s ml -m പരീക്ഷയാ
Using /usr/local/lib/libvarnam.so
പരീക്ഷയ്

This is because I haven't added the code to check for more complex ending if the first ending is not in the stemrules table in ml.vst

Also,

varnamc -c schemes/ml now inserts the stem rules to a table stemrules in ml.vst

A small helper function strbuf_get_ending() as been added that makes use of the recently added strbuf_chars()

The commit : https://github.com/lonesword/libvarnam/commit/bb0a2998a87775d76b4377b48c7a8d5ae272791d

I haven't written any tests yet.