Re: [Varnamproject-discuss] Bug 40714 : without rowid

[Kevin Martin]

I have done the tests on patterns_content and found it to be helpful. Please see[1]. I used the varnam word corpus to populate ml.vst.learnings. The difference in size was very significant. The DB shrinked from about 500mb to 294mb. I have attached the sqlite_analyzer output on the bug tracker. If this is really as good as it looks, I will use 'without rowid' on all tables and submit a pull request.

[1] https://savannah.nongnu.org/bugs/index.php?40714

On Thu, Mar 20, 2014 at 11:59 PM, Navaneeth K N <address@hidden> wrote:

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Hello Kevin,

I have updated SQLite and made a commit. Pull to get latest changes.

On 3/20/14 9:35 PM, Kevin Martin wrote:

> I was able to reproduce it once. But not again. I will look into this and
> file a bug if I can figure out why this happens. Meanwhile, how can I try
> out sqlite3 3.8.3 with varnam? Needs it to use the without rowid feature.
> How can I change the embedded sqlite?
>
>
> On Thu, Mar 20, 2014 at 11:47 AM, Navaneeth K N <address@hidden> wrote:
>

> Hello,
>
> `libvarnam` embeds SQLite. It won't use the system version. Primarily
> because SQLite does lots of performance improvements to each versions
> and system packages won't get updates all the time. For example, in
> Debian, updates are very rare.
>
> This makes `libvarnam`'s performance dependent on system's installed
> SQLite package. To avoid that, libvarnam compiles SQLite statically. In
> fact, that is the preferred way of using SQLite.
>
> On 3/20/14 11:34 AM, Kevin Martin wrote:
>>>> I'm trying to use sqlite 3.8.2 with libvarnam to see if 'without rowid'
> is
>>>> helpful. However using without rowid throws me a syntax error when I use
> it
>>>> with libvarnam. I can create tables without rowid in sqlite 3. I noticed
> a
>>>> file sqlite3.c in deps/ . libvarnam is not using the libsqlite3-dev
> package
>>>> in the system? If sqlite3.c is written for sqlite3 < 3.8.2, without rowid
>>>> will not work.
>>>>
>>>> Another curious thing is that I tried building libvarnam after removing
>>>> sqlite3 from my system. The build was successfull, even though
>>>> transliteration did not work ('kevin' was transliterated to 'kevin'
> instead
>>>> of the malayalam pattern). Wouldn't it be nice if we can add a few checks
>>>> to see if sqlite3 is installed?
>
> Transliteration should work because `libvarnam` is not dependent on
> system's SQLite package. Do you have the VST file available in the
> search path? Can you reproduce the behavior?
>
>>>>
>
>>
>>
>

- --
Cheers,
Navaneeth
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.22 (Darwin)
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJTKzN/AAoJEHFACYSL7h6kiOUIAIqQUp1uInMLREW9cMaEJ/r/
9U6YyY25lyJGlc3gxXzxglRH4Yb0U/XzTSSs5Us40dYttKkJwt5jK1EtbXjXQYEW
C6/lxmAjzI3741Z3zEaIgxyZhF6TWCtct4t6YCq7UviM7BpEI9JHzqe9Ac2U4tdU
yM+KXDAwfAYstMkgHy6PSbdJ8fvwvIeo3YX+acQGR3pjaaXmQfEW1SkYXPsVsaB9
q3FK16u3ZmpHmSs9/8rmse5EuS6vuNor2W5ztBajrykLb0f9f83O0VCgz6marLPb
1Wb6xAO5DWXRYYILzRpHawJiXuWQHGxLYL1SM2VlQsM8qYjnF0rO/VuWPOE0Zzw=
=6IBw
-----END PGP SIGNATURE-----