Re: [Sks-devel] 3 million keys & and community help requested

[Jeffrey Johnson]

On Nov 1, 2011, at 2:46 PM, Kim Minh Kaplan wrote:

> John Clizbe wrote:
> 
>> Are we using the most efficient schema for the database? Page sizes and other
>> default DB creation settings and tunables?
> 
> I have started running some benchmarks. First results are available at
> <https://www.kim-minh.com/pub/sks/sks-database-tuning>. The short
> answer is that we are probably not using a good page size.

New in db-5.2.38 is a db_tune utility that attempts to find an optimum
per-table page size.

I looked briefly at the output wrto rpmdb tables before choosing
not to fiddle up pagesizes on a per-table basis.

But the SKS tables are more predictable than rpmdb tables.

I doubt you will see any serious performance improvement.
Berekely DB performance depends on many pother factors, not just
pagesize. The mmap tunable is by far the most significant performance
tunable if there is some concept of "working set", which might not
be achievable for a 3M pubkey store.

hth

73 de Jeff