Re: Allocating many workspaces.

[Ben Pfaff]

Ben Pfaff <address@hidden> writes:

> John Darrington <address@hidden> writes:
>
>> The partcular problem I encountered stems from the fact, that
>> for every category, I'm calling sort_create_writer, which in
>> turn allocates space for a large number of cases - even if they
>> are never used.  I think I can solve that problem by sorting
>> the cases before categorising.  But I'm wondering if similar
>> situations will arise where such an optimisation cannot be
>> done.
>
> Hmm.  This seems like a bug in the sorting code.  It shouldn't
> allocate all that memory in advance.
>
> I didn't realize at the time I wrote the sort code that there
> would be a situation where we had a large number of sorters, so I
> didn't think of allocating incrementally.
>
> I doubt that it will be too difficult to fix this.  I filed it as
> bug #35887.

I fixed this specific bug in sort_create_writer().  The more
general problem, of course, remains.
-- 
Ben Pfaff 
http://benpfaff.org