Re: Importing large file to PSPP hangs

[Roberto Roggiero]

Hi, thanks for your suggestions.

Finally the file opened, it was a lack of patience from me for not
waiting enough until pspp could open the file. It took more than 10
minutes to open in a not so powerfull computer with W7 at work. The
same file under Linux and a more updated computer took only a couple
of minutes to open.

Regards, Roberto.



2014-03-11 12:22 GMT-05:00 John Darrington <address@hidden>:
> PSPP should indeed be capable of handling such a file.  However please note:
>
> 1. I don't think that large files with CSV import has been thoroughly tested. 
>  So
>    it is possible that there might be problems which nobody has until now 
> noticed.
>
> 2. Obviously, when dealing with such large files it takes time to read, so I 
> would
>    expect the GUI to be unresponsive  until it is finished.  In fact I would 
> recommend using
>    the command line interface instead of the GUI, which is always going to be 
> faster.
>    In any case, I would estimate that for the dimensions you mention at least 
> 120 seconds
>    will be needed, perhaps more.
>
> 3. Whilst it should work on windows, GNU/Linux is the system which is most 
> thoroughly
>    tested, and for which it has been optimised.
>
>
> Hope this helps.
>
>
>
> On Tue, Mar 11, 2014 at 10:02:28AM -0500, Roberto Roggiero wrote:
>      I have a database in csv format with 11 million cases (rows) and 10
>      variables (columns), the file is 500 MB alfa-numeric. I can pass the
>      first steps of the import process, but when I finally ask for import
>      the process hangs, without any notice. I understand PSPP is capable to
>      manage such files (even larger). Any hint?
>
>      I am using PSPP 0.8.2 in Windows 7 with 2 GB Ram.
>
>      Regards, Roberto.
>
>      _______________________________________________
>      Pspp-users mailing list
>      address@hidden
>      https://lists.gnu.org/mailman/listinfo/pspp-users
>
> --
> PGP Public key ID: 1024D/2DE827B3
> fingerprint = 8797 A26D 0854 2EAB 0285  A290 8A67 719C 2DE8 27B3
> See http://sks-keyservers.net or any PGP keyserver for public key.
>