[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Wp-mirror-list] Download issue with wp-mirror
From: |
Benjamin Goldsmith |
Subject: |
[Wp-mirror-list] Download issue with wp-mirror |
Date: |
Tue, 19 Mar 2013 18:23:07 -0400 |
Hello wp-mirror-list.
I'm back and trying out version 0.5 of wp-mirror on enwiki. I'm very
excited to work on this project.
Here is what I have:
Dell PowerEdge 2950
8 GB RAM
Intel Xeon Dual Core Processor (2 CPU threads)
6 HDs:
2 36GB SAS drives, /dev/sda, RAID 1, ext4, mount /
2 300GB SAS drives, /dev/sdb, RAID 1, reiserfs, mount /var
2 2 TB SATA drives, /dev/sdc, RAID 1, reiserfs, mount
/var/lib/mediawiki/images
The RAIDs are managed by the hardware, not the OS.
I did a wp-mirror --add en to add enwiki
I did a wp-mirror --drop simple to not mirror simplewiki
Then my attempts to run wp-mirror began:
1) The assert-hdd-write-cache-disabled-p check failed. I made sure my
/etc/rc.local file had the lines:
hdparm -W0 /dev/sdb
hdparm -W0 /dev/sdc
But the check still failed. So I commented out the call to that check
and re-ran wp-mirror.
2) Next wp-mirror attempts to download the .xml.bz2. The file appears
in /var/lib/mediawiki/images/wp-mirror. But after awhile wp-mirror
quits, the file is deleted, and I see the message:
[fail]fsm-file-download enwiki-20130304-pages-articles.xml.bz2
This happens every time.
3) I wget enwiki-20130304-pages-articles.xml.bz2 myself, and copy it
into /var/lib/mediawiki/images/wp-mirror. Then I run wp-mirror. It
runs for awhile, but then this happens:
[ ok ]fsm-file-wikix
enwiki-20130304-pages-articles-p005973000-c000001000.xml
[ ok ]fsm-file-count
enwiki-20130304-pages-articles-p005974000-c000001000.xml
[ ok ]fsm-file-md5sum
enwiki-20130304-pages-articles-p005974000-c000001000.xml
[....]fsm-file-wikix
enwiki-20130304-pages-articles-p005974000-c000001000.xml
*** - regexp:regexp-exec: argument eof is not a string
And it halts.
I wonder if step 1 is screwing up the rest? Any insights are welcome.
Thank you in advance,
-Ben
- [Wp-mirror-list] Download issue with wp-mirror,
Benjamin Goldsmith <=