Re: [Wp-mirror-list] WP-MIRROR 0.7 feedback

[wp mirror]

Dear Luiz,

Thank you very much for your bug reports and feature requests.

I am currently working to release WP-MIRROR 0.7.3 this week. It is mostly bug fixes. Then I will start work on your requests. I have been thinking adding a feature that may be of interest to you. Namely, to generate ZIM files using Parsoid.

I will get back to you in a few days, after I have released v0.7.3.

Sincerely Yours,

Kent

On Mon, May 12, 2014 at 3:24 PM, Luiz Augusto <address@hidden> wrote:

Firstly, many thanks for releasing WP-MIRROR and congratulations for doing such impressive work! Your Manual is also awesome being so instructive for those that are nerd enough to run such software set but without being geek enough to known all knowledge that you've summarized on the manual.

I was playing on mirror Wikisource wikis for later creating .ZIM files for Kiwix but found some issues. Below are also some insights for some anothers Wikipedia sister projects

A) Apparently I've found a bug with your script. I was willing to try to run it mirroring ca.wikisource (a small Wikisource wiki, but with all relevant specific configurations that Wikisources shares), but using WP-MIRROR 0.7 on Debian 7.5 within VirtualBox 4.3.10 at some point I got this error message [1]:

B) Additionally, your tool misses some very crucial MediaWiki extensions used on some but not all Wikimedia wikis:

- ProofreadPage [2], usage example on [3] and [4]. Largelly used on all Wikisource wikis

- DynamicPageList [5], used on lot's of Wikimedia wikis. Usage example at [6] and [7]

- Quiz [8], enabled on some Wikibooks and Wikiversity wikis. Usage examples on [9]

C) Is possible to mirror the [[:oldwikisource:]] wiki (<https://wikisource.org/wiki/>, dbname sourceswiki)? How I cand do that? Is that wiki part of the WIkisource farm on your script?

D) Same question for [[:betawikiversity:]] wiki (<https://beta.wikiversity.org/>, dbname betawikiversity) and that wiki being to the Wikiversity farm

E) Is possible to point WP-MIRROR to grab the "allpages" data dump? Some Wikisource wikis stores relevant data on Talk namespace, as on [10]. My home wiki (ptwikisource) stores it in a multi-purspose custom namespace, [11]

Best,

Luiz/[[:m:User:555]]

----

[1] [ ok ]fsm-no-op cawikisource-20140509-local-media-f-ff

[ ok ]fsm-file-wget cawikisource-20140509-local-media-f-ff

[ ok ]fsm-file-remove cawikisource-20140509-local-media-f-ff

[....]fsm-file-list-missing cawikisource-20140509-remote-media-0-00

ERROR 1142 (42000) at line 1: SELECT command denied to user 'wikiadmin'@'localho[ ok ]fsm-file-list-missing cawikisource-20140509-remote-media-0-00

[ ok ]fsm-no-op cawikisource-20140509-remote-media-0-00

[ ok ]fsm-file-wget cawikisource-20140509-remote-media-0-00

[ ok ]fsm-file-remove cawikisource-20140509-remote-media-0-00

[....]fsm-file-list-missing cawikisource-20140509-remote-media-0-01

ERROR 1142 (42000) at line 1: SELECT command denied to user 'wikiadmin'@'localho[ ok ]fsm-file-list-missing cawikisource-20140509-remote-media-0-01

[2] - <https://www.mediawiki.org/wiki/Extension:Proofread_Page>

[3] - <https://fr.wikisource.org/wiki/Page%3AWace_-_Vie_de_saint_George%2C_1858.djvu/12>

[4] - <https://fr.wikisource.org/wiki/Vie_de_saint_George>

[5] - <https://www.mediawiki.org/wiki/Extension:DynamicPageList_(Wikimedia)>

[6] - <https://meta.wikimedia.org/wiki/Grants:IEG#ieg-join>

[7] - <https://en.wikinews.org/wiki/Category:Sports> ("latest stories")

[8] - <https://www.mediawiki.org/wiki/Extension:Quiz>

[9] - <https://en.wikiversity.org/wiki/Help:Quiz>

[10] - <https://en.wikisource.org/wiki/Talk:4885_Bags_of_Linseed/Opinion_of_the_Court>, that points to a doc on User namespace

[11] - <https://pt.wikisource.org/wiki/Anexo:Ficha/Ensaio_Hist%C3%B3rico_sobre_as_Letras_no_Brasil>