(The ZIM farm (zimfarm) is a half-decentralised software solution to build ZIM files efficiently. This now happens 100% automatically with the help of the Zimfarm. Actually, many ZIM flavours for Wikipedias and a few other projects. This was the last milestone on the way to generate a monthly fresh ZIM snaspshot for each of our projects. Install easily python-libzim with pip and give it a try: In the next months a few critical scrapers will be migrated from zimwriterfs to python-libzim and benefit of a sensitive code simplification and speed-up. On our side, Python-libzim was critical for a few other projects which are currently running. This move is really important to allow more people to benefit of the file format and ZIM files already published. For the other OSes you will have to compile the libzim manually.Īfter Node.js, this is the second scripting language for which openZIM proposes a binding of its famous reference implementation of the ZIM open specification. It supports out-of-the-box macOS and GNU/Linux. It provides a shallow Python interface on top of the libzim C++ library. Python-libzim package allows you to read/write ZIM files in Python. I'm happy to introduce you to Python-libzim. Hopefully now we can move on to newer problems." It can now be done in 5-6 days \o/Ĭongrats to everyone involved or who supported us one way or another, including the Foundation with the new & bigger servers they recently gave us access to. Updates will now run on a monthly basis, which is another major improvement: we had initially planned on bimonthly updates as a single run used to take up to three weeks. Emmanuel will have more details on the hurdles that he had to deal with. The numbers are somewhat misleading because we need to include internal links and redirects, which brings the total to 100+ million interlinked items. 5.2 millions) and a healthy 11 Gb in size (89 vs. with images) we had was from October 2018 (!), and since then we had been plagued by regressions, bugs, resource limitations and probably some very dark magic. "quick announcement for a major success on our side: we finally released late last night an updated version of the English Wikipedia. Updates from their team from a mailing list:
0 kommentar(er)
