Static content group
|Static content group (talk)|
|CD/DVD on meta|
|WP 1.0 on meta|
|German CD on meta|
|Polska DVD on meta|
|Mandriva on meta|
|Offline task force
on strategy wiki
|Alt parsers (on MediaWiki)|
|GERMAN WP 1.0 (t)|
|de info in English|
|POLISH WP 1.0|
|ITALIAN WP 1.0 (it)|
|Malayalam WP 1.0 (ml)|
|ENGLISH WP 1.0 (t)|
|Bot (t) Criteria.|
|SOS Children DVD online browsable (t)|
|Version 0.5 (t) (bot)
|Core topics — Torrent|
|Work via WikiProjects|
|Wikipédia Junior (active)|
|FRENCH CD (very old)|
This is a group and set of projects dedicated to gathering and sharing static content from Wikimedia projects, including CDs and DVDs, single-file databases for use with specific browsers and readers, and pdf and html exports.
- 1 Background
- 2 Goals
- 3 Status
- 4 Food for thought
- 5 Guidelines and coordination
- 6 Updates and recommendations
- 7 See also
In 2004, the first Wikipedia CD was released, and the concept of WikiReaders for offline printing and reading was refined. In 2006, the Special Projects Committee authorized the creation of a subcommittee dedicated to static snapshots of Wikimedia content, to identify the groups working on such projects, and to help them work effectively together and share their results. This page is derived from those efforts and the work of all who have pursued similar goals.
- content quality/vetting for "Wikipedia 1.0"
- content on paper
- topical subsets
- selections for different audiences
- Maintain, offer and assist interested parties in getting
- static content of Wikimedia projects in a variety of formats
- metadata about its completeness, complexity/age level, and quality.
- Coordinate efforts to produce and distribute snapshots, and software for viewing snapshots.
- Stimulate research about content and making content accessible in an offline or semi-online environment.
As of mid-2006, the Wikimedia Foundation served to the world outdated version of static content of Wikipedias (November 2005 snapshot - ) and offered the same content for download (). There seeem to be persistent small problems with static content installation (categories,search, perhaps other).
There were plans to set up an up-to-date server with current static content of Wikipedias.
MediaWiki 1.5 included routines to dump a wiki to HTML, rendering the HTML with the same parser used on a live wiki.
There have been several separate attempts at producing software to convert SQL dumps into data formats that are suitable. Directmedia Publishing GmbH in Germany had by then a successful history of distributing Wikipedia content on DVD for Windows and MacOSX (Linux is beta).
Needs updating since 2007!
See List of Offline Projects for updated list of offline projects in the community.
Food for thought
- gateway to Wikipedia content publication on WP-De
- PDA-friendly content hosted by wikipedia:Axel Schäfer, member of parliament ( and  )
- /Germany - Introduction to the current situation of "Static content in Germany and/or in Germany"
- En: Organised by the w:Wikipedia:Version 1.0 Editorial Team with help from a bot. Release of w:Wikipedia:Version 0.5 (a test CD) is planned for late 2006.
- En: Earlier in 2006 the UK children's charity SOS Children released "A World of Learning" containing 2200 articles suitable for kids. They are now working here to expand the selection.
- Polish Wikipedia DVD: Major release planned for autumn 2006 by Wikimedia Polska in collaboration with Helion SA. See also this report in English.
- French Wikipedia: Work beginning on software, now collaborating with en and po.
- En/Fr Mandriva project: Wikimedia and Mandriva (very little activity)
- No: See no:Wikipedia:Wikipedia_1.0 (put on hold).
- Sv: See sv:Wikipedia:Wikipedia_1.0 (little activity).
- Bn: See bn:উইকিপেডিয়া:উইকিপ্রকল্প সিডি প্রকাশনা (Target: A 2000 article CD by the end of 2007)
Other project languages : Chinese? Dutch? Italian? Russian?
Since before 2004:
- The en:Webaroo Wikipedia and related packs
- OEPC : en:Wikipedia:One_Encyclopedia_Per_Child (simple, laptopwiki)
Formats and readers
Distribution formats: plain (x)HTML, PDF, TomeRaider, Plucker, Webaroo pack, proprietary formats
- Directmedia (free, if not open source, on Linux and Mac platforms - Linux version (digibux) is GPL)
- Gearswiki and google gears efforts
- Other (See below)
- REDIRECT Kiwix - Wikipedia Offline
- Tero-dump wikipedia to html converter
- Convert Wikipedia's SQL dump to static HTML for local installation only a prototype, very limited, but usable
- Wikimedia content for Sharp Zaurus
- TomeRaider and TomeRaider database
- Wikipedia in ipodlinux.org
- Static HTML tree dumps for mirroring or CD distribution
- Dynamic HTML generation from a local XML database dump
Initial members of the subcommittee:
Other interested people:
- Eric Astor (working on OEPC)
- Erik Garrison (working on related statistics)
- Eyu100 (asked the get involved)
Guidelines and coordination
Style guidelines for each project should be written down, for the benefit of projects to come after them. Coordination across projects of aspects such as script writing can also be quite helpful -- in catching mistakes and corner cases, and in avoiding repeated effort. Some specific ideas follow.
Registering a new snapshot
Needed : a process for announcing and registering a snapshot for others to see in progress, contribute to, or download and use. Start with finished projects to date in German, English, and Polish.
- En:wp: SOS CD project; Andrew wrote some scripts for this. 2006 articles on a CD.
- Initially distributed to benefit a children's charity in early 2006
- Wikiwizzy's version of the above for distribution in S.Africa
- De:wp: Directmedia CD, then DVD.
- Pl:wp: ?? DVD, planned for completion in October (slightly new deadline).
- How should snapshots recognize authors? What's the best way to attribute WP as a project as well as individuals, not simply to satisfy the GFDL?
- How can snapshots share algorithms? Part of snapshot design is choosing content.
- How can snapshots get updated? Scripting the creation so they don't get stale; minimizing editorial time needed.
- Style : different ways to handle
- templates (navigational, other)
- foul language
- images (size, content)
- text (when too long, for balance)
- interlanguage, interwiki links
- Enhancing content : how to handle
- delicate subjects (warning templates)
- conflicted subjects (pov templates)
- fast-changing subjects (news / current event templates)
- (note: all this can update the dynamic database directly)
- Interactivity and interfaces : Front-ends to read and interact with different snapshot formats.
- Reducing text : summarizing, auto-excerpting
- Ranking text : bot-assisted reviewing/vetting/rating, metric analysis (apsp, grank, hit-popularity, edit-popularity, expertise, writing style, &c)
- Metadata : bot-assisted annotation (audience, type, categorization)
- Spellchecker, grammar checker
- Copyvio checker
- Image resizing & compression
- Metadata extraction
- History metadata (list of users, freshness, &c)
- Image/media metadata
- Index generation (for browsing)
- Category tree generation
Updates and recommendations
- Add links to new moulin and kiwix projects, update links from local wikipedias re: 1.0 (via interwiki links). +sj | help with translation |+
- Add links to review ideas, including content stamping (since 2000) +sj | help with translation |+ 20:15, 26 February 2008 (UTC)
- set up a cron job with a script to update static content whenever content dump is done
- This actually sounds like a project for the Wikimedia Toolserver. -- Mathias Schindler 09:19, 3 June 2006 (UTC)