Wikipedia:Wikipedia Signpost/2011-02-07/Technology report
Bugs, Repairs, and Internal Operational News
MediaWiki 1.17 deployment imminent
For most of its history, code for the MediaWiki software which forms the basis of WMF wikis and other sites was developed, packaged into sequential releases every three or four months, and then deployed. However, more recently, major changes have been deployed immediately (i.e. out of cycle), easing the pressure on set-piece deployments of code. On Tuesday, February 8, starting at 07:00 UTC, the latest major release of the MediaWiki software, version 1.17, will be released, giving WMF wikis around six months' worth of not-already-deployed code updates (Wikimedia Techblog). A release to other sites will follow soon after. The release represents a massive code review effort in the last two months to check all updates to the software (approximately 1200 of them) before they are released.
If the deployment goes well, it is unlikely that Wikimedians will notice much difference: most of the major features have already been implemented on WMF wikis. (Some interim disruption is nonetheless expected; for example, database dumps are to be stopped temporarily.) Among the major unreleased developments is the new ResourceLoader, designed to speed up page loading times, though it could cause JavaScript errors on less well maintained (smaller) WMF wikis. Other updates are less obvious: a full list, which includes already released developments, is also available. A number of other developments dependent on 1.17 will be added shortly after its release.
The regularity of releases – and particularly the criteria used for determining which updates were deployed immediately and which had to sit in the queue – has been a contentious issue in recent months (see, for example, previous Signpost coverage from October 2010: 1, 2). There is now hope that after the release of 1.17, it may be possible to act upon volunteer developers' calls to have a more regular development cycle. For example, Brion Vibber, for a long time Chief Technology Officer (CTO) at Wikimedia, commented (wikitech-l mailing list):
| “ | 1.17 releasing soon should bring the schedule back to semi-annual, but there's no firm impediment other than our own self-organization to pushing 1.18 out 3 months later instead of 6 or 13. | ” |
February Engineering Update published
In addition to the major announcement concerning 1.17, the Foundation's Engineering Update for February (and covering the activities of January) was published last week on the Wikimedia Techblog, giving a brief overview of all Foundation-sponsored technical operations in the last month. It summarised the developments:
| “ | January 2011 was a tough month for Wikimedia engineers. About 75% of us caught the "WikiPlague" (a.k.a. RSV) and were out of commission between 3 and 10 days. Also, with the end of the Fundraiser coming early, this past month has been a time of re-starting and re-setting priorities... Major accomplishments this month include: the completion of equipment specs and negotiations to order all equipment for the new primary data center in Ashburn, Virginia; major work on getting MediaWiki 1.17 released, especially by reducing the Code Review queue to releasable levels; and work on increasing Nagios and Watchmouse monitoring [to prevent and minimise downtime]. | ” |
The update also noted that new job openings for the positions of Operations Engineer and Senior QA Engineer, previously announced, had been published; and that work had been done on evaluating LiquidThreads but that development of the Article Feedback tool had been put off until after the release of 1.17. Other noticeable improvements include the imminent launch of improved category collation code, allowing sub-categories, files, and pages to be paged separated. This "dark-launch" will be invisible at first, while the feature is stress-tested to check for errors before it is finished and made visible to the average user. According to the update, a survey related to the Wikimedia mobile site is also being drafted.
In brief
Not all fixes may have gone live to WMF sites at the time of writing; some may not be scheduled to go live for many weeks.
- After the news that all remaining IPv4 addresses had been allocated to regions – effectively signalling the possible end of the standard in some regions within the next eighteen months – there was a discussion about how Wikimedia sites could (better) support the new specification, IPv6 (wikitech-l mailing list).
- The search engine Google briefly stopped including much of the German Wikipedia in their search listings after a "bug on their end" (Wikimedia bug #27155). There had been conjectures that it was related to the FlaggedRevs extension (which includes a "noindex,nofollow" tag in unreviewed page revisions, though by default these are only displayed as current revisions to logged-in users), which even made it into German media: a Spiegel online headline read "Bug lets Wikipedia vanish".
- The Foundation held a "data summit" on February 3/4, "a working session about semantic data, analytics and research into data dumps" in California. Speakers included developers for Semantic MediaWiki and various projects that extract structured data from Wikipedia (including Freebase, DBPedia, Ultrapedia and Shortipedia), as well as in-house experts from Wikimedia such as Data Analyst Erik Zachte. The session on analytics included a one-hour discussion of privacy issues, with Foundation staff explaining potential community concerns to external researchers, e.g. about a possible use of a session cookie to track the reading behavior of Wikipedia visitors or analysis of the geographical provenance of logged-in edits. Videos from the event were streamed live (wikitech-l mailing list) and recordings are expected to become available online. A day later, the FOSDEM conference in Belgium featured a talk by Tomasz Finc and Arthur Richards titled "Free Culture, Free Data - How we use Data to Drive at Wikipedia".
Discuss this story
I wouldn't exactly say that lots of major changes have been deployed out of cycle. There was (very very very roughly) about 109 fixes merged out of cycle (based on [1]. This doesn't count extensions. Including extensions there is about 500, Much of which was fundraiser related. The number of commits to the wmf branch only corresponds very roughly with how many changes merged out of cycle, so that number is probably quite debatable). Very few of these were new features (although a couple were. Most that were new features, were new features to support an extension), and most seem to be high priority bug fixes. There is still a lot of cool stuff in 1.17 that has not been previously deployed, as well as many many bug fixes (Everything from making special:mypage/common.js be a per-user js page that works on all skins, to making transcluding {{special:recentchanges}} work again, a new special page allowing you to get a diff between two different pages instead of just between revisions of the same page, and much more). Bawolff (talk)