• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

An Antic Disposition

  • Home
  • About
  • Archives
  • Writings
  • Links
You are here: Home / 2009 / Archives for June 2009

Archives for June 2009

How I think Wikipedia works

2009/06/30 By Rob 13 Comments

I have a mental model of how Wikipedia works and behaves. This may not reflect reality, but it is how I, as an end-user, expect Wikipedia to behave. I think these are reasonable expectations regarding things like standards of proof and balance and that if the real Wikipedia differs substantially from these expectations, then we have a problem.

Please let me know if my mental model differs from reality.

First, I assume that we deal with facts, not opinions. So an editor cannot state a personal opinion such as, “Citizen Kane is the greatest movie ever made”, since there is no objective, recognized scale for cinematic greatness.

However, saying, “Citizen Kane topped the list of ‘Greatest Films’ according to a 2002 poll of directors and film critics by Sight & Sound magazine” would be fine. It is a factual statement, albeit a statement about an opinion, but the factual portion of it is verifiable. It is a fact about an opinion and that is OK.

But if I made the statement, “Citizen Kane is the greatest movie ever made” and cited the Sight & Sound article, this would not be proper, since that article does not establish the fact of the greatest movie, but only the fact of a poll that collected opinions on the greatest movie. A fact about the existence of an opinion (or even a polled opinion) does not assert the truth of the opinion.

Similarly, a statement, “Gone with the Wind has been criticized for its long running time” would not be properly cited by merely referencing a source that states its length as 238 minutes. That citation would merely be evidence of its length, not that its length was inordinate. You need a citation for the length being criticized.

Similarly, if another recognized expert stated, “Gone with the Wind was too short and failed to cover the entire Mitchell novel”, then I would expect both opinions to be mentioned, not merely selecting an arbitrary opinion.

I also expect that cited sources have recognized (not merely self-declared) expertise in the area. So, I would find it idiosyncratic if an article on cinema said, “Citizen Kane is the greatest film ever made, according to a fan blog post by Joe Blow, a ophthalmologist in Podunk, Michigan”, since he would be a source cited outside any area of recognized expertise.

I also, as a user, expect Wikipedia to give a balanced view of issues. This does not mean equal time to all fringe opinions. Although I expect there to be multiple views presented on the propriety of the Iraq War, I would not expect that someone who believes that Abraham Lincoln was an alien from the planet Quthbral to have a section in the Lincoln article, even if he could cite a blog post or a photocopied article, or self-published book on the subject. Ditto for Flat Earth Society members, holocaust deniers and those who think the Apollo moon landing was filmed on a Hollywood sound stage.

On the other hand, I don’t expect that every fact requires a citation. For example as a user, I don’t expect to see citations whenever someone says “Mercury is the closest planet to the Sun”. Similarly, I would find it odd if someone removed that assertion for lack of a citation.

However, I would be suspicious if someone writes something in the form, “Mercury is the hottest planet because it is closest to the Sun”. Although the it is well known that Mercury is the closest planet, it does not follow that it is the hottest. In fact, Venus is the hottest planet. It is a subtle form of editorializing, where an editor can inadvertently introduce personal assumptions into an article. I’m assuming Wikipedia editors are on the watch for this kind of thing.

On the other hand, some things clearly logically follow from known facts. If we know that John Brown was buried on January 23rd, 1582, then we should, absent contrary evidence, safely be able to state that his date of death was on or before January 23rd, 1582. I would not expect someone to revert such a statement as being unfounded, speculation, original research, etc. It logically follows based on our knowledge of how the world works.

Does anyone know whether the above statements have any basis in the aspirations or actual practice of Wikipedia editors and admins? Sadly, my recent reading of some articles suggests that these reasonable expectations are routinely flouted and bear little resemblance to reality.

  • Tweet

Filed Under: Wikipedia

ODF Plugfest

2009/06/26 By Rob 14 Comments

Although the term may be alien to some, “plugfests” have been around for around 20 years. A plugfest is when implementors of the same interface get together and test the interoperability of their products. In the beginning this was done with wired standards, USB, etc. (thus ‘plug’). Over the years the term was applied to networking at all higher levels of the protocol stack. The concept is also applicable to document exchange formats like ODF.

We had an ODF Plugfest last week in the Hague. Although we’ve had interoperability workshops and camps before that attracted a handful of vendors, this was the first one that had nearly universal participation from ODF vendors. I’m not going to recap the details of the plugfest. Others have done that already. But I will share with you some of my conclusions, based on long discussions with other participants, from whose insights I have greatly benefited.

In an ideal world, specifications would be perfect and software applications would be bug-free and users would read the manuals and we would achieve perfect interoperability instantly by anointment of the salubrious unction of standardization. But to the extent this planet’s population obdurately persists in imperfection, we are resigned to make additional efforts in pursuit of interoperability. We are not alone in this regard. The only standards that don’t need to work on interoperability are those standards that no one implements.

We should use every licit technique at our disposal to give the user the best experience with ODF we can. In a competitive market you can not get away with telling your customer, “Sorry, your spreadsheet doesn’t work because page 652, clause 23 says ‘should’ rather than ‘shall'”. If you did that you would not have that customer for long. (Unless, of course, you have a monopoly, in which case many seemingly irrational, anti-consumer actions can occur, seemingly without consequences.)

Further, I assert:

  1. Users want real-world interoperability, and not excuses
  2. Real-world interoperability is what users see and achieve in practice
  3. Where vendors have the will to interoperate, achieving interoperability is a known technical problem, with known engineering solutions, but where the will to interoperate is lacking, there are no technical means of compelling interoperability
  4. Interoperability lies at the intersection of technology, engineering standards, competition law, intellectual property and economics. There are no silver bullets, although there are a arsenal of proven techniques that can help to improve interoperability
  5. Achieving interoperability is facilitated by a variety of cooperative activities, including standardization, test case creation, implementation testing, online validators, plugfests, defect collection and reporting

Going forward there is a promising constellation of efforts converging around ODF interoperability:

  • The OASIS ODF Interoperability and Conformance TC, charged with creating an ODF test suite
  • The OASIS ODF TC, finishing up work on ODF 1.2
  • OfficeShots.org, providing a way to test the interoperability of a document in many ODF editors
  • The ODF Toolkit Union, especially their open source ODF Validator
  • The Plugfest participants, who continue to add information and test scenarios to the plugfest’s wiki.
  • Groups such as OpenDoc Society and OpenForum Europe which lend their organizational skills and enthusiasm to the effort, and often much more.

So, we’re moving in the right direction. The key thing will be to sustain the momentum from the Plugfest and transition it into an ongoing effort, a Perpetual and Virtual Plugfest where the effort and the progress is continuous.

[6/29/09: I’ve received some emails on the photo, so here are the details:

The picture was taken at 3:30PM on the 2nd day of the workshop.

The lens was a Pentax DA 10-17mm “fisheye” zoom at 10mm. So that explains the projection distortion. The graininess and B&W was from post-processing using Nik Software’s Silver Efex Pro and Sharpener Pro.]

  • Tweet

Filed Under: ODF

ODF TC timeline

2009/06/23 By Rob 3 Comments

I used a variation of this chart at the recent ODF Plugfest in the Netherlands. But the aspect ratio of a presentation slide doesn’t suit this type of chart well, so here is a fuller version of what I showed there.

Those who are not familiar with standards development are sometimes amazed at how long it takes to develop a good standard. Perhaps the single-vendor, 6,000 page, 12-month escapade of OOXML in Ecma has skewed expectations. Fortunately, OOXML is the exception, not the rule. Achieving a multi-vendor consensus around a substantial technical standard will always be time-consuming, but it is time that is well spent.

OASIS standards go through several stages of development:

  1. Working Draft (WD)
  2. Committee Draft (CD)
  3. Public Review Draft
  4. Committee Specification
  5. OASIS Standard

Progressing from one step to another is by ballot. The first 4 stages are advanced by vote of the Technical Committee (TC), while the last stage (OASIS Standard) is by a ballot of all OASIS members. As a draft advances through stages 1-4, an increasing degree of consensus is required. So, a CD requires only simple majority, whereas a Committee Specification requires 2/3 approval, with no more than 1/4 disapproval. Some of these stages allow iteration. So we can, and typically do, have several WD’s and several CD’s.

If you want more detail on the nitty-gritty details, here is a flow chart of the OASIS standards approval process.

I occasionally get a question along the lines of: “What has the ODF TC been doing for the past couple of years?” The following timeline should give you an idea. I’ve indicated the time spent developing ODF 1.0 and ODF 1.1, along with some other milestone activities, such as the PAS transposition of ISO/IEC 26300, the publication of ODF 1.0 Approved Errata 01 and the creation of the various ODF subcommittees. I’ve also indicated the dates of each of the ODF 1.2 WD’s and CD’s.

As you can see, we’ve been quite busy. After iterating on WD’s during 2007 and 2008, we’ve now moved on to CD’s. This is not a drawn out process, but simply the ODF TC working with full transparency, making all of the intermediate drafts available for public inspection.

All of the planned feature work for ODF 1.2 is now completed. The remaining work is to address the various editorial and technical comments that have been submitted to our comment list, as well comments from TC members and JTC1/SC34. The goal is to have no known defects in ODF 1.2 before we send it out for a Public Review. Of course, previously-unknown defects will likely be identified during the Public Review, and we have a process for handling these. I’ll comment more on that process, and Public Reviews in general, when we get closer to that stage.

  • Tweet

Filed Under: ODF

ODF Lies and Whispers

2009/06/09 By Rob 21 Comments

There is an interesting disinformation campaign being waged against ODF. You won’t see this FUD splattered across the front pages of blogs or press releases. It is the kind of stuff that is spread by email and whispers, and you or I rarely will see it in the light of day. But occasionally some of it does cross my desk, and I’d like to share with you some recent examples.

First up is this instance, from a small Baltic republic, where a rather large US-based software company was recently arguing to the national standards committee for the adoption of OOXML instead of ODF. Here are some of the points made by this large company in a letter:

There is no software that currently implements ODF as approved by the ISO

(They then link to Alex Brown’s comment from Wikipedia). I think this demonstrates the triangle-trade relationship among Microsoft, Alex Brown (and other bloggers) and Wikipedia, by which Microsoft FUD is laundered via intermediaries to Wikipedia for later reference as newly minted “facts”. No wonder one of Microsoft’s first actions during their OOXML push was to seize control of the Wikipedia articles on ODF and OOXML via paid consultants. In any case, Alex’s claims were rebutted long ago.

ODF has a number (more than a hundred) of technical flaws which haven’t been addressed for 3 years despite change requests addressed to OASIS by countries such as Japan and United Kingdom. There are discussions between OASIS and ISO/IEC JTC 1 SC 34 regarding true ownership of ISO ODF, which is a reason why the flaws in ISO ODF aren’t being addressed. In a recent SC 34 meeting in Prague a new ISO ODF maintenance committee has been formed because ISO / IEC 26300: 2006 is not being presently maintained.

This is not true. First, the ODF TC has received zero defect reports from any ISO/IEC national body other than Japan. Second, we responded to the Japanese defect report last November. Amazingly, Alex Brown is implicated in this FUD one as well. It was false then and it is false now. At the exact time Alex was quoted in the press as saying the the ODF TC was not acting on defect reports (October 8th, 2008), we had in fact already sent our response to the defect report out to public review (August 7th, 2008) and then completed that reivew (August 22nd), after quite a bit of active technical discussion with the submitter of the original defect report (Murata Mokoto). How Alex translated that into “Their defect reports are being shelved” and “Oasis has not been acting on reports of defects” is beyond me. It must be particularly embarrassing that Murata-san wrote to the OASIS list, within days of Alex’s FUD, “I am happy with the way that the errata has been prepared.” How could Alex be ignorant of these facts? Why was he lying to the press? How is this conformant with his leadership role in JTC1/SC34 and his participation in BSI? Also observe the triangle-trade route of FUD in this case from Alex to Doug Mahugh to Wikipedia, this time for negative edits in the OASIS article.

IBM currently recommends not using OASIS ODF 1.1 and to instead use OASIS ODF 1.2 which is currently not complete and will not be complete and ISO certified before 2010/2011. OASIS on the other hand have started work on ODF 2.0 which will not be backwards compatible.

This is an odd one, demonstrably false. IBM Lotus Symphony supports ODF 1.1. We have no ODF 1.2 support at present. I wonder where they came up with this one? It is totally bizarre. Although we have started to gather requirements for “ODF-Next”, the contents of that version, and to what degree it will be backwards compatible, has not even been discussed by the TC, let alone determined. So this is pure FUD, trying to make ODF sound risky to adopt, and then lying about IBM’s support for it, and our position on ODF 1.2.

The list goes on, including claims that no one supports ODF 1.0 or ODF 1.1, etc., but you get the gist of it. The particulars are interesting, of course, but more so the reckless disregard for the truth, and the triangle-trade relationship between notable bloggers, Wikipedia, and Microsoft’s whisper campaign.

Another current example is part of Microsoft’s attempt to duck and cover from criticism over their interoperability-busting ODF support in Office 2007 SP2. I’ve heard variations on the following from three different people in three different countries, including from government officials. So it is getting around. It goes something like this:

We (Microsoft) wanted to be more interoperable with ODF. In fact we submitted 15 proposals to the ODF TC to improve interoperability, but IBM and Sun voted them down.

Nice story, but not true. Certainly Microsoft submitted 15 proposals. But they were never voted on by the TC, because Microsoft chose not to advance them for a vote. They opted not to have these proposals considered for ODF 1.2. It was their choice alone and their decision alone not to put these items up for a vote. I would have been fine with whatever decision Microsoft wanted to make in this situation. I’m not criticizing their decision. I’m just saying we need to be clear that the outcome was entirely due to their decision, and not to blame IBM or Sun for Microsoft’s choice in this matter.

I think I can trace this FUD back to a May 13th blog post from Doug Mahugh where he wrote:

We then continued submitting proposed solutions to specific interoperability issues, and by the time proposals for ODF 1.2 were cut off in December, we had submitted 15 proposals for consideration. The TC voted on what to include in version 1.2, and none of the proposals we had submitted made it into ODF 1.2.

This certainly is an interesting statement. There is nothing I can point to that is false here. Everything here is 100% accurate. However, it seems to be reckless in how it neglects the most relevant facts, namely that the proposals did not make it into ODF 1.2 at Microsoft’s sole election. It is as if Lee Harvey Oswald had written a note: “Went to Dallas and saw a parade today. Tried to see a movie, but had to leave early. Heard later on the radio that the President was shot”. This would have been 100% accurate as well, but not the “whole truth”. In any case, the rundown of the facts in this question are on the TC’s mailing list.

So what is one to do? You obviously can’t trust Wikipedia whatsoever in this area. This is unfortunate, since I am a big fan of Wikipedia. I want it to succeed. But since the day when Microsoft decided they needed to pay people to “improve” the ODF and OOXML articles, these articles have been a cesspool of FUD, spin and outright lies, seemingly manufactured for Microsoft’s re-use in their whisper campaign. My advice would be to seek out official information on the standards, from the relevant organizations, like OASIS, the chairs of the relevant committees, etc. Ask the questions in public places and seek a public, on-the-record response. More people are willing to lie than face the consequences of being caught lying. That is the ultimate weakness of lies. They cannot stand the light of public exposure. Sunlight is the best antiseptic.

  • Tweet

Filed Under: ODF

Primary Sidebar

Copyright © 2006-2023 Rob Weir · Site Policies