• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

An Antic Disposition

  • Home
  • About
  • Archives
  • Writings
  • Links
You are here: Home / Archives for 2010

Archives for 2010

How to Crush Dissent

2010/08/15 By Rob 26 Comments

While in Berlin for the LinuxTag 2010 conference a couple of months ago, I took the opportunity for a 8-mile long meandering walk across the city, from Warschauer Strasse and the East Side Gallery to Wittenbergplatz and KaDeWe, taking in the various historical sites along the way.  It was a great refresher course in 20th century European history.  I especially enjoyed the free outdoor exhibit in Alexanderplatz, which dealt with the Revolutions of 1989 with a focus on the various dissident movements and publications in the DDR.  Most were self-published, stealthily distributed samizdat newletters, copied laboriously using  typewriters and carbon paper, primitive printing presses, or toward the end, some personal computers smuggled in from the West.  They had on display an Amiga 500 and an NEC Pinwriter P6 used in 1989.  Through “advanced” technology like this, document production could be raised from a few hundred to tens of thousands of copies.

As I looked at this display of samizdat publications, each a sign of struggle, technical and political,  I was smug.   Surely, all of this is irrelevant today?  The march of technology has now put within each of our hands tools that are orders of magnitude more efficient and effective than any underground publication of 1989.  With the Web, and WordPress and Twitter and YouTube and other services, we can instantly get a message out to millions of people.  We are far more advanced now.

Or so I thought for a few brief minutes, until the horrible truth struck me as I considered the question more deeply.  No, technology has not made dissent safer.  We are merely fortunate that the political climes of 2010 permit more dissent.  But if challenged, the powers that be have far greater tools to control information than they did in 1989.  I am not certain the tools available to the individual come close to being able to withstand them.

I strongly believe that the capability for citizens to dissent is an essential complement to fallible leadership. And all leadership is fallible.  Without such capabilities, transitions of power may be less frequent, but they also may be far bloodier.

Note that I say “capability” for dissent.  I don’t mean that all forms of dissent should be legal.  Certainly this is a good thing as well, and is enshrined in the constitutions of many democracies today.  But I mean something more fundamental, the capability of individuals and groups to organize and express dissent, even when this goes against the law. It is almost axiomatic that a regime slouching toward oppression will, at an early stage, declare dissent illegal.  History has shown this to us repeatedly.  So the capability to express illegal dissent is in some sense even more important than the ability to express dissent legally.

Through the 20th century there were many attempts to reduce capabilities to express dissent, from outlawing of opposition political parties, to shuttering independent newspapers, to mandatory registration of typewriters.  These all made dissent more difficult and riskier, but they did not remove the capability.  It was still possible, for one person, or a group of people, to organize in secret and get their message out.  They did it illegally, and at their own peril.  But that was enough to start the wheels turning.  If 10 people protest, they are called insane and carted away to the hospital.  If 1,000 people protest, tear gas is used and people are sent to prison,  But if 100,000 protest, then governments fall.  In a sense the gamut from civil war to an open democratic election, including a nationwide protest someplace in the middle, are all proxies for the use of force.  There are bloody and bloodless ways of determining the majority opinion, and prudence suggests not eliminating the opportunity to use bloodless methods.

My sad observation is that we are quickly reaching the point, perhaps for the first time in history, where governments will have the means to eliminate even the capability for illegal dissent.  I believe this is a destabilizing threshold to cross.

Consider the following thought experiment.   Imagine we are back in 1985, back in the DDR, but instead of typewriters, you have all the 21st century technological facilities, the internet, Twitter, Youtube, etc.  You are a dissident and I am the government.

Your two main tasks are:

  • To collaborate electronically with trusted parties, while protecting the contents of the communication, as well as the identities of the other parties.
  • To publish  information anonymously or pseudonymously for public consumption

You wouldn’t be much of a dissident leader if you didn’t attempt those two tasks, and I wouldn’t be much of an oppressive regime if I did not try to stop you!

So where should I start?

  1. A private national network.  Think North Korea.
  2. A Great Firewall.
  3. Mandatory registration of computers, internet accounts
  4. Control of DNS
  5. Control of search
  6. Control of Certificate Authorities
  7. Invisible tagging of paper/ink
  8. Software monoculture that provides a single point of government control
  9. Limits on how many emails can be sent.  One might argue in favor of this as an anti-spam measure.  But also prevents effective organization.
  10. Outlaw strong cryptography.
  11. Reduce due process, making it trivial to subpoena ISP records without judicial review
  12. Make circumvention technology illegal
  13. Copyright — prevent fair use, Creative Commons, etc., extending copyright to government records

The interesting thing is how far we’ve gone down this road, especially at the behest of the recording industry and the copyright lobby.

What capabilities do you have on the other side?  What are your abilities to express dissent?

I think the example of Wikileaks quickly comes to mind.  That shows one example of a web site, that through technical and jurisdictional means, appears to have avoided take-down by a far more powerful entity, at least so far.  However, I think this is a Pyrrhic victory.  The mere existence of Wikileaks will spur governments to tighten laws, invest in additional counter-information technologies, such as the Internet “Kill Switch” proposed by the Department of Homeland Security in the U.S., etc..  The presence of a presently uncontrollable voice will surely lead to a concentration of control of the choke points of the internet that will eventually silence that voice.

When an irrepressible force meets an immovable object, one may speculate which will win.  I put my bets on the side with the money and the guns.  The danger for the rest of us is that in their attempts to control a venue for indiscriminate, absolute free speech, they devise such choke points that they provide the ability for future regimes to crush dissent, and by eliminating dissent also eliminate the best opportunity we have for peaceful revolutions.

Of course, I do not advocate sedition.  And I’m not an advocate of absolute free speech.  There are copyright laws, there are privacy concerns, there are military secrets, there is child pornography.   These all trump free speech.  But I think that means that we make these activities illegal and vigorously prosecute those who break these laws.  But we should be seeking the minimal technical means necessary to detect the violators, without introducing such technologies that, to the level of a mathematical certainty, eliminate the ability for these activities to take place.  Because, if we do so, we also at the same time introduce mechanisms that can be also used to crush political dissent.  These technologies may first be promoted under the banner of “national security” or “protection of intellectual property”, but that is just their purported intent, not their technological limitation.

One would need to be a rather poor student of history not to notice that for several times in the past century governments have occasionally lapsed and ended up a wee bit overzealous in their attempts to secure a high degree of visible consensus among their citizens.  When this happen, it is good to have several avenues to pursue honest and forthright discourse.  Certainly one doesn’t want to make it too easy to topple an established form of government, but neither does one want to make it mathematically impossible.  You want to bias the balance of rights toward stability, while acknowledging that the forces of revolution are forces of construction as well as destruction. We have 400 years or more of experience balancing free speech with legitimate needs of governments to declare some speech illegal.  To date this has been done without the concentration of technical and administrative control sufficient to effect absolute prior restraint.  This is changing.  The unintended consequences of having such concentrated control should give us pause and make us hesitate rather than move quickly.  The creation of the equivalent of an anti-free speech nuclear bomb, a big red button that when pressed will silence a class of speech, must be avoided.

Filed Under: Cyber Freedom, Popular Posts

Weekly Links #16

2010/08/14 By Rob Leave a Comment

  • VML is baack… – Aspose.Words Product Family – Blogs

    “But the interesting thing that we came across is that ISO 29500 allows extensions and Microsoft did not waste any time by implementing something that is known as [MS-ODRAWXML]: Office Drawing Extensions to Office Open XML Structure Specification. This document basically puts VML back into ISO 29500 Strict documents via the standard extension mechanism.”

    tags: OOXML

  • MATLAB Central – File detail – Read Open Document Format Spreadsheet (.ods)

    MatLab routine that calls into ODFDOM to load data from an ODF spreadsheet

    tags: ODF ODFDOM

  • odt2braille brings Braille to OpenOffice.org – The H Open Source: News and Features

    “The release of odt2braille by the Belgian university Katholieke Universiteit Leuven, has brought the ability to work with Braille to OpenOffice.org. The extension adds a “Braille” menu to OpenOffice.org’s Writer which allows users to translate documents into Braille formats such as .brf or .pef or send the content to Braille printers for embossing. The development was supported by the EU funded AEGIS project.”

    tags: ODF

Posted from Diigo. The rest of my favorite links are here.

Filed Under: Weekly Links

Weekly Links #15

2010/07/31 By Rob Leave a Comment

  • odf-report – GitHub

    “Gem for generating .odt files by making strings, images, tables and sections replacements in a previously created .odt file.”

    tags: ODF

  • My Personal Blog: ODF Become National Format?

    “What a surprising news. ODF will soon become a mandatory format for all government documents. I have posted this since a year ago and two years ago, but finally it will come true. Right now, the Indonesian government is trying to migrate all computers in the governmental level to use Open Source to reduce it’s spending just to buy licenses for Windows and many other Microsoft products (mostly Microsoft Office). When that target has been completed (estimated 2011), they will follow with standarizing the national format to use ODF.”

    tags: ODF

  • Phase relationships in the standardization process

    tags: standards

  • 1’s and 0’s – The Daily WTF

    Reminds me of OOXML’s Bits.  Bad idea then and now.

    tags: ooxml

Posted from Diigo. The rest of my favorite links are here.

Filed Under: Weekly Links

ODF 1.2 Word Clouds

2010/07/29 By Rob 3 Comments

I’ve been playing around today with a preview build of the ODF Java API ODFDOM 0.9.   One of the capabilities we’re adding is a simple text extraction API.

The idea is to have a very simple API, a single function call in fact, that will allow you to extract the plain text from an ODF document.  So strip all formatting, all layout and just return the text.  At first you might think this is rather useless, but further reflection shows that it has myriad uses, including accessibility, search indexing, collaborative filtering, and text analytics in general.

Extracting text from ODF is pretty simple.  There are a handful of special cases to watch out for.  One example is a single word that has mixed styles, e.g.: ODFDOM.  In ODF this looks like:

<text:span text:style-name="style1">ODF</text:span>
<text:span text:style-name="style2">DOM</text:span>

We want text extraction to come out as “ODFDOM” not “ODF DOM” with a space.

On the other hand, there are other examples of adjacent elements, like with footnote citations, where we need to insert a space to prevent two adjacent strings from being conflated.

Overall, the build I used looks pretty good, and works the same across text, spreadsheets and presentations.

So I was looking this afternoon for something I could use to demo this new capability.  I thought of using Jonathan Feinberg’s  excellent Wordle applet (which I wrote about a while back).  This applet creates a word cloud, based on word frequency of text you feed it.  As a torture test I decided to feed it the text of  ODF 1.2 Committee Draft 05, the version that is currently out for public review.

This is what I got for results.

Part 1 is the annotations the schema for ODF.  As expected, the key words are those referring to XML markup concepts like “attribute” and “element”:

Part 2: is OpenFormula, the spreadsheet formula express language.  No XML in this part.  In fact, this looks more like what I’d expect from an excerpt from a programming language specification, which pretty much what OpenFormula is.

And Part 3 is the packaging specification.

In the end text extraction is just the data preparation step.  The real fun happens after,  with the analysis and visualization techniques that can be applied to the text once extracted.

If anyone is interested in trying out the text extraction module, please let me know.   We’re aiming for a release of ODF 0.9 toward the end of August, but I can probably get you a preview, if you are interested in testing.   And let me know if you have any brilliant ideas of what to do with the extracted text.  I’m always looking for good demo material.

Filed Under: ODF

The value of restricting choice

2010/07/27 By Rob 8 Comments

The language game

Microsoft’s talking points go something like this (summarized in my words):

If you adopt ODF instead of OOXML then you “restrict choice”.  Why would you want to do that?  You’re in favor of openness and competition, right?  So naturally, you should favor choice.

You can see a hundreds of variations on this theme, in Microsoft press releases, whitepapers,  in press articles and blogged by astroturfers, by searching Google for “ODF restrict choice“.

This argument is quite effective, since it is plausible at first glance, and takes more than 15 seconds to refute.  But the argument in the end fails by taking a very superficial view of “choice”, relying merely on the positive allure of its name, essentially using it as a talisman.  But “choice” is more than just a pretty word.  It means something.  And if we dig a little deeper, at what the value of choice really is, the Microsoft argument falls apart.

So let’s make an attempt to show how can one be in favor of choice, but also be in favor of eliminating choice.  Let’s resolve the paradox.  Personally I think this argument is too long, but maybe it will prompt someone to formulate it in a briefer form.

Choice — the option to act

Choice is the option to act on one more possibilities.  Choice is the freedom to take one path or another.  Choice is the ability to open one door or another.  And what is the value of choice?  It depends on the value of the underlying possibilities.

In some cases, the value of choice can be valued quite precisely.

For example, imagine I have three boxes, one containing nothing, one containing $5 and another containing $10.  If you have no choice, and are given one  box at random, then you will get $5 on average.   And if given the choice of which box to pick, also without knowing the contents, you will also get $5 on average.

Similarly, if each box contained exactly $5 and you could see inside, the value of choice would still be zero.

But if the three boxes contained nothing, $5 and $10 and you could see inside, then the value of having a choice is clear.  You would naturally pick the $10 box.  So having a choice is worth an additional $5.

So we see that for choice to have value, you must have two things:

  1. A way to estimate the value of outcome over another.
  2. A preference for one outcome over another

In some cases this can be done with precision.  In other cases it can only be estimated or modeled. For example, trading stock options is essentially the selling and buying of the right to exercise the choice (option) to buy or sell a security at a given price within a given time period.  The value of this choice can be modeled by sophisticated mathematical models like the Black-Scholes option pricing formula.

Eliminating choice

So going back to the  boxes again.  Now imagine one has $10 in it, and the other has a note in it that requires that you pay me $10.  You can see the contents of each box.  Which one do you choose?  It should be obvious, you pick the one with $10 in it.

But what if I say you are not limited to picking only one box.  You can pick either box, or both boxes if you wish.  You have absolute freedom to choose A, B or A+B.  What do you do?  Of course, you still pick the box with $10 in it.

But doesn’t that eliminate choice?  Yes, of course it did.  But the value of choice was only derived from the value of the underlying outcomes.  By choosing, I’ve derived the full value of having a choice.  Since if one choice is clearly more favorable than others (it “dominates” the others) then the alternatives should be discarded.

Resolving the paradox of the choice

Give the choice of A, B or A+B, each are distinct, mutually exclusive choices.  They are the three boxes with three outcomes.  Each one has a value that could be estimated.  When someone portrays option A+B as preserving choice, they are forgetting that this is a choice that also restricts choice, since it eliminates A or B in their exclusive, pure forms from consideration.  Any choice, even the choice of A+B, restricts choice.   If you choose A+B then you have not chosen A alone or B alone.  You have the value of the outcome A+B, but do not have the possibly greater benefits of picking choice A alone or choice B alone.

Clear?  I think this should be obvious, but I’ve seen these concepts cause much confusion.

It is also important to realize that the combination A+B may have conjoint effects, which may be neutral, synergistic or antagonistic.  In other words the value of A+B is not necessarily the same as the value of A plus the value of B.

In some cases, certainly, the value of the A+B choice is the same as the sum of each individual values. For example, the boxes with money and notes, these are all simply additive, with no conjoint effects.

But in other cases, the value of A+B has synergistic effects.   For example, the choice of diet+exercise is more salubrious that either one chosen in isolation.

And in some cases the value of A+B is less than the value either one in isolation, as anyone who has bought both a cat and a dog knows.  These choices are antagonistic.

So back to the file format debate.  The choice here is between adopting ODF, OOXML, or ODF+OOXML.  These three choice are mutually exclusive.  They are the three boxes,  with three different outcomes.  Each outcome has a value that could be estimated.  But we should not fall into the trap of thinking that an ODF+OOXML decision is preserving choice.  Far from it.  By making that choice, one eliminates the possibility of having only ODF, or of having only OOXML, with the resulting values that those choices would bring.  Choosing both formats eliminates outcomes and restricts choice just has much as choosing only ODF eliminates outcomes.

You cannot avoid eliminating the outcomes you do not choose.  There are benefits that would come from having only a single standard, and there are costs and complications from maintaining multiple standards.  These must all be considered.

Filed Under: ODF, OOXML

  • « Go to Previous Page
  • Page 1
  • Interim pages omitted …
  • Page 3
  • Page 4
  • Page 5
  • Page 6
  • Page 7
  • Interim pages omitted …
  • Page 13
  • Go to Next Page »

Primary Sidebar

Copyright © 2006-2026 Rob Weir · Site Policies