• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

An Antic Disposition

  • Home
  • About
  • Archives
  • Writings
  • Links
You are here: Home / 2008 / Archives for January 2008

Archives for January 2008

A Brief History of Open

2008/01/03 By Rob Leave a Comment

Circa 1700 BC, the Babylonian king Hammurabi ordered the laws of his kingdom be engraved on a black stone slab and displayed in the city center for all to see. This was mostly for show, since the number of people who could read Akkadian cuneiform were probably as small then as now. But the symbolism was clear: the Law is fixed (indeed carved in stone) and not improvised at the whim of the magistrate. Of course, the Law was not popularly determined, and certainly all were not treated equal, but still this was progress.

1215 A.D., along the Thames in Surrey, at the meadow called Runnymede, a group of English Barons joined their powers together to force their monarch, King John, to affix his seal to Magna Carta, establishing that even the King himself was bound by the Law.

Philadelphia, the hot summer of 1787, representatives from 12 of the 13 American states met in Convention, at first with the aim of enhancing their current loose affiliation, but eventually agreeing upon a much more ambitious Federal form of government in their proposed Constitution. This document was far from perfect and needed ten major additions before it was considered ready for use (thus the Bill of Rights). Over the next 200 years additional problems were detected and fixed (via further Amendments) according to an process that emphasized openness and participation of all concerned parties.

These of course are three examples of the progress of openness. All can be called “open” but they are not all of the same degree of “openness”.

For example, the Code of Hammurabi was open in a sense, since it was publicly documented for all to read. But this openness is of small consequence to the builder’s son who could be legally stoned to death if a house his father built collapsed and killed it’s owner’s son. The Code was “open” but still allowed crimes committed by one person to be judicially imputed onto another party.

Similarly, the U.S. Constitution was even more open, since it was publicly documented and also well-deliberated and formed as part of a consensus process. But it still allowed slavery and denied the majority of its population the right to vote.

At the risk of falling into a teleological argument that sees all of human history leading inexorably to modern America, it does seem that the general flow of history has been:

  1. A move from undocumented or improvised laws to laws that are fixed and publicly documented.
  2. A move from laws created by a single entity to laws formed as part of a deliberative, multilateral, consensual process.
  3. A move toward increasing inclusiveness as to whose interests are considered.

So we should never stop at a claim of “openness” and say that with the mere application of this label that all diligence has been performed. You need to ask yourself always, whose interests have been taken into account? All? Many? Few? One?

There seems to me to be a natural parallel here with the “open standard” moniker. Is it a single fixed and unitary concept that admits of no degrees? Or are there a wide range of standards which share the concept “open” to one degree or another? How thinly can the concept be diluted? Can it be homeopathically prepared, with one drop enough to inoculate gallons?

I think the key is to move away from the mere consideration of the process of standardization and to also consider the content of the standard. Just as a Constitution that held that women could not vote was far from open, even though it was drafted in an open committee process, a standard that does not facilitate use by competitors is not open, regardless of the process that created it. We need to move beyond strictly process-oriented definitions of openness and bring in considerations of content and results. A standard can be per-se non-open if its content violates important principles of openness.

Filed Under: Standards

The Piemen of Erie

2008/01/02 By Rob 13 Comments

An interesting historical anecdote to relate, from our nation’s industrial adolescence, a tale with relevance today when we discuss standards.

The year was 1853 and the place was Erie, Pennsylvania, a town at the junction of two incompatible rail gauges. This gauge incompatibility was inefficient and frustrating, but the citizens of Erie loved it, and resisted every attempt to join the emerging common standard gauge in what would be called the Erie Gauge Wars. Why? Let’s find out more in the words of industrialist and historian James Ford Rhodes from a passage quoted in extenso from his 1895 History of the United States from the Compromise of 1850 to the McKinley-Bryan Campaign of 1896 (Vol III Pages 18-23). I will follow this by some additional thoughts.

For the prosperity of 1846-57 there were several contributing causes, either special to that period, or then for the first time effective. The greatest of these (whose influence, continuing with ever-increasing momentum to our own day, is still transcendent, and will pervade the future to a degree to which no philosopher can now set bounds) were railroad transportation, beginning its first great era, and the coming into general use of the electric telegraph. We may mark the year 1849 as the commencement of railroad extension. Having less than 6,000 miles January 1, 1849, the country had at the end of 1860 30,635 miles. In 1850 it was impossible to go by direct railway from New York to either Albany or Boston; in 1860 New York had continuous lines reaching beyond the Mississippi. In 1850 Chicago had one short road; in 1860 that city was a great railroad center, her main lines “reaching hundreds of miles — east, west, north, south. In 1850, Ohio, Indiana, and Illinois were open fields; in 1860 they were crossed and recrossed many times.” “I arrived here last night,” wrote Emerson from Pittsburgh in 1851, “after a very tedious and disagreeable journey from Philadelphia, by railway and canal, with little food and less sleep; two nights being spent in the rail-cars, and the third on the floor of a canal-boat.” Not until the end of 1860 did the railway system between the East and the West approach unification and give promise of that consolidation of separate railroads and branches into systems which in our own day has characterized this development.

The primitive ideas in regard to railway travel prevailing in the decade of 1850-60, are well illustrated by what was then known as the Erie Railroad War. The traveler who goes from New York to Chicago in our day is not obliged to set foot from his train, for he is provided with the comforts and conveniences of a hotel. Far different was it in 1853. The traveler could, indeed, then go from New York to Albany in four hours; but there he must change to another road and another train which carried him from Albany to Buffalo, and he esteemed himself fortunate to be able to cover so great a distance in the same car. If he made the western connection at Buffalo it was considered good-luck. The tales of those days are full of complaints of trains behind time, of connections missed, of tedious delays. From Buffalo the traveler had a short run to the station on the line between New York and Pennsylvania, called State Line, where, on account of a difference in gauge, a transfer was necessary. On the broader gauge he could travel twenty miles to Erie, Pa., when he must change again to a road of the Ohio gauge. The train on this railroad carried him to Cleveland; but on the way, if at all late, he was subject again to the anxiety of missing connections. At Cleveland he must hurry to the river, where a scow, carrying at most a dozen passengers and sculled by a weather-beaten mariner, was used as a ferry to take passengers to the Toledo railroad station. In this open boat travelers suffered from exposure to rain and snow; at times the waves ran high and the crossing was attended with danger. If the eastern train was crowded or a few minutes late, haste was necessary to secure passage in the first trip of the scow, for it was well known that the Toledo train started on schedule time and waited for neither train nor boat. At Toledo the traveler made the last change, and — if not more than five minutes behind time — found the Michigan Southern train awaiting him; otherwise he had a tedious delay, which, if his arrival at Toledo happened on a Saturday, might extend to thirty-six hours. The traveler from New York who missed no connections and arrived at Chicago on time had a marvelous story to tell.

The railroad managers of the lines between Buffalo and Erie, eager to improve their route, decided to alter the six-foot gauge of the railway between State Line and Erie to four feet ten inches — the gauge of the roads east of State Line and west of Erie — so that passengers could go from Buffalo to Cleveland without change. The railroad ran a distance through the streets of Erie. The Erie municipal authorities refused to give a permit for making the alteration unless the railway company would agree to stipulations to which its directors, considering them unreasonable, declined to accede. In the contest which followed, a color of law and reason was given to the position taken by Erie; but no one was deceived as to the real ground of the trouble. Erie objected to the change of gauge because the transfer of passengers and freight was deemed important to the borough’s prosperity. The wait involved brought custom to her eating-houses; the transfer of freight and live-stock gave work to her people. The populace ignored the legal points and the pretended grounds of demur, but they keenly appreciated the vital objection.

On December 7, 1853, the railroad company began at State Line the work of changing the gauge. The news came quickly to Erie. A cannon was fired to call out the citizens. A large mob assembled, tore up the track, and cut down the railroad bridge in the borough. The infection spread to Harbor Creek, a Pennsylvania town seven miles east of Erie, and that evening its citizens held an orderly meeting and resolved to remove the track of the railroad running on the public highway. The resolution was the next day carried into effect. Two days later (December 10) the track of the new gauge was completed to the borough limits of Erie. That night rioters at Harbor Creek tore up the track, destroyed the bridge, and ploughed up part of the grade of the road. War had begun in earnest. The mayor and the sheriff at times directed the mob, while the local militia, arrayed for service, swelled its number. Even the governor of the commonwealth seemed to sympathize with the Erie people. Certainly they had the sentiment of the whole of Pennsylvania on their side. The United States Circuit Court then granted an injunction restraining all persons from interfering with the railroad company. An Erie justice of the peace pronounced the injunction null and void, and the populace, believing the later decision to be the better law, refused to respect the order of the court. Two days after Christmas, the Harbor Creek bridge was torn down for the fourth time.

The contest attracted the attention of the country. In Buffalo the excitement was intense. Cincinnati held an indignation meeting presided over by Thomas Corwin, to protest against the conduct of the Erie citizens. The New York Tribune said: “Let Erie be avoided by all travelers until grass shall grow in her streets, and till her piemen in despair shall move away to some other city.” The press of Philadelphia espoused the cause of Erie. The City of Brotherly Love held a large public meeting to express sympathy with the borough at the other end of the commonwealth. It was declared that “the only protection Erie has to prevent her own ruin is to require the break to be made within her boundaries.”

About this time Horace Greeley had occasion to go West. He wrote to his newspaper that he was obliged to ride the seven miles from Harbor Creek to Erie in an open sleigh “through a cutting storm of wind, snow, and sleet…. Let Erie have her way,” he continued,” and all passengers and freight must change cars before her pie-shops…. The whole world is to be taxed, as in the days of Caesar Augustus, in order that Erie may clutch a sixpence for every dollar of expense she imposes on others. Is it strange that so mean and selfish an exaction should be enforced by mobs, arson, devastation, and ostentatious defiance of judicial mandates?”

With the new year the excitement grew. The Erie people became vindictive. They warned the president and director of the railroad company, living at Erie, to leave the borough. Women joined the rioters and assisted in the work of destruction of the bridges. The New York Tribune called upon President Pierce to interfere, and suggested that he issue a proclamation and call out troops in order that the laws might be executed. “Had a runaway negro,” this journal said, “been somehow mixed up with the matter, we should have had half of the United States army in Erie a month ago.” The trouble brought into view the rivalry between New York and Philadelphia, between New York State and Pennsylvania. The Commonwealth of Pennsylvania was declared an accomplice with the Erie rioters and bridge-burners, for the purpose of diverting business from the West to the seaboard through her territory and to her port by a projected line from Erie to Philadelphia, and an appeal was made to the West to frustrate her purpose. It is possible that the sentiment of the West had some influence in bringing about a settlement; but in the early part of January, 1854, the minds of Northern men became engrossed with the proposed repeal of the Missouri Compromise, and the Erie war ceased to attract attention. An act of the Pennsylvania legislature, by a fair compromise, brought the trouble to an end. The railroad company, having consented to confer certain desired advantages upon Erie and Pennsylvania, was allowed to complete the change of gauge and run its trains through Erie without molestation.

So, what do we have here? Two, incompatible standards meet in Erie. Maintaining the two standards is wasteful, inefficient and expensive to the railroad owners, and causes great inconvenience to the travelers who pass through Erie. Everyone knows this. However, the shopkeepers and laborers of Erie benefit from directly from these circumstances. This situation is common. We don’t all benefit from the same things. Some people benefit from other people’s misfortune. War is good for arms dealers. Hurricanes are good for the glazier. Tuberculosis is good for the undertakers. And two incompatible rail gauges are good for those whose livelihood depends on jobs manually loading and unloading goods at the junction, or providing refreshments to those who must wait for connecting trains. In any change, there are winners and losers, those who benefit from maintaining the status quo, no matter how inefficient it is, and those who will benefit from change.

So what do you do? Choose a commercial interest? Line up behind either the rail barons or the teamsters? Not necessarily. In the end the competing commercial interests don’t amount to a hill of beans compared to the interests of the travelers, the consumers and the public at large. They are the ones who were absorbing the cost of maintaining two rail gauges, in shipping costs and frustration, and they are the ones who benefited from the convergence on a single standard. Sure there were two commercial interests vying for supremacy, but there was also a choice that was clearly better for the public.

So whenever anyone tells you that two office document format standards is a good idea, that plugins and convertors can deal with shuffling data back and forth between two formats, ask yourself some basic questions:

  1. Who benefits from having two standards? Who are the “pieman of Erie” that will make money off of the inefficiency that results?
  2. Who has the most to lose if Erie becomes just another railroad town, one of many?
  3. How far will the piemen of Erie go to protect their monopoly? What technological advances and innovations will they prevent or actively destroy in order to preserve their exclusive access to their customers?
  4. And most important, what about the interests of the public at large? What is good policy?

If Microsoft were fighting the Erie Gauge War, they would portray it as a fight between the good townspeople of Erie and the rail barons. The big bad mean old rail barons are forcing their single gauge standard on people who don’t want it. Why not give them the choice of gauges? Only the old broad gauge is 100% backwards compatible with the cars that were designed for it. In fact legislation should be passed for force all railroad towns to support both gauges so everyone can have the choice. Piemen of the word, unite !

That is the distortion you get if you look at a standards war through the narrow blinders of commercial interest. But if you look at the full market impact, the simple economics of it, it becomes a lot clearer. What brings greater efficiency, greater fidelity, greater innovation and lower costs? Having two incompatible document format standards? Or having a single harmonized document format standard? Fighting against economics is like fighting against gravity or the 2nd Law of Thermodynamics. You are going to lose in the end. The piemen of Erie, and their modern counterparts, are on the wrong side of economics, and history,

Filed Under: Standards

Legacy format FUD

2008/01/02 By Rob 17 Comments

From CyberTech Rambler (and Slashdot) comes the news that the Office 2003 Service Pack #3 disables (blocks) access to a number of legacy document formats. Details are in this MS support article. Formats so blocked include legacy Lotus 1-2-3 and Corel Quattro Pro formats. Why? According to the Microsoft support article, “By default, these file formats are blocked because they are less secure. They may pose a risk to you.”.

Interesting. Well, let’s look at the record. If we query the CERT vulnerability database for “WK1”, “WK3”, “WK4”, etc., how many reported vulnerabilities do we see? Zero. Nothing.

But search the same database for “XLS” and what do we see? Eleven reported vulnerabilities:

ID Date
Public
Name
VU#493185 01/09/2007 Microsoft Excel vulnerable to arbitrary code execution via malformed record
VU#176556 10/10/2006 Microsoft Office fails to properly parse malformed records
VU#807780 10/10/2006 Microsoft Office fails to properly parse malformed Smart Tags
VU#194944 03/07/2007 Microsoft Windows fails to properly handle malformed OLE documents
VU#234900 10/10/2006 Microsoft Office fails to properly parse malformed strings
VU#534276 10/10/2006 Microsoft Office fails to properly parse malformed chart records
VU#613740 02/02/2007 Microsoft Excel memory access vulnerability
VU#706668 10/10/2006 Microsoft Excel fails to properly process malformed DATETIME records
VU#252500 10/10/2006 Microsoft Excel fails to properly process malformed COLINFO records
VU#143292 07/03/2006 Microsoft Excel fails to properly process malformed STYLE records
VU#802324 06/16/2006 Microsoft Excel vulnerability

Hmm… I’m so glad they disabled access to the risky formats.

And what about the Data Interchange Format (DIF), the text based format for exchanging data between spreadsheets. As well as being text-based and easy to parse, DIF doesn’t allow any active code (scripts, macros) at all. Where is the security risk there, real or perceived? By what stretch of the imagination can Microsoft say, “…these file formats are blocked because they are less secure. They may pose a risk to you.”

Now it may be entirely possible that these old import filters in Excel are poorly written and poorly maintained and that Microsoft may be trying to reduce the overall security exposure of MS Office by ditching old code that is not strategic for them. But call it that. The MS Office code has the problem. Don’t malign the formats. Don’t make up some untenable story that DIF format is “less secure” and “may pose a risk for you”.

Filed Under: Office

  • « Go to Previous Page
  • Go to page 1
  • Go to page 2

Primary Sidebar

Copyright © 2006-2023 Rob Weir · Site Policies