Notes on Document Conformance and Portability #2

by Alex Brown 7. May 2009 10:42

There has been quite a lot of heat (and rather less light) in the blogosphere lately on the topic of document conformance, and – in particular – on the topic of whether Microsoft’s newly released Service Pack for their Office suite is conformant to the Open Document Format (ODF).

Conformance is, in reality, a complex topic. When we are considering the conformance of an office application there are really two distinct types of conformance at issue:

  • Document conformance
  • Application conformance

Simply put, document conformance is an assessment of whether the documents emitted by an application are as the specification says they must be; application conformance is an assessment of whether an application does what the specification says it must.

In the overheated blogs, one can find many pronouncements about what might (or might not) be conformant, but disappointingly few informed readings of what the ODF specification actually states about conformance. Curious readers might what to investigate further and decide for themselves …

There Are No Rules

The specification to consult is Open Document Format for Office Applications (OpenDocument) v1.1, specifically section 1.5 on “Document Processing and Conformance”. From this we learn various things about validity and foreign elements, and the section closes with these words:

There are no rules regarding the elements and attributes that actually have to be supported by conforming applications, except that applications should not use foreign elements and attributes for features defined in the OpenDocument schema.

It is not necessary to re-word or interpret what is written here – the meaning is plainly stated in exactly the place we’d expect to find it. Consequently we can confidently describe ODF as a very liberal specification indeed, and know it is very hard for an application to be non-conformant, so long as its document processing behaviour passes the technical XML validation and namespace tests stated earlier in this conformance section.

So while issues of document portability and application interoperability may well be worth discussing, I cannot see from this reading of ODF 1.1 how a discussion of application conformance is relevant to the new service pack from Microsoft.

Personally, I believe this conformance statement in ODF 1.1 is badly misconceived, and I am glad that the conformance requirements of the ODF 1.2 draft have been beefed-up – even though applications are still free to omit support for features of the specification and still claim full conformance. The “application description” feature in OOXML gets it right, I think, by introducing the concept of defined feature sets which conformant applications can claim to support (or not).

Going Beyond the Spec

Document conformance and portability is a problem for ODF, as it is for any similar specification, and in recognition of this OASIS has wisely created the OASIS Open Document Format Interoperability and Conformance (OIC) TC who are busy working on the wider issues of conformance than those envisaged within ODF itself. This work is very important and I am very happy to see it underway.

OOXML needs to have a parallel activity, as its specification too will not, on its own, be sufficient to guarantee the degree of document portability or application interoperability that users rightly demand. This is a theme I hope to return to in coming blog entries over the next couple of weeks …

Comments

5/7/2009 6:32:30 PM #

anonymous-insider

Off Topic

It seems someone has been trying to find a conspiracy connection:

www.investorvillage.com/smbd.asp

anonymous-insider United States |

5/7/2009 6:43:20 PM #

Alex

Truly we Illuminati have been rumbled!

Luckily they didn't find out about Kevin Bacon ...

Alex United Kingdom |

5/7/2009 7:05:43 PM #

anonymous-insider

Let me bring back an important issue...

**********************************************

Apple v. EFF: The iPhone Jailbreaking Showdown

By David Kravets May 2, 2009 http://www.wired.com

PALO ALTO, California – To jailbreak or not to jailbreak the iPhone.

That was the heated topic of discussion late Friday between Apple’s iPhone marketing czar Greg Joswiak, Fred von Lohmann, the Electronic Frontier Foundation’s copyright genius, Copyright Office officials including registrar Marybeth Peters, the record labels, movie studios and software industry.

Apple vigorously opposed authorizing jailbreaking, saying copyright protections is what gave birth to the iPhone, the 1 billion app sales, 50,000 app developers and 35,000 apps. The EFF vigorously urged the Copyright Office to authorize jailbreaking, which in this case is hacking the phone’s OS, and hence allowing consumers to run any app on the phone they want, including those not authorized by Apple.

“It is my automobile at the end of the day,” von Lohmann said, a reference that iPhone users should be allowed to do what they want with their phones, just like car owners do.

At stake for Apple is the very closed business model Apple has enjoyed since 2007, when the iPhone debuted. More than 30 million have been sold so far. “This would severely limit our ability to continue what we are doing as well as innovate for the future,” Joswiak said.


The panelists squared off here as part of the Copyright Office’s three-year review on whether to grant exemptions to the Digital Millennium Copyright Act of 1998. The act forbids circumventing encryption technology to copy or modify copyrighted works – in this instance encryption protecting the bootloader connected to the OS operating system itself.

Neither Peters nor the three Copyright Office attorneys at the three-hour hearing here tipped their hats on whether they would recommend the librarian of Congress to grant the exemption, a decision expected later this year. Still, the changeover seemed unlikely as the Copyright Office has repeatedly denied consumer-friendly oriented fair use changes, such as requests to make up backup copies of DVDs or video games, as well as requests for exemptions to enable copying DVDs to laptops and portable devices.

Despite the iPhone’s popularity, about three-dozen people attended the marathon, three-hour jailbreaking hearing here at Stanford University. The hearing came just months before Apple releases its OS 3.0, its latest operating iPhone system. There is an estimated 1 million-plus jailbroken iPhones, von Lohmann said.

Apple said jailbreaking would amount to such a major modification – for example with apps turning the iPhone into a WiFi center — that the law does not permit it. Apple maintained allowing any app on the iPhone could be detrimental to the phone’s functionality that Apple will be overrun by service calls from angry customers. It also goes against the agreements it has with its 30 phone-connection carriers worldwide, Joswiak said.

Ben Golant, the Copyright Office’s assistant general counsel, asked whether AT&T, the exclusive provider for the iPhone in the United States, “prohibits you from implementing certain applications?”

“We don’t allow any bandwidth hogs,” Joswiak said. He added that the Cupertino company does not allow apps associated with porn or other distasteful content, including a so-called “Baby Shaker” app barred last week.

The EFF, of San Francisco, requested the exemption.

Apple (.pdf) fears opening its iPhone platform to non-approved apps could cost it money. It earns 30 percent for every app sold, but would get nothing from those not sold via iTunes. Most important, however, it fears that opening up the OS would lead to piracy of sanctioned iPhone apps as well as create a giant iPhone platform to play and copy infringing content like movies and games.

The Motion Picture Association of America, the Recording industry Association of America, the Business Software Alliance and others said the DMCA does not allow  circumvention exemptions to create a “venue for infringing activity.”

“The impact will be to open up fast fields for the manufacturers and purveyors of pirated games,” said Steve Metalitz, a representative for those groups.

But von Lohmann countered and said the exemption, which would apply to all mobile phones including Google’s Android platform, is warranted because opening a venue for third-party apps is, by itself, a non-infringing activity the DMCA authorizes.

“This is a close ecosystem of a business model,” von Lohmann said, adding:
“I don’t think Congress meant that when they passed the DMCA.”

The DMCA, which President Clinton signed ten years ago, dictates “no person shall circumvent a technological measure that effectively controls access to a work protected under this title.”

But under the law, every three years the Librarian of Congress is charged with considering the public’s request for exemptions to that anti-circumvention language.

An exception adopted during the last review in 2006 granted mobile-phone owners the right to circumvent the technological locks on their phones.

Doing that allows users to switch phone carriers without buying a new phone. That is up for review again this year, and Peters and the other members of the Copyright Office entertained proposals to extend that for another three years as well.

Over the decade, a handful of other exemptions have been granted. They include circumvention of anti-copying restrictions on DVDs for the purpose of making compilations of portions of those works for educational use in a classroom. Another was directed at the blind, allowing the circumvention of an e-book’s shuttered read-aloud function. Another allows the circumvention of access controls on CDs to research for security flaws.

Copyright 2009

**********************************************

Groklaw wrote:

"It may be your automobile; but it's Apple's business, associated with the apps, not the gadget alone, and it's Apple's brand. Brand matters, and brand is built on quality. If, for example, someone passed a law that everyone could put whatever they wish on Groklaw and I lost control over that, I'd shut Groklaw down rather than see it ruined. From dealing with spammers, I know exactly how ruined it would quickly be. Apple says they block bandwidth hog apps and porn and other things they don't want to be associated with, like Baby Shaker. I'd want to be able to do that too, because it affects the brand, not just the business model. At the end of the day, this will be decided on the basis of the legal issues the EFF has raised, but common sense tells me that Apple won't sell certain gadgets that people really love if this exemption is approved. This is part of the periodic review of the DMCA, and the article has a link to the 9 proposed exemptions being considered now."

Screenshot: 2.bp.blogspot.com/.../groklaw-perspective.jpg

Is Groklaw against interoperability on the iPhone?

anonymous-insider United States |

5/7/2009 10:40:36 PM #

Alan Bell

It is indeed a tricky issue to assess conformance and interoperability to a standard. I can think of only one way to half the workload.
From what I can work out it seems that wordprocessed documents are now reasonably interoperable as .odt however spreadsheets are a basket case thanks to a lack of a formula specification in ODF 1.1 and Microsoft just dumping in their own formula syntax in a new namespace rather than attempting to be interoperable. Actually I don't think they made the worst decision in this aspect, if they tweaked their formula language to be mostly like OpenOffice.org and used the same namespace there would be weird edge cases where interoperability failed (probably date handling). As it is they broke it altogether. The really bad thing they did is ripping out other people's formulas when they open and save a spreadsheet, it then saves just the values of the most recent calculation. I think that is pretty bad application behaviour, but as you point out it could still be compliant technically.
So if odt works now and ods is a future goal then progress is being made.

@anonymous-insider what is the point you are attempting to make? what does it have to do with document standards?

Alan Bell United Kingdom |

5/8/2009 9:08:13 AM #

Alex

@Alan

Something I'd like to have more facts on is how interoperable the OO.o "convention" really is. "Maya's Wedding Planner" obviously isn't a sufficient guarantee that this (undocumented) technology is fit for purpose, safe, or consistently implemented.

There are some problems with Microsoft's .odt implementation (as there are with other implementations also)  - I'll come to those in a bit.

Alex United Kingdom |

5/8/2009 6:57:57 PM #

Alan Bell

I could link to the PDF, but for irony's sake here is the sc.openoffice.org/.../Validation%20of%20Functions.doc .doc file where function results have been carefully compared across various products to assess interoperability and improve compatibility. OOo makes real efforts to be interoperable.

Alan Bell United Kingdom |

5/8/2009 9:09:08 PM #

anonymous-insider

Off Topic

More conspiracy theories...

www.investorvillage.com/smbd.asp

anonymous-insider United States |

5/8/2009 9:12:17 PM #

anonymous-insider

@Alan Bell

Double standards perhaps...

anonymous-insider United States |

5/8/2009 10:57:36 PM #

anonymous-insider

Off Topic

The conspiracy is turning now into mere trolling according to http://tinyurl.com/o68ae2 with the Eminence Rouge benedictions.

anonymous-insider United States |

5/9/2009 8:00:57 AM #

Alex

@anonymous-insider

I'm not sure which is the less valuable: the tinfoil brigade's chunterings, or your commentary on it!

Alex United Kingdom |

5/9/2009 8:09:03 PM #

anonymous-insider

I'm always baffled by the Eminence Rouge of Groklaw!

anonymous-insider United States |

5/10/2009 5:41:57 AM #

anonymous-insider

@Alan Bell

An update on Groklaw's preferences for proprietary products:

anonymous-insider.blogspot.com/.../...pective.html

(new and enlightning comments were added)

anonymous-insider United States |

5/10/2009 8:22:48 AM #

Alex

@Alan

That certainly looks useful -- but is a long way from offering comfort. Showing that an implementation has black box behaviour (nearly) identical to other applications doesn't guarantee accurate or predictable behaviour for this "convention". Behaviour really needs to be precisely detailed in all respects - or in other words, standardized.

Microsoft's Doug Mahugh has posted a new piece at blogs.msdn.com/.../1-2-1.aspx - this seems to call the safety of the "convention" into some doubt...

- Alex.

Alex United Kingdom |

7/7/2011 4:37:43 PM #

trackback

Links for 05/04/2009

PHPPowerPoint 0.1.0 was released last week, as an open-source PHP API for generating PPTX files, much

Doug Mahugh |

Comments are closed

About the author

Alex Brown


Links

Legal

The author's views contained in this weblog are his, and not necessarily of any organisation. Third-party contributions are the responsibility of the contributor.

This weblog’s written content is governed by a Creative Commons Licence.

Creative Commons License     


Bling

Use OpenDNS  

profile for alexbrn at Stack Overflow, Q&A for professional and enthusiast programmers

Quotable

Note that everyone directly involved in the development of ISO standards is a volunteer or funded by outside sponsors. The editors, technical experts, etc., get none of this money. Of course, we must also consider the considerable expense of maintaining offices and executive staff in Geneva. Individual National Bodies are also permitted to sell ISO standards and this money is used to fund their own national standards activities, e.g., pay for offices and executive staff in their capital. But none of this money seems to flow down to the people who makes the standards.

Rob Weir

RecentComments

Comment RSS