123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507 |
- <!DOCTYPE html PUBLIC
- '-//W3C//DTD XHTML 1.0 Transitional//EN'
- 'http://www.w3.org/TR/xhtml1/DTD/transitional.dtd'>
- <html><head>
- <title>package overview</title>
- <!--
- /*
- * Copyright (C) 1999,2000,2001 The Free Software Foundation, Inc.
- */
- -->
- </head><body>
- <p> This package contains Ælfred2, which includes an
- enhanced SAX2-compatible version of the Ælfred
- non-validating XML parser, a modular (and hence optional)
- DTD validating parser, and modular (and hence optional)
- JAXP glue to those.
- Use these like any other SAX2 parsers. </p>
- <ul>
- <li><a href="#about">About Ælfred</a><ul>
- <li><a href="#principles">Design Principles</a></li>
- <li><a href="#name">About the Name Ælfred</a></li>
- <li><a href="#encodings">Character Encodings</a></li>
- <li><a href="#violations">Known Conformance Violations</a></li>
- <li><a href="#copyright">Licensing</a></li>
- </ul></li>
- <li><a href="#changes">Changes Since the Last Microstar Release</a><ul>
- <li><a href="#sax2">SAX2 Support</a></li>
- <li><a href="#validation">Validation</a></li>
- <li><a href="#smaller">You Want Smaller?</a></li>
- <li><a href="#bugfixes">Bugs Fixed</a></li>
- </ul></li>
- </ul>
- <h2><a name="about">About Ælfred</a></h2>
- <p>Ælfred is a XML parser written in the java programming language.
- <h3><a name="principles">Design Principles</a></h3>
- <p>In most Java applets and applications, XML should not be the central
- feature; instead, XML is the means to another end, such as loading
- configuration information, reading meta-data, or parsing transactions.</p>
- <p> When an XML parser is only a single component of a much larger
- program, it cannot be large, slow, or resource-intensive. With Java
- applets, in particular, code size is a significant issue. The standard
- modem is still not operating at 56 Kbaud, or sometimes even with data
- compression. Assuming an uncompressed 28.8 Kbaud modem, only about
- 3 KBytes can be downloaded in one second; compression often doubles
- that speed, but a V.90 modem may not provide another doubling. When
- used with embedded processors, similar size concerns apply. </p>
- <p> Ælfred is designed for easy and efficient use over the Internet,
- based on the following principles: </p> <ol>
- <li> Ælfred must be as small as possible, so that it doesn't add too
- much to an applet's download time. </li>
- <li> Ælfred must use as few class files as possible, to minimize the
- number of HTTP connections necessary. (The use of JAR files has made this
- be less of a concern.) </li>
- <li> Ælfred must be compatible with most or all Java implementations
- and platforms. (Write once, run anywhere.) </li>
- <li> Ælfred must use as little memory as possible, so that it does
- not take away resources from the rest of your program. (It doesn't force
- you to use DOM or a similar costly data structure API.)</li>
- <li> Ælfred must run as fast as possible, so that it does not slow down
- the rest of your program. </li>
- <li> Ælfred must produce correct output for well-formed and valid
- documents, but need not reject every document that is not valid or
- not well-formed. (In Ælfred2, correctness was a bigger concern
- than in the original version; and a validation option is available.) </li>
- <li> Ælfred must provide full internationalization from the first
- release. (Ælfred2 now automatically handles all encodings
- supported by the underlying JVM; previous versions handled only
- UTF-8, UTF_16, ASCII, and ISO-8859-1.)</li>
- </ol>
- <p>As you can see from this list, Ælfred is designed for production
- use, but neither validation nor perfect conformance was a requirement.
- Good validating parsers exist, including one in this package,
- and you should use them as appropriate. (See conformance reviews
- available at <a href="http://www.xml.com/">http://www.xml.com</a>)
- </p>
- <p> One of the main goals of Ælfred2 was to significantly improve
- conformance, while not significantly affecting the other goals stated above.
- Since the only use of this parser is with SAX, some classes could be
- removed, and so the overall size of Ælfred was actually reduced.
- Subsequent performance work produced a notable speedup (over twenty
- percent on larger files). That is, the tradeoffs between speed, size, and
- conformance were re-targeted towards conformance and support of newer APIs
- (SAX2), with a a positive performance impact. </p>
- <p> The role anticipated for this version of Ælfred is as a
- lightweight Free Software SAX parser that can be used in essentially every
- Java program where the handful of conformance violations (noted below)
- are acceptable.
- That certainly includes applets, and
- nowadays one must also mention embedded systems as being even more
- size-critical.
- At this writing, all parsers that are more conformant are
- significantly larger, even when counting the optional
- validation support in this version of Ælfred. </p>
- <h3><a name="name">About the Name <em>Ælfred</em></a></h3>
- <p>Ælfred the Great (AElfred in ASCII) was King of Wessex, and
- some say of King of England, at the time of his death in 899 AD.
- Ælfred introduced a wide-spread literacy program in the hope that
- his people would learn to read English, at least, if Latin was too
- difficult for them. This Ælfred hopes to bring another sort of
- literacy to Java, using XML, at least, if full SGML is too difficult.</p>
- <p>The initial Æ ligature ("AE)" is also a reminder that XML is
- not limited to ASCII.</p>
- <h3><a name="encodings">Character Encodings</a></h3>
- <p> The Ælfred parser currently builds in support for a handful
- of input encodings. Of course these include UTF-8 and UTF-16, which
- all XML parsers are required to support:</p> <ul>
- <li> UTF-8 ... the standard eight bit encoding, used unless
- you provide an encoding declaration or a MIME charset tag.</li>
- <li> US-ASCII ... an extremely common seven bit encoding,
- which happens to be a subset of UTF-8 and ISO-8859-1 as well
- as many other encodings. XHTML web pages using US-ASCII
- (without an encoding declaration) are probably more
- widely interoperable than those in any other encoding. </li>
- <li> ISO-8859-1 ... includes accented characters used in
- much of western Europe (but excluding the Euro currency
- symbol).</li>
- <li> UTF-16 ... with several variants, this encodes each
- sixteen bit Unicode character in sixteen bits of output.
- Variants include UTF-16BE (big endian, no byte order mark),
- UTF-16LE (little endian, no byte order mark), and
- ISO-10646-UCS-2 (an older and less used encoding, using a
- version of Unicode without surrogate pairs). This is
- essentially the native encoding used by Java. </li>
- <li> ISO-10646-UCS-4 ... a seldom-used four byte encoding,
- also known as UTF-32BE. Four byte order variants are supported,
- including one known as UTF-32LE. Some operating systems
- standardized on UCS-4 despite its significant size penalty,
- in anticipation that Unicode (even with surrogate pairs)
- would eventually become limiting. UCS-4 permits encoding
- of non-Unicode characters, which Java can't represent (and
- XML doesn't allow).
- </li>
- </ul>
- <p> If you use any encoding other than UTF-8 or UTF-16 you should
- make sure to label your data appropriately: </p>
- <blockquote>
- <?xml version="1.0" encoding="<b>ISO-8859-15</b>"?>
- </blockquote>
- <p> Encodings accessed through <code>java.io.InputStreamReader</code>
- are now fully supported for both external labels (such as MIME types)
- and internal types (as shown above).
- There is one limitation in the support for internal labels:
- the encodings must be derived from the US-ASCII encoding,
- the EBCDIC family of encodings is not recognized.
- Note that Java defines its
- own encoding names, which don't always correspond to the standard
- Internet encoding names defined by the IETF/IANA, and that Java
- may even <em>require</em> use of nonstandard encoding names.
- Please report
- such problems; some of them can be worked around in this parser,
- and many can be worked around by using external labels.
- </p>
- <p>Note that if you are using the Euro symbol with an fixed length
- eight bit encoding, you should probably be using the encoding label
- <em>iso-8859-15</em> or, with a Microsoft OS, <em>cp-1252</em>.
- Of course, UTF-8 and UTF-16 handle the Euro symbol directly.
- </p>
- <h3><a name="violations">Known Conformance Violations</a></h3>
- <p>Known conformance issues should be of negligible importance for
- most applications, and include: </p><ul>
-
- <li> Rather than following the voluminous "Appendix B" rules about
- what characters may appear in names (and name tokens), the Unicode
- rules embedded in <em>java.lang.Character</em> are used.
- This means mostly that some names are inappropriately accepted,
- though a few are inappropriately rejected. (It's much simpler
- to avoid that much special case code. Recent OASIS/NIST test
- cases may have these rules be realistically testable.) </li>
- <li> Text containing "]]>" is not rejected unless it fully resides
- in an internal buffer ... which is, thankfully, the typical case. This
- text is illegal, but sometimes appears in illegal attempts to
- nest CDATA sections. (Not catching that boundary condition
- substantially simplifies parsing text.) </li>
- <li> Surrogate characters that aren't correctly paired are ignored
- rather than rejected, unless they were encoded using UTF-8. (This
- simplifies parsing text.) Unicode 3.1 assigned the first characters
- to those character codes, in early 2001, so few documents (or tools)
- use such characters in any case. </li>
- <li> Declarations following references to an undefined parameter
- entity reference are not ignored. (Not maintaining and using state
- about this validity error simplifies declaration handling; few
- XML parsers address this constraint in any case.) </li>
- <li> Well formedness constraints for general entity references
- are not enforced. (The code to handle the "content" production
- is merged with the element parsing code, making it hard to reuse
- for this additional situation.) </li>
- </ul>
- <p> When tested against the July 12, 1999 version of the OASIS
- XML Conformance test suite, an earlier version passed 1057 of 1067 tests.
- That contrasts with the original version, which passed 867. The
- current parser is top-ranked in terms of conformance, as is its
- validating sibling (which has some additional conformance violations
- imposed on it by SAX2 API deficiencies as well as some of the more
- curious SGML layering artifacts found in the XML specification). </p>
- <p> The XML 1.0 specification itself was not without problems,
- and after some delays the W3C has come out with a revised
- "second edition" specification. While that doesn't resolve all
- the problems identified the XML specification, many of the most
- egregious problems have been resolved. (You still need to drink
- magic Kool-Aid before some DTD-related issues make sense.)
- To the extent possible, this parser conforms to that second
- edition specification, and does well against corrected versions
- of the OASIS/NIST XML conformance test cases. See <a href=
- "http://xmlconf.sourceforge.net">http://xmlconf.sourceforge.net</a>
- for more information about SAX2/XML conformance testing. </p>
- <h3><a name="copyright">Copyright and distribution terms</a></h3>
- <p>
- The software in this package is distributed under the GNU General Public
- License (with a special exception described below).
- </p>
- <p>
- A copy of GNU General Public License (GPL) is included in this distribution,
- in the file COPYING. If you do not have the source code, it is available at:
- <a href="http://www.gnu.org/software/classpath/">http://www.gnu.org/software/classpath/</a>
- </p>
- <pre>
- Linking this library statically or dynamically with other modules is
- making a combined work based on this library. Thus, the terms and
- conditions of the GNU General Public License cover the whole
- combination.
- As a special exception, the copyright holders of this library give you
- permission to link this library with independent modules to produce an
- executable, regardless of the license terms of these independent
- modules, and to copy and distribute the resulting executable under
- terms of your choice, provided that you also meet, for each linked
- independent module, the terms and conditions of the license of that
- module. An independent module is a module which is not derived from
- or based on this library. If you modify this library, you may extend
- this exception to your version of the library, but you are not
- obligated to do so. If you do not wish to do so, delete this
- exception statement from your version.
- Parts derived from code which carried the following notice:
- Copyright (c) 1997, 1998 by Microstar Software Ltd.
- AElfred is free for both commercial and non-commercial use and
- redistribution, provided that Microstar's copyright and disclaimer are
- retained intact. You are free to modify AElfred for your own use and
- to redistribute AElfred with your modifications, provided that the
- modifications are clearly documented.
- This program is distributed in the hope that it will be useful, but
- WITHOUT ANY WARRANTY; without even the implied warranty of
- merchantability or fitness for a particular purpose. Please use it AT
- YOUR OWN RISK.
- </pre>
- <p> Some of this documentation was modified from the original
- Ælfred README.txt file. All of it has been updated. </p>
- </p>
- <h2><a name="changes">Changes Since the last Microstar Release</a></h2>
- <p> As noted above, Microstar has not updated this parser since
- the summer of 1998, when it released version 1.2a on its web site.
- This release is intended to benefit the developer community by
- refocusing the API on SAX2, and improving conformance to the extent
- that most developers should not need to use another XML parser. </p>
- <p> The code has been cleaned up (referring to the XML 1.0 spec in
- all the production numbers in
- comments, rather than some preliminary draft, for one example) and
- has been sped up a bit as well.
- JAXP support has been added, although developers are still
- strongly encouraged to use the SAX2 APIs directly. </p>
- <h3><a name="sax2">SAX2 Support</a></h3>
- <p> The original version of Ælfred did not support the
- SAX2 APIs. </p>
- <p> This version supports the SAX2 APIs, exposing the standard
- boolean feature descriptors. It supports the "DeclHandler" property
- to provide access to all DTD declarations not already exposed
- through the SAX1 API. The "LexicalHandler" property is supported,
- exposing entity boundaries (including the unnamed external subset) and
- things like comments and CDATA boundaries. SAX1 compatibility is
- currently provided.</p>
- <h3><a name="validation">Validation</a></h3>
- <p> In the 'pipeline' package in this same software distribution is an
- <a href="../pipeline/ValidationConsumer.html">XML Validation component</a>
- using any full SAX2 event stream (including all document type declarations)
- to validate. There is now a <a href="XmlReader.html">XmlReader</a> class
- which combines that class and this enhanced Ælfred parser, creating
- an optionally validating SAX2 parser. </p>
- <p> As noted in the documentation for that validating component, certain
- validity constraints can't reliably be tested by a layered validator.
- These include all constraints relying on
- layering violations (exposing XML at the level of tokens or below,
- required since XML isn't a context-free grammar), some that
- SAX2 doesn't support, and a few others. The resulting validating
- parser is conformant enough for most applications that aren't doing
- strange SGML tricks with DTDs.
- Moreover, that validating filter can be used without
- a parser ... any application component that emits SAX event streams
- can DTD-validate its output on demand. </p>
- <h3><a name="smaller">You want Smaller?</a></h3>
- <p> You'll have noticed that the original version of Ælfred
- had small size as a top goal. Ælfred2 normally includes a
- DTD validation layer, but you can package without that.
- Similarly, JAXP factory support is available but optional.
- Then the main added cost due to this revision are for
- supporting the SAX2 API itself; DTD validation is as
- cleanly layered as allowed by SAX2.</p>
- <h3><a name="bugfixes">Bugs Fixed</a></h3>
- <p> Bugs fixed in Ælfred2 include: </p>
- <ol>
- <li> Originally Ælfred didn't close file descriptors, which
- led to file descriptor leakage on programs which ran for any
- length of time. </li>
- <li> NOTATION declarations without system identifiers are
- now handled correctly. </li>
- <li> DTD events are now reported for all invocations of a
- given parser, not just the first one. </li>
- <li> More correct character handling: <ul>
- <li> Rejects out-of-range characters, both in text and in
- character references. </li>
- <li> Correctly handles character references that expand to
- surrogate pairs. </li>
- <li> Correctly handles UTF-8 encodings of surrogate pairs. </li>
- <li> Correctly handles Unicode 3.1 rules about illegal UTF-8
- encodings: there is only one legal encoding per character. </li>
- <li> PUBLIC identifiers are now rejected if they have illegal
- characters. </li>
- <li> The parser is more correct about what characters are allowed
- in names and name tokens. Uses Unicode rules (built in to Java)
- rather than the voluminous XML rules, although some extensions
- have been made to match XML rules more closely.</li>
- <li> Line ends are now normalized to newlines in all known
- cases. </li>
- </ul></li>
- <li> Certain validity errors were previously treated as well
- formedness violations. <ul>
- <li> Repeated declarations of an element type are no
- longer fatal errors. </li>
- <li> Undeclared parameter entity references are no longer
- fatal errors. </li>
- </ul></li>
- <li> Attribute handling is improved: <ul>
- <li> Whitespace must exist between attributes. </li>
- <li> Only one value for a given attribute is permitted. </li>
- <li> ATTLIST declarations don't need to declare attributes. </li>
- <li> Attribute values are normalized when required. </li>
- <li> Tabs in attribute values are normalized to spaces. </li>
- <li> Attribute values containing a literal "<" are rejected. </li>
- </ul></li>
- <li> More correct entity handling: <ul>
- <li> Whitespace must precede NDATA when declaring unparsed
- entities.</li>
- <li> Parameter entity declarations may not have NDATA annotations. </li>
- <li> The XML specification has a bug in that it doesn't specify
- that certain contexts exist within which parameter entity
- expansion must not be performed. Lacking an offical erratum,
- this parser now disables such expansion inside comments,
- processing instructions, ignored sections, public identifiers,
- and parts of entity declarations. </li>
- <li> Entity expansions that include quote characters no longer
- confuse parsing of strings using such expansions. </li>
- <li> Whitespace in the values of internal entities is not mapped
- to space characters. </li>
- <li> General Entity references in attribute defaults within the
- DTD now cause fatal errors when the entity is not defined at the
- time it is referenced. </li>
- <li> Malformed general entity references in entity declarations are
- now detected. </li>
- </ul></li>
- <li> Neither conditional sections
- nor parameter entity references within markup declarations
- are permitted in the internal subset. </li>
- <li> Processing instructions whose target names are "XML"
- (ignoring case) are now rejected. </li>
- <li> Comments may not include "--".</li>
- <li> Most "]]>" sequences in text are rejected. </li>
- <li> Correct syntax for standalone declarations is enforced. </li>
- <li> Setting a locale for diagnostics only produces an exception
- if the language of that locale isn't English. </li>
- <li> Some more encoding names are recognized. These include the
- Unicode 3.0 variants of UTF-16 (UTF-16BE, UTF-16LE) as well as
- US-ASCII and a few commonly seen synonyms. </li>
- <li> Text (from character content, PIs, or comments) large enough
- not to fit into internal buffers is now handled correctly even in
- some cases which were originally handled incorrectly.</li>
- <li> Content is now reported for element types for which attributes
- have been declared, but no content model is known. (Such documents
- are invalid, but may still be well formed.) </li>
- </ol>
- <p> Other bugs may also have been fixed. </p>
- <p> For better overall validation support, some of the validity
- constraints that can't be verified using the SAX2 event stream
- are now reported directly by Ælfred2. </p>
- </body></html>
|