TidBITS#445/31-Aug-98 ===================== Do your eyes glaze over when you hear about MacBinary, AppleDouble, and Base64? Read on for a comprehensive look at common Macintosh file formats. Also in this issue, Mark Anbinder relays details of Adobe's announcement of PageMill 3.0 for the Mac, and, in the news, Quark bids for Adobe, Farallon introduces a solution for iMacs and StyleWriters, the Norton Utilities 4.0 beta eats RAIDs, and new software releases include AppleShare IP 6.0, MacLinkPlus Deluxe 10, and Virtual PC 2.1. Topics: MailBITS/31-Aug-98 PageMill 3.0 Surfaces Macintosh Internet File Format Primer Copyright 1998 TidBITS Electronic Publishing. All rights reserved. Information: Comments: --------------------------------------------------------------- This issue of TidBITS sponsored in part by: * APS Technologies -- 800/443-4199 -- -- How do you back up your APS hard disks? Try APS tape, removable, magneto-optical, and CD-R drives! * Northwest Nexus -- 1 888-NWNEXUS -- Internet business solutions throughout the Pacific Northwest. * Small Dog Electronics -- Special Deal for TidBITS Readers! Apple PowerBook 3400c/240 (refurb), 48 MB & Backpack: $1,949 Epson Stylus 740 USB/LocalTalk printer: $269 For Details: -- 802/496-7171 * Cyberian Outpost -- the Cool Place to Shop for Computer Stuff! <- NEW! All your iMac needs, from SuperDisks to RAM to more iMacs! Order online today or call 860/927-2050 x228! * TERRY MORSE MYRMIDON Turns any Mac file into a Web page with one click! QuarkXPress, PageMaker, FreeHand, FileMaker Pro -- anything. FREE DEMO --> <-- FREE DEMO * StuffIt Deluxe 4.5: $10 OFF - only $59.95 for TidBITS readers! <- NEW! The ultimate utility for compressing, expanding, encoding, and decoding over 20 Mac, Unix, and PC file formats! Download now! --------------------------------------------------------------- MailBITS/31-Aug-98 ------------------ **No Issue Labor Day** -- In the continuing administrative saga, our planned server move last week was delayed by the just-resolved US West strike, so the move will happen in the future. More immediately, we're taking the next issue off, nominally because it's the Labor Day holiday in the United States, and what better way to celebrate than by not working? In fact, Tonya and I have friends visiting and Jeff Carlson is working to finish his PalmPilot Visual QuickStart Guide for Peachpit Press. If we're lucky, the weather won't decide to follow the stock markets into the doldrums. [ACE] **Adobe Rejects Quark Buyout Offer** -- Last week Quark, Inc. made public its desire to purchase Adobe Systems, Inc. for an undisclosed sum. The privately held Quark made an offer to Adobe management, although Adobe claims that Quark did not make a bona fide offer, but sent only "unsolicited letters." [I wonder if that counts as spam? -Adam] Adobe refused Quark's advances, and Quark is now hoping to open a new dialog with Adobe or pursue the possibility of a hostile takeover. Although Adobe is much larger - with 1997 revenues of $911.9 million compared to Quark's $200 million - its stock is at a yearly low, and the company is undergoing restructuring. Quark, maker of the desktop publishing application QuarkXPress, said that it would likely divest Adobe of PageMaker, QuarkXPress's main competition, as well as other products that could raise flags with industry regulators. [JLC] **Apple Releases AppleShare IP 6.0** -- Apple has released AppleShare IP 6.0, the latest version of the company's integrated server software. AppleShare IP 6.0 improves performance and adds major new features, including support for Windows clients using the Server Message Block protocol (SMB), IMAP4 support combined with Sherlock server-side searching technology, printing capabilities over TCP/IP, and support for third-party plug-ins. According to Apple, AppleShare IP requires a Power Macintosh with a PowerPC 601, 604, 604e, or G3 processor (or the Power Macintosh 6500), Mac OS 8.1 with Open Transport 1.3 or later, and 48 MB of RAM (with virtual memory, 64 MB without). Pricing is $499 for a 10-client license; Apple sells other licenses up to an unlimited client license that can support up to 500 simultaneous users for $1,499. [ACE] **MacLinkPlus Deluxe 10 Ships** -- It may no longer be bundled with the Mac OS, but MacLinkPlus hasn't disappeared. DataViz has now released MacLinkPlus Deluxe 10.0, the latest version of the venerable file translation utility. The new version adds new translators for Word 98 and Excel 98, decoding capabilities for a variety of Internet compression and encoding formats generally found in email, and contextual menu support for all of MacLinkPlus's functions. A new interface supports drag & drop, offers information about files of unknown provenance, and enables you to view graphics and text in files. Upgrades cost $40 and new versions cost $99. Two problems have surfaced since the release, including a crash related to trying to save or open a file in ClarisWorks 5 using MacLinkPlus. DataViz recommends a workaround of translating files outside of ClarisWorks 5, and notes that to translate ClarisWorks 5 files to another format, you must first save them as ClarisWorks 4 files. Also, the MacLinkPlus installer incorrectly installs the Contextual Menu Enabler extension, which can cause trouble for some users. Although that extension is required by Apple Internet Address Detectors (IAD) 1.0.1 and should remain if you've previously installed IAD, DataViz recommends all other MacLinkPlus users disable the Contextual Menu Enabler extension. [ACE] **Of iMacs and StyleWriters** -- Last week's "iMac Connection Guide" (see TidBITS-444_) will require updates, and the first comes from Farallon, who introduced the EtherMac iPrint Adapter SL. This model of the iPrint connects serial-based StyleWriter printers without LocalTalk support to the iMac's 10Base-T Ethernet port. Like Farallon's solution for LocalTalk printers, the now- shipping EtherMac iPrint Adapter LT, the SL version of the iPrint will cost $99, and Farallon expects to ship it in September of 1998. [ACE] **Connectix Updates Virtual PC to 2.1** -- Connectix Corporation last week released an updater to Virtual PC, adding a handful of features and fixing minor bugs and compatibility issues. The new version adds support for Voodoo2 graphics and Windows NT, the capability to choose between multiple installed Ethernet devices, support for hot-swapping PowerBook drives, improved compatibility with RAM Doubler and virtual memory, and improved video compatibility. Owners of Virtual PC 2.0 or 2.0.1 can jump to 2.1 for free by downloading the 1.7 MB updater. [JLC] **You Beta Be AfRAID of Norton** -- Mark James has identified a severe incompatibility between the public beta of Norton Utilities 4.0 for the Macintosh and volumes formatted with SoftRAID, the RAID software currently bundled with Apple servers. When repairing a striped volume, Norton Utilities apparently changes the partition type to HFS, thereby rendering all striped volumes inaccessible. Independent sources confirm this problem also applies to Apple RAID, RAIDware, ImageRAID, and FWB's RAID ToolKit. Symantec should be able to fix this problem quickly, and while anyone who's been nipped by this issue has our sympathies, it's beyond us why people would be running pre-release disk repair software on an important disk without top-notch backups. (And if you don't have top-notch backups, check out Adam's recent article series on the subject.) [GD] PageMill 3.0 Surfaces --------------------- by Mark H. Anbinder A little over a month ago in "Closing the Book on Visual Page" in TidBITS-439_, Adam speculated that Adobe's PageMill for Macintosh had quietly faded away, since there had been no sign Adobe would offer a companion to PageMill 3.0 for Windows. A week later, we reported that Adobe was indeed working on PageMill 3.0 for Macintosh, and today, even sooner than expected, Adobe announced an impressive upgrade and released a preview version of PageMill 3.0 for the Mac. Like its Windows cousin, PageMill 3.0 for Macintosh adds the site management features of SiteMill to an array of new and improved Web authoring features. Scheduled to ship in early October, PageMill 3.0 sports improved table editing, tag support, support for Java applet placement (and previewing if Macintosh Runtime for Java (MRJ) 2.1 is installed), site-wide search and replace, cleaner editing of raw HTML (for those who wish to tweak the code themselves), comprehensive contextual menu support, and strong support of Mac OS 8.5. The biggest enhancement in PageMill 3.0 is likely to be SiteMill's site management capabilities, now rolled seamlessly into the package. PageMill users need never touch a separate FTP client: Finder-like views of a Web site's contents enable intuitive drag & drop management and synchronization of the site. Serious Web designers will be especially pleased that PageMill 3.0 is better behaved than its predecessors when dealing with non-standard HTML and other types of markup used with database software or server- specific functions. The software's support for Mac OS 8.5 enhancements to the Appearance Manager, contextual menus, and Navigation Services features won't matter to most users initially, though it's nice to see Adobe thinking ahead. The sweeping contextual menu support within the application will be a treat for those who have become used to Control-clicking objects with Mac OS 8. Adobe has stopped short of assuming everyone will wish to use this feature, though, and provides other means to access the controls and commands in the contextual menus. PageMill 3.0 also includes an update feature that enables the software to check for PageMill updates on Adobe's Internet servers. It can check and perform the updating automatically, check periodically and allow the user to decide whether to download and install the updates, or wait for the user to check for an update manually. These options provide easy and automatic ways to keep the software up to date, without the discomfort many users have with downloads occurring behind their backs. The PageMill package includes Photoshop LE, a copy of the latest Acrobat Reader, QuickTime 3.0, current Netscape and Microsoft Web browsers, sample Java applets and JavaScripts, dozens of Web page templates, and thousands of graphic images suitable for Web use. PageMill requires a PowerPC processor and System 7.5.5 or later, although Adobe recommends Mac OS 8 or later. PageMill 3.0 will be available in early October with an upgrade price of $49 for existing PageMill owners. The new software will sell for $99 on Adobe's Web site if you'd like a product box, CD, and manual, or $79 if you want an electronic version. In the meantime, you can download the 8.6 MB public preview version (a release candidate that may turn out to be the "golden master") and take it for a spin. Macintosh Internet File Format Primer ------------------------------------- by Adam C. Engst Last week's article in TidBITS-444_ about the need for developers to support MacBinary III brought in a lot of email from people confused about various Macintosh file formats that appear on the Internet. What do these formats do, and how do they interact? I hope this article, written with the help of Leonard Rosenthol (the original developer of StuffIt Expander), will clear up confusion. First off, Mac users regularly deal with three kinds of encoding formats: archiving formats (like StuffIt, Compact Pro, and Zip), binary packaging formats, and transfer encoding formats. Archiving formats bundle multiple files into a single file, compressing the originals in the process. I'll assume that everyone understands the concept behind lossless compression - you replace repeating patterns of data within a file with a token representing those patterns, thus reducing the amount of data needed to represent the original. Binary packaging and transfer encoding formats are more complicated, and worse, they can be combined in the same format. Binary packaging formats include MacBinary, AppleSingle, and AppleDouble. Transfer encoding formats include uuencode, Base64, and quoted-printable. Last but not least, the venerable BinHex straddles the fence, providing both binary packaging and transfer encoding. Should you wish to encode or decode files manually, shareware utilities exist for some specific formats, and Aladdin's StuffIt Deluxe 4.5 provides translators for many as well. TidBITS readers can get a discount on StuffIt Deluxe - see the sponsorship area at the top of the issue for details. **MacBinary** -- MacBinary is an old format, first proposed back in 1985 by Dennis Brothers on MAUG on CompuServe. Two years later, a group of developers made additions to the format to handle HFS and other changes in the Mac OS. That format, MacBinary II, has survived to this day, although it is being replaced by MacBinary III to address the issue raised by the new file flags originally slated for Mac OS 8 and appearing now in Mac OS 8.5. Interestingly, the MacBinary II format has an option for a "secondary header" for future expansion, but it's never been used. As a binary packaging format, MacBinary bundles up the data fork and the resource fork, along with Finder information about the file (type, creator, etc.). In bundling the two forks of a Macintosh file together, MacBinary protects the file when it's uploaded to a Unix machine or PC, neither of which support Macintosh two-forked files. Without MacBinary, resource forks would be lost, which could be disastrous or merely annoying, depending on the file. Support for MacBinary is broad within applications, though users have seldom understood it because MacBinary support is generally transparent. When you upload a Macintosh file using Anarchie or Fetch, for instance, both default to uploading in MacBinary format. Part of the problem, I suspect, is that many people who upload files don't know to change the file name to reflect MacBinary's file extension - .bin. Some FTP applications, notably Fetch, try to add the .bin extension automatically. Although application support has been broad, it's seldom deep. For instance, although Anarchie and Fetch deal with MacBinary correctly and transparently, Web browsers generally pawn MacBinary files off on a helper application, such as MacBinary II+ or StuffIt Expander. Without the appropriate helper application, you can't decode the file. Worse, many Web servers don't set the proper MIME type for MacBinary files, which can result in old Web browsers trying to display the MacBinary file as text within the browser window. In this case, there are two solutions, short of updating to a modern Web browser. First, click and hold on the link and choose Download Link to Disk from the pop-up menu that appears in many browsers. Once you've downloaded the file, drop it on StuffIt Expander. Second, convince the Web site administrator in question to set the correct MIME type for MacBinary files. They should download in binary mode, with the "bin" extension, and using the MIME type "application/x-macbinary" (type and creator fields can be set to BINA and SITx so double-clicking the file launches StuffIt Expander). Even more confusing, it turns out that Internet Config, and thus Internet Explorer, incorrectly sets the MacBinary MIME type to "application/macbinary", which is an uncompleted proposal. And, older versions of Netscape Navigator (at least 2.x, and possibly 3.x) don't set any MIME type for MacBinary at all. Without agreement between Web servers and browsers, there's a good chance that something will go wrong when a user clicks a link to a MacBinary file. In theory, forcing a download to disk and then decoding manually should work, but with so many variables, there's no telling. My recommendation: set the MIME type for MacBinary to "application/x-macbinary" wherever you see it, including Internet Config, Web servers, and older versions of Netscape Navigator. Other settings for handling MacBinary, such as the file suffix and an application to handle the files, should be the same as those mentioned above for Web servers. Again, MacBinary is a binary packaging format, not a transfer encoding format. Thus, it requires a full 8-bit connection whenever the MacBinary file is being transferred. If someone still behind an obsolete 7-bit connection to the Internet tries to transfer a MacBinary file, it will be damaged in transit. (Some 7-bit connections still exist, but are rapidly fading into the mists of Internet past because both FTP and the Web's HTTP use 8-bit connections.) For that extremely uncommon situation, a transfer encoding format like BinHex is also necessary. **AppleSingle** -- Like MacBinary, AppleSingle is an 8-bit binary packaging format. Most people have seen AppleSingle only in the attachment encoding format pop-up menu in Eudora or Emailer. Apple developed AppleSingle and AppleDouble in the days of A/UX, Apple's original version of Unix. Since A/UX didn't support two-forked Macintosh files, Apple needed a way to share files between A/UX and the Mac OS. MacBinary was the obvious choice, but because MacBinary stores the data fork first in the file, you couldn't do live edits on MacBinary files within A/UX. So, Apple reversed the order in which the forks were stored in MacBinary files (so programs could append or remove data without moving the resource fork), added some never-used options for future expansion, and called it AppleSingle. Thanks to its extensibility, AppleSingle is a better format than MacBinary (it even supports the new Finder flags appearing in Mac OS 8.5), but it suffers from one significant problem: almost nothing supports it for file transfer. Email programs can often handle AppleSingle attachments, and Fetch can both upload and download AppleSingle files. Web browsers, however, are clueless. When the file flag issue that resulted in MacBinary III first arose, the immediate thought was to evangelize AppleSingle. But, without existing code, developers were loathe to put in the work necessary to support AppleSingle and to unleash a new file extension on the Mac community. MacBinary III was the course of least resistance. AppleSingle use is primarily restricted to occasional email messages between Macintosh users (although Apple also uses AppleSingle when storing disk images). As a cross-platform format, AppleSingle falls down because it bundles the two forks of a Macintosh file together in such a way that they can't easily be separated - that's what AppleDouble is for. In short, unless you're sending an attachment to another Macintosh user, there's no point in using AppleSingle, and even then, AppleDouble works as well. Since AppleSingle is an 8-bit format, AppleSingle files must be protected by a transfer encoding format when sent via email, since email protocols like SMTP (unlike FTP and HTTP) aren't guaranteed or required to be safe for 8-bit files. **AppleDouble** -- AppleDouble stores the two forks of a Macintosh file as separate files (bundling Finder information like type and creator in with the resource fork). AppleDouble also came about because of A/UX. You could share files between the Mac OS and A/UX using AppleSingle if programs on both sides understood AppleSingle. However, if you were sharing files with other flavors of Unix using NFS (Network Filing System), programs on those machines were unlikely to understand AppleSingle. AppleDouble's technique of storing a Macintosh file as two separate files enabled those other Unix users to edit just the data fork without disturbing the resource fork. You won't see files stored in AppleDouble on Internet file sites, since it's silly to store two files for each file uploaded. However, AppleDouble's way of splitting Mac files proved extremely useful for email, since each part of the file could be a different MIME part within a single message. That enables the receiving email program to pick out the parts it understands. If a Mac email program receives an AppleDouble-encoded attachment, it knows to read both forks and put them back together. If a non-Macintosh email program receives an AppleDouble-encoded attachment, however, it saves only the data fork, throwing away the resource fork. In fact, AppleDouble is the standard for sending Macintosh files in email according to the Macintosh extensions to MIME, written by Eudora author Steve Dorner. Like AppleSingle, AppleDouble doesn't lose Mac OS 8.5's new file flags, which makes it the default format of choice for attachments in the future. Keep in mind, however, the fact that AppleSingle and AppleDouble can both store these new file flags, doesn't mean that older applications properly read the new flags or write them out again. So, even though these _formats_ don't require any changes, _applications_ still might. Once again, AppleDouble is an 8-bit binary packaging format, so any AppleDouble email attachments must be protected by a transfer encoding format, generally Base64. **uuencode** -- uuencode is one of the oldest of the Internet transfer encoding formats. Designed many years ago for transferring binary files via the text-only UUCP protocols that carried email and Usenet news, uuencode takes 8-bit data and converts it to 7-bit text. There are many uuencode implementations, but files are easily recognizable because they all start with a "begin" line that specifies the file name and the Unix permissions for the file (generally 644). Transfer encoding formats like uuencode are essentially the reverse of compression software. They take groups of 8-bit bytes and represent them in a series of 7-bit characters. Thus, files encoded with a transfer encoding format always grow after encoding, up to 35 percent. uuencode doesn't know about Macintosh file forks and encodes only the data fork of a Mac file. Not all Mac files have resource forks or store necessary information in them (Microsoft Word files, for instance, have resource forks, but they don't contain any information essential to the file), so uuencode proves an acceptable way to transfer files to Windows users. Support for uuencode is more common in Windows programs, so I fall back to uuencode when sending attachments to Windows users if AppleDouble fails (which it might if the recipient's email program isn't MIME-savvy). **Base64** -- Like uuencode, Base64 represents 8-bit files using 7-bit characters so they can withstand being transmitted over 7-bit links or using 7-bit protocols. Base64 wasn't developed originally for the Internet, but for PostScript Level 2 for computers to transfer binary data to printers. Unlike uuencode, which sports numerous utilities, Base64 is almost entirely transparent to the user, being handled in the background by email programs. This transparency comes as a result of Base64 being a modern format that's handled by modern programs. In the past, computers and programs were less capable and users tended to be more sophisticated, so it was less necessary to make transfer encoding support transparent. **Quoted-Printable** -- Quoted-printable, which most people know of only indirectly because of Eudora's QP button, is a transfer encoding format designed for representing high ASCII characters (special characters with diacritical marks, for instance) in 7-bit form. The important difference between quoted-printable and the other transfer encoding formats is that quoted-printable encoded text remains mostly human-readable. Quoted-printable isn't used for encoding files, just the text of email messages. We've all seen email messages with equal sign characters at the ends of the lines - that's an indication of a quoted-printable message not being decoded, usually because the MIME header that specifies the quoted-printable encoding was deleted. This problem crops up primarily in mailing list digests, since mailing list software removes all but the essential headers from messages before combining them into a digest. The solution to this problem is MIME digests, which maintain headers for each message within the digest, facilitating bursting the digest into a mailbox and retaining special headers that specify transfer encoding. **BinHex** -- I've saved the most confusing format for last. BinHex is a binary packaging _and_ transfer encoding format originally developed by Tim Mann for the TRS-80 in the early 1980s and rewritten completely by Yves Lempereur for the Macintosh in 1984. Yves was also part of the team that created the MacBinary format, and he wrote the BinHex 5.0 program to support it. This caused some confusion because his BinHex 4.0 program used the BinHex format, whereas BinHex 5.0 used MacBinary. The BinHex format solves both problems facing transmission of Mac files on the Internet. When you encode a file in BinHex, the encoder first combines the file's forks, then converts the 8-bit result into a 7-bit file. The combination of these functions made BinHex the most popular way to deal with Mac files on the Internet because you could be pretty sure that whatever you did, the original file would survive. I shouldn't imply that BinHex is an entirely good thing any more. It was great back when 7-bit links were common, but in today's world, the 30 to 35 percent by which files grow when binhexed is an unnecessary waste of space and downloading time. Also, BinHex doesn't store Mac OS 8.5's new file flags, which will render it less useful in the near future. That said, BinHex won't go away any time soon. Support for BinHex is widespread, and everyone recognizes the BinHex .hqx extension and knows how to decode BinHex files (drop them on StuffIt Expander). Because BinHex files are 7-bit text, they're more likely to survive badly configured applications, and in the past, it was even common practice to copy them out of an email message or a browser window into a text file, save it, and decode it. If you see BinHex text in today's software, something has probably gone wrong, and it's likely that the file will be damaged. Another minor advantage of BinHex's text format is that it can have human- readable descriptions above the BinHex code. The main argument I've seen for why people like BinHex is that it works. That's true, and I'd never encourage someone to switch to something that worked badly. I've heard of situations where BinHex decoders deal better with huge files than MacBinary decoders, and the whole MIME type debacle with MacBinary that I mentioned above has also caused trouble. At the same time, though, our goal should be to identify and eliminate the problems that affect today's modern formats, rather than sticking, DOS-like, with what we're used to. $$ Non-profit, non-commercial publications may reprint articles if full credit is given. Others please contact us. We don't guarantee accuracy of articles. Caveat lector. Publication, product, and company names may be registered trademarks of their companies. This file is formatted as setext. For more information send email to . A file will be returned shortly. For information: how to subscribe, where to find back issues, and more, email . TidBITS ISSN 1090-7017. Send comments and editorial submissions to: Back issues available at: And: Full text searching available at: -------------------------------------------------------------------