New Perspectives: Multimedia in Analytical Chemistry

Hamid Ghanadan
gh multimedia

This article includes two animated figures as Supporting Information.

When I was studying biochemistry in college, my professor often attempted to illustrate structures of complex proteins on the board. Even though he was artistically inclined, with his white chalk on the green board, the structures always had a suspicious resemblance to a bowl of spaghetti. And no matter how much he emphasized that the action of most proteins is directly related to their three-dimensional (3-D) structure, the concept never truly hit home until I saw my first computer-generated model of a protein's crystal structure, rotating against a simple black space.

Although this kind of animation used to require top-of-the-line Silicon Graphics workstations, today's personal computers are faster and more capable of creating multimedia. In computer terms, multimedia can be defined as any combination of images, animation, sound, and words used to convey an idea. The more complex and technical a subject, the more suitable it is for communication through multimedia. Thus, science is the ideal subject for this type of communication. This article provides an overview of software programs that are available for creating scientific multimedia and covers some issues regarding the distribution of multimedia via the Internet.

Authoring multimedia

Animation. For scientific purposes, animation can be defined as the stacking of small images or other multiples of data through time. Effective animation can add several dimensions—for example, movement, color, or time—to a static illustration. There are several good software packages available for creating 3-D and two-dimensional (2-D) animation.

Standard 2-D illustration software such as Adobe Illustrator (http://www.adobe.com/prodindex/illustrator) and Macromedia Freehand (http://www.macromedia.com/software/freehand) do not offer enhanced animation tools. They do, however, provide a flexible environment for creating motion graphics. For example, a multilayered image can be created in Illustrator, in which layers contain different frames of a simple animation. This multilayered image file can then be exported to Adobe Photoshop (http://www.adobe.com/prodindex/photoshop) for assembly of the animation.

Illustrator also includes a graphing tool, allowing numerical data input for plotting graphs. This is especially useful to scientists for two reasons. First, scientific data are no longer bound to the "canned" look and feel of standard spread sheets. With the software's wide range of design tools for customizing fonts, colors, and axes, scientists have control over every element of their graphs and charts. Second, scientists can create simple animation of their data. Imagine how that might enhance the results from a time series of experiments, for example.

Macromedia Flash (http://www.macromedia.com/software/flash) creates 2-D animation that is Web-friendly. Flash also can add interactivity to animation, allowing viewers to make selections through hot links. For example, a chemist can create an animated diagram to explain the operating principle of an instrument. Viewers of the diagram can "virtually" operate the instrument by clicking on the valves to turn them "on" or "off". Each action by the viewer affects the animation.

Three-dimensional animation can be created with several modeling programs, such as MetaCreations Ray Dream Studio (http://www.metacreations.com/products/rds55) and formZ by autodessys (http://www.formz.com). Each program uses its own algorithm for creating and rendering 3-D images. These programs, like most 3-D modeling software, come equipped with a time line for creating complex animation. As shown in Figure 1, simple animation can be used to rotate molecules, perhaps showing their structure, contour, or water-accessible surface from multiple vantage points. More complex animation can illustrate the spatial interaction of several molecules, stereochemical reactions, or complex biochemical processes, as shown in Figure 2.


Figure 1. Single frames from animation showing the rotation of green fluorescent protein. Link to animated gif (83 KB).

Audio. Sound adds yet another dimension to data. For example, adding narration to a video that explains the protocol for operating an instrument allows for faster "metabolism" of the information. Although recording, capturing, and playing back the audio requires the computer to be equipped with a sound card, virtually all of today's Macintosh computers and Windows-based PCs come with this hardware.


Figure 2. Single frames from a complex animation illustrating the formation of the prepriming complex in DNA replication. Link to QuickTime movie (649 KB).

Audio can be digitized in two ways: It can be directly recorded onto the computer, or prerecorded audio can be captured by the computer. There are many software packages available for capturing and editing audio. These programs range from simple, amateur-level programs to complex, studio recording software for professional audio engineers. Macromedia SoundEdit 16 (http://www.macromedia.com/software/sound) and BIAS Peak (http://www.bias-inc.com/peak.html) are two simple programs that offer substantial flexibility and editing features. Both programs allow merging and synchronization of audio with animation and video, and they are widely used by professional multimedia producers.

Video. Traditional film and video techniques require special hardware and are cumbersome, time-consuming, and expensive. With today's computers, however, creating movies and editing videos are relatively trouble-free. Video has many potential uses in science. For example, microscopists can document and present real-time cellular behavior (e.g., see the depletion of serotonin from Retzius neurons or the depletion of epinephrine and norepinephrine from bovine adrenal chromaffin cells at http://pubs.acs.org/isubscribe/journals/ancham-a/71/i15/html/yeung.html [1]). Other uses for video include the demonstration of multistep analytical techniques and the distribution of prerecorded lectures over the Internet. As with audio, video can be digitized by recording it directly onto the computer, or prerecorded video can be captured. In both cases, however, the computer needs to be equipped with a video capture card.

Once digitized, video can be edited with a program such as Adobe Premiere (http://www.adobe.com/prodindex/premiere), which offers many features and tools for editing video. A similar program, Adobe After Effects (http://www.adobe.com/prodindex/aftereffects), emphasizes the creation of special effects and motion graphics. Although both packages are used by video professionals, they are fairly easy to learn and straightforward to use.

Serving multimedia

The most convenient and inexpensive method of distributing multimedia supplements is via the Internet. With Internet connection speeds increasing, the Web provides a viable means for distributing scientific information. Today's scientific Web sites offer a wealth of multimedia for a variety of audiences (e.g., view Kent Wilson's interactive teaching tool for physical chemistry at http://www-wilson.ucsd.edu/education/samplegateway.html). However, there are several issues to consider when creating multimedia for distribution over the Internet. Most audio, video, and animation requires optimization for Web circulation. Also, issues regarding compatibility with different Web browsers and operating systems need to be addressed. Lastly, multimedia pieces are often too large to be downloaded over conventional connections within a reasonable amount of time.

The simplest animation, containing only a few frames, can be distributed as an animated gif file. First, each frame is created individually and saved as a gif file. (All of the software programs mentioned above support the gif format.) Then, the sequence is assembled by the shareware programs GifBuilder for Macintosh (http://iawww.epfl.ch/Staff/Yves.Piguet/clip2gif-home/GifBuilder.html) or Gif Construction Set for Windows 3.1/95/NT (http://www.mindworkshop.com/alchemy/gifcon.html). Alternatively, Macromedia Flash can create Web-ready interactive animation. However, viewers need to download free plug-in software to enable their Web browsers to parse the flash format.

More complex animation, especially those with audio and video, are often "streamed" on the Web. Streaming is a technology where audio and video can be viewed as the data are being downloaded. This technology eliminates the long download times that would be needed to view animation and video. Without streaming, a 4-MB file can take more than 8 min to download with a 56-Kb modem. As a streamed file, the movie would start playing after several seconds.

There are three main types of streaming technologies available: Apple QuickTime 4.0 (http://www.apple.com/quicktime), RealNetworks (http://www.real.com), and Macromedia Shockwave (http://www.macromedia.com/downloads). Each of these technologies has unique capabilities and features. However, they all require viewers to download plug-ins or helper applications for their Web browsers.

QuickTime is the industry standard format for digital video on both Macintosh and Windows platforms. All of the 3-D modeling and digital audio/video programs mentioned in this article rely heavily on the QuickTime format, and the most recent version, QuickTime 4.0, includes streaming technology. However, although it takes relatively little effort to create a QuickTime movie and distribute it over the Internet, QuickTime's streaming technology requires special hardware and software configurations on the server side.

RealNetworks Real media is a popular technology for streaming audio and video over the Internet. Three different software programs are needed for distributing Real content. First, RealPublisher is needed to compress and encode QuickTime source files in the Real format. RealPublisher automates the process of creating Real content by encoding audio/video files, writing the HTML code, and uploading all the files directly to the server. A server-side software program is also needed to distribute Real content. Finally, viewers need RealPlayer to play back Real content.

Macromedia Shockwave creates streaming interactive video and uses a unique compression method for distributing its content via the Web. Like Flash, Shockwave offers audio, video, and interactivity, allowing viewer input through hot links. Shockwave is created with Macromedia Director, which is an extensive multimedia authoring package for creating CD-ROM content. Director can either assemble a sequence of images or use QuickTime movies to create Shockwaves. A plug-in is necessary on the viewer's side for the browser to recognize and parse the Shockwave code. No additional software on the server side is necessary.

Keeping it clean

With all this power and ease to create complex multimedia, principles of effective information design must be followed to create meaningful supplemental information (2, 3, 4). Far too often, the Web is used as a showcase of technology for technology's sake. And this grave mistake has created a sea of information-less documents. But amidst this sea, there are gems of scientific information, presented and supplemented with fabulous multimedia.

References

 (1) Yeung, E. S. Anal. Chem. 1999, 71, 522 A-529 A.

 (2) Tufte, E. R. The Visual Display of Quantitative Information; Graphics Press: Cheshire, CT, 1983.

 (3) Tufte, E. R. Envisioning Information;Graphics Press: Cheshire, CT, 1990.

 (4) Tufte, E. R. Visual Explanations; Graphics Press: Cheshire, CT, 1997.

Hamid Ghanadan (hamid@ghmedia.com) is a multimedia producer who specializes in scientific communication. His work includes several covers for Analytical Chemistry.

CASChemPortChemCenterPubs Page