to computer science and art students. Computer science majors are uneasy ... required for image creation. Computer science students often learn about the ...
EDUCATION
TDaching Computer graphics Visual Litoracy to A r t and Computer Science Students: Advantagos, Resources and Opportunitios algorithms associated with those cues. The approach draws upon critical analysis [I]; but instead of emphasizing design, concept and media, it teaches students to recognize a small number of visual cues. These include:
Dena Eber Bowling Green State University
RosaleeWolfe DePaul University
• Visibility of polygon faces or polygon edges
Abstract Although it is a requisite skill for success in industry, visual literacy in graphics is intimidating to computer science and art students. Computer science majors are uneasy about using their eyes to examine images while art students may not have much background in the technical terminology. This column is the second in a two-part series that discusses an interdisciplinary teaching technique that overcomes these obstacles. Part one was published in Computer Graphics 34(I) February 2000, pp. 24-26. With this approach students become more familiar with the limits and possibilities of the medium of computer graphics, learn how to analyze and talk about what visual images might mean and develop a deeper understanding of time constraints. In addition, they gain confidence with technological terminology and the idea of suggesting alternative algorithms to create a desired visual "look." As a result both computer science and art students become more able to communicate effectively about and with visual imagery.
• Transition from light to dark on diffusereflecting surfaces • Highlight color and shape • Presence of transparency, reflection, refraction, patterns and textures Figure I: A sampleTERAsession.
• Color bleeding between adjacent diffuse reflectors
Figure 2: TERAin "Self Quiz" mode.
Background As mentioned in the previous column, visual literacy is important for both computer science and art students as it is a highly prized skill in the computer graphics industry. The workplace awaiting graduates is an interdisciplinary, t e a m - o r i e n t e d environment where people skills and empathy are essential for successful collaboration. Visual literacy forms a basis for shared vision and communication. For art students, visual literacy complements t h e i r visual knowledge by imparting an understanding of technical terminology and requirements. It gives them a standard and consistent means to commu-
27.
Computer Graphics
• Sharpness of shadow
nicate to different audiences. Visual literacy also enhances the technical abilities of computer science students because it gives them experience in looking at an image and analyzing what they perceive. It allows them to build a better understanding and appreciation of the visual aspects of c o m p u t e r graphics. In order to impart a visual literacy to graphics students, the authors use an interdisciplinary approach called visual analysis. Visual analysis is the process of discovering visual cues in an image and identifying the
These cues are usually sufficient to identify commonly used rendering algorithms. In a classroom setting, an instructor gradually introduces cues over a period of three to six weeks, starting with two or three that appear starkly different. For example, a good beginning set of cues encompasses the difference between outlined and filled in polygons and the presence or absence of reflection and refraction. In this stage instructors need to focus on the characteristic visual behavior of rendering techniques to give students the time needed to build their skills. Once students become confident with identifying rendering algorithms based on typical visual behavior, they are ready to tackle visual equivalencies.
Visual Equivalencies and Time U n d e r certain circumstances, different rendering algorithms can create similar results. This is the phenomenon of visual equivalency. For example, it is possible to use a z-buffer surface algorithm to produce shadows (via a shadow buffer) and reflections (via environment mapping), and the resulting image may appear as if it had been ray traced. When an object has a dull surface, it can be virtually impossible to distinguish Gouraud and Phong shading. Another example is the simulation of a Phong highlight with Gouraud
Figure J: By LanaLazebnik,DePaulUniversity. Implementedin C and OpenG/_
shading and a texture map depicting a highlight. As instructors introduce visual equivalencies, they can also broach the subject of algorithm performance. Visual equivalencies can motivate discussions on the amount of time needed to render an image. All graphics students need to be able to estimate the amount of time required for image creation. C o m p u t e r science students often learn about the basic differences in algorithm performance through informal discussions of an algorithm's time complexity or through examination of bench mark data showing the time required for various algorithms to rendering a given scene. A n o t h e r way t o understand algorithm performance is through empirically gained knowledge. A r t students learn to estimate the rendering time for a single image o r frame by rendering a low-resolution version and then estimate the time required for completing a high-resolution image. From there, they can estimate the rendering time for animations of various lengths and frame rates. They are shocked to discover the time requirements for rendering a five-minute ray traced animation. For students, it is often disappointing to find that a technique capable of producing a desired visual effect is simply not practical for the chosen application. A discussion of possible alternatives based on visual equivalency can follow naturally from this discovery. Stu W Matorials Students need to practice visual analysis outside of the classroom.VVhile posting images on the Web or pointing out examples in taxibooks is a start, students say that they benefit more from the questJon.and-answer sessions held at the end of a lecture. Simply looking at images does not promote active learning, in fact, students learn best by taking part in the experience, in other words, by doing [2].
Figure 41: FromLiberationby HunterGrant, BowlingGreenStateUniversity.
Having students learn a rendering package helps a bit because students can choose parameters and v i e w the resulting images. However it takes a significant amount of time to learn a package, and since the students have a priori knowledge of the surface and shading algorithms, this approach does not provide a student with a means of self assessment. A b e t t e r approach is t o p r o v i d e students with an easy-m-use interactive tool t h a t can demonstrate any r e n d e r i n g o r shading algorithm while encouraging active learning. One such tool is TEllS, (Tool for Exploring Rendering Algorithms), an interactive program that facilitates comparative study of the visual effects of rendering algorithms [4]. See Figure I for an annotated screen dump of TERA. A student can choose a scene and select a rendering algorithm for any object in the scene. Students can practice visual analysis using TERA. In "Self Quiz" mode, students select a scene, and TERA presents it with each object rendered by a random algorithm. Students then guess the rendering algorithm for each object in the scene.TERA responds w i t h " C o r r e c t , " " T r y Again" o r " C l o s e Enough." The "Close Enough" response is for those cases where multiple algorithms produce similar visual effects. For instance, Gouraud and Phong shading produce similar effects when no highlight is present. Always available is the "Tell me m o r e " button, which provides specific feedback about a student's last algorithm selection. When a student is in "Explore" mode, the "Tell Pie More" button will activate a pop-up window describing the relevant visual cues. In "Self Q u i z " mode, when students get a response of"Close Enough:' they can click on "Tell He Piore" for an explanation.A pop-up window will list the algorithm they picked and the actual algorithm in addition to a specific
e x p l a n a t i o n of why the t w o algorithms produced effects that are visually equivalent. For example, if a flat surface is very evenly lit, then Gouraud shading may produce variations in shade that are so subtle that the result looks like constant shading. In this situation, if a student picks " c o n s t a n t " and receives the "Close Enough" response, the "Tell Me More" button will activate a pop-up window containing the relevant explanation. See Figure 2. The new version of TERA is capable of creating nearly a million images for students to analyze. The images cover surface algorithms, z-buffer shaders, ray tracing shaders, texture mapping, bump mapping, lighting and visual equivalencies. Along with TERA, the students can do an in-class interactive exercise by taking the terminology from TERA and applying it to actual works of art from well established digital art exhibitions such as the SIGGRAPH Fine Arts Gallery, the SIGGla~PH Electronic Theater or the NewYork Digital Salon. After they apply terms or describe what they see, they will formally connect the visual cues, interpret them and finally assess the work. During critiques, the students will apply a similar approach to describing their own work and chat of their classmates. Benefits to Students For computer science students, visual analysis adds excitement and a sense of the "big picture" to introductory graphics courses. Students may not be able to implement every rendering algorithm when they leave the course, but they will be able to recognize them and know their names, which provides a starting point for further investigation. They develop an awareness and a deeper appreciation of computer generated imagery in addition to a sensibility for the technical requirements of the animations that they see in
May 2000
n
Figure 5: FromLiberatJonby Hunter Grant, Bowling Green State University.
Figure 6: From!Jberationby HunterGrant, Bowling GreenState University. movies and on television. A visual sensibility, fostered by visual analysis, enhances a depth of knowledge of those rendering algorithms that students do implement. Because they are already familiar with the visual behavior of the algorithm, they have expectations of how an image should appear and can perform more of their debugging on their own w i t h o u t outside help. Students no longer ask, "Is it right?" They state, "There's something wrong with my highlight." A greater awareness of visual possibilities serves as an effective motivator. Figure 3 is an example of student's final project in a programming course where the emphasis was on developing a z-buffer based renderer using OpenGL. The student wanted reflections and shadows in her image, so she took the time to implement a special case of environment mapping and a shadow buffer. For art students, visual analysis imparts an awareness of the possibilities in visual communication with digital media. Even if students cannot create a large-scale virtual environment or full feature animation, they have a better appreciation of future possibilities. In addition to comprehending the possibilities of the medium, the students will become aware of the limitations. In under-
24
Computer Graphics
standing the limitations, they will find creative solutions to express similar ideas in a different way, thus pushing the digital medium. Not only will the students learn to communicate their ideas verbally, but with practice they will develop and understand their visual intentions. This is demonstrated in Figures 46, which depict scenes from recent student work depicting the harsh treatment of those jailed in Tibet. Images are seen through the eyes, but the perception of them is something that happens in concert with the mind and other body memories. W i t h o u t background in visual literacy, students often do not express perception and they do not understand why they chose certain formal aspects of their artwork, or even what they are trying to say. After learning about visual literacy, students show an understanding of how their choices impact the perception of the work. When asked about their art, students describe their work through a formal analysis coupled with ideas or meaning instead of, "Well, it looks cool." Future Possibilities Especially helpful for art students would be to develop tools similar to TERA for leaning terminology for a larger scope of digital media including 2D imagery, digital sculpture and time-based works such as 2D and 3D animation, interactivity and non-linear video editing. Such tools would also be enormously useful to computer science students taking courses in multimedia, humancomputer interaction and Web development. An additional goal is to establish a taxonomy for critically analyzing digital art work which includes a discussion of meaning, formal qualities and the success of communicating ideas. This would be similar to that of Feldman's approach [3], but would incorporate terminology and ideas relevant to digital technology. References I. Arnheim, R. Art and Visual Perception, Berkeley: University of California Press, 1974. 2. Dewey, J. Art as Experience, New York: Perigee Books, 1934. 3. Feldman, E. Varieties of Visual Experience, Englewood Cliffs, NJ: Prentice Hall, Inc., 1967. 4. Wolfe, R. and A. Sears. TERA: An Interactive Tool for Teaching Computer Graphics, Journal of Computing in Small Colleges 10 (4), pp. 41-46, February 1995.
