Computer Graphics
Introduction
Christoph Garth
What is Computer Graphics?
Computer Graphics is concerned with the mathematical and algorithmic foundations for
the generation of images on a computer.
Example: photorealistic rendering of scenes & models
Computer Graphics – Introduction 0.1
What is Computer Graphics?
Computer Graphics is concerned with the mathematical and algorithmic foundations for
the generation of images on a computer.
Example: nearly-photorealistic computer game
Computer Graphics – Introduction 0.2
What is Computer Graphics?
Computer Graphics is concerned with the mathematical and algorithmic foundations for
the generation of images on a computer.
Example: visual effects (VFX) in film production
Computer Graphics – Introduction 0.3
What is Computer Graphics?
Computer Graphics is concerned with the mathematical and algorithmic foundations for
the generation of images on a computer.
Example: technical drawing (CAD) and vector graphics.
Computer Graphics – Introduction 0.4
What is Computer Graphics?
Computer Graphics is concerned with the mathematical and algorithmic foundations for
the generation of images on a computer.
Example: Mathematically inspired computer graphics – Mandelbrot Set and Mandelbulb.
Computer Graphics – Introduction 0.5
Computer Graphics Areas
Modeling Animation Rendering
Modeling and Modeling and Description of Generation of Pixel Images
Description of Scenes Dynamic Scenes from Scene Descriptions
Computer Science Mathematics Physics
Foundations Foundations Foundations
Data Structures & Linear Algebra, Calculus, Physics of Light & Light
Algorithms Stochastics Signal Processing Transport
Computer Graphics – Introduction 0.6
Computer Graphics Areas
Jim Blinn
Pioneer of Computer Graphics
SIGGRAPH98 Keynote Address,
Computer Graphics 33(1), pp. 43-47
• „Modeling is figuring out the shape of it.“
• „Rendering is how to make a picture of it.“
• „Animation is figuring out how it moves with time.“
Computer Graphics – Introduction 0.7
(Photorealistic) Image Synthesis
Rendering Algorithm: Algorithm for Image Synthesis
Which operations are needed to generate a (photorealistic) image of a given scene?
• A photorealistic image is one that is (almost)
indistinguishable from a photograph.
• Aspects of photorealism are often (but not always!) a goal.
• Trade-off between realism and effort
• Physically-based rendering
get the physics right, photorealism automatically obtained, high effort
• Real-time rendering
„fake realism“ – if it looks ok, we may not care about physics accuracy (games and film)
Computer Graphics – Introduction 0.8
(Photorealistic) Image Synthesis
better physics simple lighting
~ 10x effort 1x effort
Example: skin rendering
Computer Graphics – Introduction 0.9
Real-Time Image Synthesis
Unreal Engine 4 - Realtime Photorealism
Computer Graphics – Introduction 0.10
Image Synthesis / Rendering
Inputs:
• Scene description
• Shape, geometry, and movement
of objects
• Appearance
• Color and texture
• Material properties
• Light Sources
• Intensity
• Color
• Direction
• Physics of light transport
Output: Pixel Image(s)
Computer Graphics – Introduction 0.11
Related Disciplines
NOT Computer Graphics:
Image Processing
• Pattern detection in digital images
• Signal processing for images (filtering, convolution, edge detection, …)
Computer Vision
• Computer-based „understanding“ of images
• Perceptual and interpretative processes of the human brain are translated to software.
• Often seen as a sub-area of Artificial Intelligence
Computer Graphics – Introduction 0.12
Related Disciplines
Human-Computer Interaction (HCI)
• User Interfaces (UI, graphical and non-graphical) and User Experience (UX)
• User- and task-focused software design
• Interaction modalities: Virtual and Augmented Reality (VR & AR)
Visualization
• Making data comprehensible through graphical depictions.
• Task-based translation of abstract, measured, or simulated data into images.
Computer Aided Geometric Design
• Representation (data structures) und processing (algorithms) of
arbitrary shapes and objects (free-form geometries).
Computer Graphics – Introduction 0.13
History of Computer Graphics
Foundation Era (1970s to mid-1980s)
• Evolution of specialized raster graphics hardware with limited
but increasing capabilities; dedicated, very expensive graphics
computers.
• Mostly scientific use and high-end applications (design).
• Development of fundamental algorithms and data structures
for photorealistic image synthesis, real-time rendering, and
modeling.
• Development of important rendering techniques (e.g. ray
tracing) and applications (e.g. CAD systems).
Tektronix 4014 computer terminal
Computer Graphics – Introduction 0.14
History of Image Synthesis – Wireframe
Computer Graphics – Introduction 0.15
History of Image Synthesis – Depth Cueing & Attenuation
Computer Graphics – Introduction 0.16
History of Image Synthesis – Color
Computer Graphics – Introduction 0.17
History of Image Synthesis – Hidden Line Removal
Computer Graphics – Introduction 0.18
History of Image Synthesis – Surface Shading
Computer Graphics – Introduction 0.19
History of Image Synthesis – Flat Shading
Computer Graphics – Introduction 0.20
History of Image Synthesis – Phong Shading
Computer Graphics – Introduction 0.21
History of Image Synthesis – Advanced Models & Illumination
Computer Graphics – Introduction 0.22
History of Image Synthesis – Texture Mapping
Computer Graphics – Introduction 0.23
History of Image Synthesis – Bump Mapping
24
Computer Graphics – Introduction 0.24
History of Image Synthesis – Reflection
Computer Graphics – Introduction 0.25
History of Computer Graphics
Commoditization of Graphics (from 1990s)
• Computer architectures and commodity graphics hardware
open up computer graphics to a much wider audience.
• Dedicated graphics hardware (graphics chips / cards) are
cheap and capable; fundmental algorithms are realized in Commodore Amiga 1000
hardware.
• Renaissance of new applications (games!).
Today
• Computer graphics underlies a multi-billion Euro business 3dfx Voodoo Graphics
(computer games and movies)
• Extremely capable hardware / graphics cards allow almost
real-time photorealism.
NVidia RTX 2080
Computer Graphics – Introduction 0.26
Doing Computer Graphics
One can distinguish different levels of computer graphics:
• Graphics research & development
• Development of new rendering techniques, algorithms, data structures.
• Custom software implementations; in-depth knowledge required.
• Graphics programming
• Using graphics libraries and middlewares to implement graphics applications
(e.g. games); medium-level knowledge required.
• End-user graphics
• Tools such Blender, 3D Studio Max or Maya provide comfortable access to modern
computer graphics methods without requiring in-depth knowledge.
Computer Graphics – Introduction 0.27
Graphics APIs and Middleware
A majority of modern computer graphics is hardware-accelerated (i.e. uses graphics hardware).
• Standardized application-programming interfaces (APIs) such as OpenGL, Vulkan (multi-
platform), DirectX (Windows), and Metal abstract from a specific hardware implementation.
These APIs can be used from many programming languages through so-called bindings (e.g.
PyOpenGL). Browser-based 3D graphics are enabled through the WebGL Javascript API.
• So-called middlewares further abstract and simplify frequent and repetitive tasks in specific
areas, e.g. in games development.
For example, Unreal Engine, Unity, and many other so-called engines provide a
comprehensive set of algorithms for all graphics requirements, e.g. model loading, rendering,
animation, etc. This makes it easy to develop games and applications.
Computer Graphics – Introduction 0.29
This Lecture
Foundations and Algorithms for Image Synthesis
• Given a model or scene description, which algorithms are suitable to render images
• under specific constraints, e.g. photorealistic vs. fast
• Essential techniques ranging from model representation and data structures to light
transport simulation and graphics hardware.
The two fundamental approaches to Image Synthesis
• Rasterization and Ray Tracing
Goals:
• Be able to converse with other fluently about computer graphics concepts.
• Apply computer graphics to computer science problems with confidence.
Computer Graphics – Introduction 0.30
Table of Contents (roughly)
Basic Concepts
2D Raster Graphics
Light Transport
Materials & Surfaces
Ray Tracing
Global Illumination
Geometric Models
Coordinate Systems & Transformations
Rasterization Pipelines
Sampling and Anti-Aliasing
Textures & Mapping
Procedural Modeling
Animation
Computer Graphics – Introduction 0.31
Literature
Web:
• scratchapixel.com (foundations and algorithms)
• Wikipedia (many excellent articles and descriptions)
• Google – many pages written by computer graphics enthusiasts
Books:
• Foley, Van Dam, Feiner, Hughes:
Computer Graphics: Principles and Practice, Addison-Wesley, 3rd edition
• Pharr & Humphries
Physically-Based Rendering, Morgan Kaufmann, 2nd edition
• Bender, Brill
Computergrafik: ein anwendungsorientiertes Lehrbuch. Hanser-Verlag
• Shirley, Ashikhmin, Marschner:
Fundamentals of Computer Graphics. CRC Press, 3rd edition
Computer Graphics – Introduction 0.32
