MULTIMEDIA
MULTIMEDIA CONCEIPTS TO BE COVERED
What is multimedia?
Historical development of multimedia
Multimedia devices
List types of multimedia devices
Minimum requirements for multimedia
Name areas where multimedia is being used
Sound and video
Describe the concept of sound and audio
Explain element of audio
Describe steps of make sound for multimedia
Video recording/shooting
Explain the concept of video recording
Outline the steps to capture a single frame
Outline the steps to capture multiple frames
Video Editing
Explain the concepts of video editing
Use video editing software
Video compression
Describe video compression
Explain various ways of carrying out video compression
Interactive media
Describe interactive contents
The History of Multimedia
Multimedia is the media that uses multiple forms of
information content and information processing (e.g. text, audio,
graphics, animation, video, interactivity) to inform or entertain
the user.
Multimedia also refers to the use of electronic media to store
and experience multimedia content.
Multimedia is similar to traditional mixed media in fine art, but
with a broader scope. The term "rich media" is synonymous for
interactive multimedia.
In the strictest sense of the word, multimedia simply means
more than one medium
Multimedia is a media that uses multiple form of information
content and information processing.
Where Did It All Begin?
Multimedia has come a long way from its humble roots to today's
cutting-edge modern animation and interactivity
In the real world, though, when most people talk about multimedia,
they are talking about computer multimedia. The word has come to
represent the realm of computer graphics, video games, on-screen
presentations, and a whole world of other possibilities.
That is hard to say, but one of the earliest and best-known examples
of multimedia was the video game Pong. Developed in 1972 by Nolan
Bushnell (the founder of a then new company called Atari), the game
consisted of two simple paddles that batted a square "ball" back and
forth across the screen, like tennis. It started as an arcade game, and
eventually ended up in many homes
A New Revolution In 1976, another revolution was about
to start as friends Steve Jobs and Steve Wozniak founded
a startup company called Apple Computer. A year later
they unveiled the Apple II, the first computer to use color
graphics. The computer revolution moved quickly: 1981
saw IBM's first PC, and in 1984 Apple released the
Macintosh, the first computer system to use a graphical
user interface (GUI). The Macintosh also bore the first
mouse, which would forever change the way people
interact with computers
In 1985, Microsoft released the first version of its
Windows operating system. That same year, Commodore
released the Amiga, a machine which many experts
consider to be the first multimedia computer due to its
advanced graphics processing power and innovative user
interface. The Amiga did not fare well over the years,
though, and Windows has become the standard for
desktop computing.
Innovations Both Windows and the Macintosh operating
systems paved the way for the lightning-fast developments
in multimedia that were to come. Since both Windows and
Mac OS handle graphics and sound – something that was
previously handled by individual software applications –
developers are able to create programs that use multimedia
to more powerful effect.
One company that has played an important role in
multimedia from its very inception is Macromedia (formerly
called Macromind). In 1988, Macromedia released its
landmark Director program, which allowed everyday
computer users to create stunning, interactive multimedia
presentations. Today, Macromedia Flash drives most of the
animation and multimedia you see on the Internet, while
Director is still used to craft high-end interactive productions.
Each new development of each passing year is
absorbed into next year's technology, making the
multimedia experience, better, faster, and more
interesting.
What is Hypertext and Hypermedia?
Hypertext is a text which contains links to other texts.
The term was invented by Ted Nelson around 1965.
Hypermedia is not constrained/limited to be text-
based. It can include other media, e.g., graphics,
images, and especially continuous media – sound and
video.
Example Hypermedia Applications?
The World Wide Web (WWW) is a clear example of a
hypermedia application.
PowerPoint
Adobe Acrobat (or other PDF software)
Adobe Flash
The Basic Elements of multimedia
are;
Text
Graphic such as charts and drawings
Video
Audio
Images
TEXT
TEXT characters that are used to create words, sentences,
and paragraphs.
Source of texts can be: keyboard, speech input, optical
character recognition, data stored on disk.
Texts are stored by input character by character: Storage of
text is 1 byte per char / more bytes for Unicode. For other
forms of data (e.g. Spreadsheet files), May store format as
text (with formatting) others may use binary encoding.
Examples of Text Format : Raw text or formatted text e.g.
HTML, Rich Text Format (RTF), Word or a program language
source (Java, Python, MATLAB etc.)
Graphics
Graphics: A digital representation of non-text
information, such as a drawings and charts
Graphics Formats can be: constructed by the composition
of primitive objects such as lines, polygons, circles,
curves and arcs.
Input source: Graphics are usually generated by a
graphics editor program (e.g. Illustrator) or automatically
by a program (e.g. Postscript).
Graphics are usually editable or revisable (unlike
Images). Graphics input devices: keyboard (for text and
cursor control), mouse, trackball or graphics tablet.
Animation
Animation
Flipping through a series of still images. It is a series of
graphics that create an illusion of motion
Video
Video
A photographic images that are played back at speeds of 15 to 30
frames a second and the provide the appearance of full motion.
Input: Analog Video is usually captured by a video camera and then
digitized. Raw video can be regarded as being a series of single
images.
The most commonly used video file formats are;
AVI – developed by Microsoft
FLV – Adobe flash player
WMV- video file format designed by Microsoft
MP4(MPEG4)
MOV- video file format designed by apple
WebM – Developed by Google
AVCHD (Advanced Video Coding High Definition) – designed
Audio
Audio
Audio signals are continuous analog signals.
They comprised of music, speech, or any other sound.
Input source: microphones and then digitized and
stored in CD Quality Audio.
Usually compressed (E.g. MP3, AAC, Flac, Ogg Vorbis).
Images
Images : Images whether represented analog or digital plays a vital role
in a multimedia. It is expressed in the form of still picture, painting or a
photograph taken through a digital camera.
Input: digitally scanned photographs/pictures or direct from a digital
camera, they may also be generated by programs “similar” to graphics
or animation programs. Stored at 1 bit per pixel (Black and White), 8 Bits
per pixel (Grey
The most used image file format are:
JPEG (Joint Photographic Experts Group)/JFIF(JPEG Interchange Format)
TIFF (Tagged Image File Format), RAW,
DNG (Digital Negative Format),
PNG (Portable Network Graphics),
GIF (Graphics Interchange Format),
BMP (Bitmap Image File),
PSD (Photoshop Document)
MULTIMEDIA DEVICES
Webcam
A webcam is a simple digital camera capable of taking video or still
images for transmission over the Internet. Unlike digital cameras
(next section), webcams don't include storage capabilities.
Digital Camera
Digital cameras have largely replaced film cameras for both amateur
and professional photography. They use CMOS or CCD image sensors
to record images onto internal or card-based flash memory
MIDI Music and MIDI Ports
Musical instrument digital interface (MIDI) music is created from
digitized samples of musical instruments that are stored in the ROM
or RAM of a MIDI device (such as a sound card) and played under the
command of a MIDI sequencer.
Sound Card
Sound cards are used to record and play back analog
audio, and most can also play back digital audio sources
as well. When recording analog audio sources such as
CDs, line in or microphone in, sound cards digitize the
audio at varying sample rates and store files in either
uncompressed forms such as WAV or compressed forms
such as WMA or MP3.
Microphone
Microphones plug into the 1/8-inch mini-jack microphone
jack on a sound card or integrated motherboard audio.
Video Capture Card
As the name suggests, video capture cards are used to
capture live video from various sources, including analog
camcorders, VCRs, analog output from DV camcorders,
broadcast TV, and cable TV.
Minimum requirements for
multimedia system
To Develop a multimedia systems we need some minimum
hardware/software requirements or components as follows;
Hardware requirements
CPU – The CPU required for multimedia has to be Pentium IV
and other advanced chips
Input/output devices – Keyboard and mouse are two
important components for any multimedia PC
Capture devices — Video Camera, Video Recorder, Audio
Microphone, Keyboards, mice, graphics tablets, 3D input devices,
tactile sensors, VR devices.
Hardware Storage Devices — Hard disks, CD-ROMs, DVD-ROM,
etc Multimedia uses digitized audio and video which not only took
huge amount of storage but also requires high speed storage
media.
Communication Networks — Local Networks, Intranets,
Internet, Multimedia or other special high speed networks.
Computer Systems — Multimedia Desktop machines,
Workstations, MPEG/VIDEO/DSP
Hardware Display Devices — CD-quality speakers, HDTV,SVGA,
Hi-Res monitors, Color printers etc. The multimedia PC should be
equipped with the monitor having Super Video Graphic Arrays
(SVGA) card. The basic advantage of having SVGA is that it has a
better resolution, thus a display will be of a better quality for the
graphics and pictures.
Minimum requirements for
multimedia
DVD – Digital video Disk technology improves the storage
capacity 4.7 to 17 Gigabytes.
Sound card – Sound output from a computer has been a a
feature of a machine usually used for sending out warning
and error signals from computer games and other
multimedia contents that require the use of audio device.
PhotoCD – It is used to save photos in a compressed format
in PC
RAM – Random Access Memory is another essential
hardware part of a multimedia system
Minimum Software requirements
for multimedia
Software Requirements
We can classify multimedia software as system software and
authoring tools used to develop multimedia applications.
Examples are;
Video for windows
QuickTime
Microsoft Multimedia Technologies
Some of the recent software used in multimedia industry are;
Photoshop
Director
Premiere
Sound Edit
Flash
USES OF MULTIMEDIA
Multimedia finds its application in various areas including, but
not limited to:
Advertisements
Education
Fine Art
Entertainment
Science and technology
Medicine
Use of Multimedia in Architecture & Interior Designing
Scientific research
Mass media and journalism
Engineering
The use of multimedia in fashion design
Advertisements
Multimedia plays a great and a vital role in the field of
advertising. As whatever it is whether print or electronic
advertisement, they first are prepared on the computer by using
professionals’ software’s and then it is brought in front of the
target audiences.
Some of different types of advertising are:
Print advertising
Radio (audio) advertising
Television (video) advertising
Digital advertising
Display Ads
Video
Social ads
Mobile advertising etc.
The use of multimedia in education
Nowadays the classroom need is not limited to that traditional
method rather it needs audio and visual media. With the use of
multimedia everything can be integrated into one system. As an
education aid the PC contains a high-quality display with mic
option. This all has promoted the development of a wide range of
computer-based training like online training.
Use of Multimedia in Mass Media and Journalism
Nowadays it’s not only the text that we can see in the
newspaper, but we can also see photographs in newspaper, this
not only makes newspaper a perfect example but will also
explain the worthiness of hypermedia.
Use of Multimedia in Gaming Industry
One of the most exciting applications of multimedia is games.
Nowadays the live internet is used to play gaming with multiple
players has become popular.
In fact, the first application of multimedia system was in the field
of entertainment and that too in the video game industry. The
integrated audio and video effects make various types of games
more entertaining.
Use of Multimedia in Science and Technology
Multimedia had a wide application in the field of science and
technology. It is capable of transferring audio, sending message
and formatted multimedia documents. At the same time, it also
helps in live interaction through audio messages and it is only
possible with the hypermedia. It reduces the time and cost can
be arranged at any moment even in emergencies.
Medicine
The role of multimedia in the field of medicine is increasing at a
tremendous rate. Medical images and videos are used for the
documentation and monitoring of progression of diseases as well
as the response to treatment strategies. Digital images such as X-
RAYS, CT-SCANS and MRI are used for diagnosis of various
diseases.
Also Doctors can be trained by looking at a virtual surgery
Fine Art
In fine arts, there are multimedia artists, who blend techniques
using different media that in some way incorporates interaction
with the viewer. There is a new term for such artists i.e. digital
artists. Digital artists are those who use computer apps to create
digital paintings
Use of multimedia in Engineering
Software engineers often use multimedia in computer
simulations for anything such as military or industrial training.
Example the use of simulations in pilot trainings.
Use of multimedia in Research
In the area of mathematical and scientific research, multimedia is
primarily used for modelling and simulation. For example, looking
at a molecular model by a scientist of a particular substance and
manipulate it to arrive at a new substance.
Use of Multimedia in Architecture & Interior
Designing
Gone are the days when architects and interior designers
used to plan everything manually which was completely
inaccurate and unprofessional. Now due to multimedia there
are various software like AutoCAD, Revit, SketchUp, 3Ds
Max which can be used to create 2d plans, plan rendering,
and realistic walk-through of a project easily.
The use of multimedia in fashion design
Fashion design is the industry which has leveraged the complete
creative power of multimedia. Fashion designers use multimedia
right from the planning to the publishing, in every stage.
They sketch, paint, and prepare 3D models using multimedia
only. They prepare special background music for their shows too.
CLASS WORK
What is Data Compression
What are the two types of data compression
Differentiate between the two types of compressions by
giving 5 key points
Characteristics of a multimedia systems
Multimedia systems have the following
characteristics:
i. They are computer-controlled
ii. They integrate and process more than one form of
information
iii. They handle information that is represented digitally
iv. The interface that presents multimedia content is
usually interactive
For a multimedia system to work effectively
the following aspects are important
The following are factors for an effective multimedia system.
a) High processing power: This processing power is required to deal
with high speed data processing and real time delivery of multimedia
content. Because multimedia content more than one media element,
including high-resolution graphics and quality video, faster
processors are required for better performance.
b) Multimedia Capable file formats: This file format is required to
deliver real time media, e.g. Rich Text Format (RTF) for a text, or Joint
Photographic Expert Group (JPEG) for images, or Motion Picture
Expert Group 4 (MPEG/MP$) for videos.
c) Efficient and Fast Input/output (I/O): The input and output
to/from the file subsystem needs to be efficient and fast since
multimedia system allow real-time recording as well as playback of
data.
Thefollowing are factors for an effective
multimedia system.
a) Large storage and Memory capacity: Large storage
and memory capacity are required for efficient
management of multimedia content. Because
multimedia involves graphics of high resolution and
high-quality video and sound, it requires large amount of
storage space.
b) Reliable Network support: If delivery is via network
or Internet involving client-server systems, a reliable
network is required to share, retrieve, and display
multimedia content.
c) Software (Application or system): Software are
needed to access, retrieve, share or display multimedia
Categories of multimedia system
devices
Multimedia devices can be grouped into three categories: input,
output and storage devices.
Input devices
The following are examples of multimedia input devices.
i. Keyboard: used to input a text for multimedia content.
ii. Digital cameras, scanners and CD-R/DVD-R: used to store and
playback audio, video and images of multimedia content.
iii. Musical Instrument Digital Interface (MIDI) based keyboard, CD
and Microphones: used to capture and playback audio of
multimedia content.
iv. Mice, track balls, joy sticks, and light pens: used for spatial data
input.
v. Modem and network interfaces card: used for network data input.
Multimedia devices can be grouped into three
categories: input, output and storage devices.
Output devices
i. Computer: Monitor for displaying video, images, text and
motion graphics.
ii. Projector: for displaying text, graphics, and videos.
iii. TV screen: For displaying multimedia content
iv. Smartphone display screen: For displaying multimedia
content.
v. Colour printers: for printing multimedia content
vi. Speaker or any other MIDI interfaces for producing sound
Multimedia devices can be grouped into three
categories: input, output and storage devices.
Storage devices
i. Hard Disk Drive e.g. Serial Advanced Technology
Attachment (SATA) or Solid State Drive (SSD)
ii. CD-Rs/DVDRs
iii. Flash disk/USB Memory Stick
iv. Memory Card . E.g. Secure Digital (SD) Cards or Micro SD
Cards
Interactive media
Interactive media, also called interactive multimedia, any
computer-delivered electronic system that allows the user to
control, combine, and manipulate different types of media,
such as text, sound, video, computer graphics, and animation.
Interactive media are means of communication in which the
output values depend on inputs. This means that the user is
actively involved in the communication. The media still has the
same purpose, but entries or inputs made by user create the
interaction and some interesting options when it comes to the
output of the system.
One of the most important characteristics of interactivity is
the interaction between user and machine, where each of them
has an active role.
Interactive media
Interactive multimedia allows the user to control, combine, and
manipulate a variety of media types, such as text, computer graphics, audio
and video materials, as well as animation.
Interactive multimedia integrates computer, storage, data, phone, TV,
and other information technologies.
The most common interactive multimedia applications include education and
training programs, video games, electronic encyclopedias, and travel guides.
Television and radio are the most common examples of non-interactive
media.
Examples of interactive media include social media, virtual reality, and
apps.
Interactive media was brought upon by the Internet revolution of
the 90s and improved technology, such as smartphones.
The uses of interactive media are far and wide, from education to
networking to video games.
WAYS OF CARRYING OUT INTERACTIVE CONTENTS
The interaction can be observed as a dialog between the user
and the computer. The choice of interface style can have a
profound effect on the nature of a dialog. There is a great
number of common interface styles including:
Command line inside the interface
Menus
Natural language
Dialogs with inquiries, questions, and answers
WIMP (windows, icons, menus, pointers) interface
3D interfaces
ELEMENTS OF INTERACTIVE MEDIA
Unlike traditional media, interactive media is meant to
enhance a user's experience. In order to do so, an
interactive medium will require one more of the following
elements:
Moving images and graphics
Animation
Digital Text
Video
Audio
Importance of interactive content
Interactive content has several benefits including the following:
a) Increases awareness and attention of users: since the content
requires active participation of the user, it increases awareness and
attentiveness
b) Greater social engagement: The content allows more than one
individual to interact with it in the form of competition and hence
promoting social interaction among them.
c) Increases exposure: Because the interaction with content involves
more than one sensory organ and hands-on activity, a user becomes
familiar with the content very easily, and cannot forget the content
easily.
d) Reduce risks: Interactive content can be used in simulation,
particularly in learning, instead of real practical's which involves high
risks such as experiment with harmful chemicals. In such cases
simulation reduces the risk of accident in particular work.
Characteristics of interactive
content
User-controlled and adaptable: Interactive content allows
learners/users to control the pace of navigation, for example,
speed of audio, video or running simulations.
Promote active engagement: Interactive content allows
active engagement, for example, a self-instructional mode of
learning, whereby a learner performs specific actions required
for learning.
It has a specific target: Interactive content is usually
designed for a particular target group. Examples of
interactive content that target specific groups are keyboard-
controlled games, keyboard typing skills programs for
beginners, interactive drawing activities for children, children
speaking drills, children writing drills, student electronic
assessment, and interactive numeracy courses for children.
… Characteristics of interactive
content
Comprehensive: In teaching and learning, for example,
Interactive content often stick to concepts or skills required
for learners to gain the intended competences. Sometimes
the program scene does not allow users to continue to a
next stage before mastering the prerequisites.
Immediate feedback: In teaching and learning, for
example, Interactive content can provide immediate
feedback to learners, giving them insight that can enable
them to learn more. An example of immediate feedback is
found in interactive electronic assessment.
Difference between Lossy Compression and
Lossless Compression
Data Compression refers to a technique where a large file
to reduced to smaller sized file and can be decompressed
again to the large file. Lossy compression restores the large
file to its original form with loss of some data which can be
considered as not-noticable while lossless compression
restores the large file to its original form without any loss of
data.
Following are some of the important differences between
Lossy Compression and Lossless Compression.
Key Lossy Compression Lossless Compression
Data Lossy compression eliminates Lossless compression keeps even
Elimination those bytes which are considered those bytes which are not-noticable.
as not-noticable.
Restoration After lossy compression, a file After lossless compression, a file can
cannot be restored to its original be restored to its original form.
form.
Quality Lossy compression leads to No quality degradation happens in
compromise with quality. lossless compression.
Size Lossy compression reduces the Lossless compression reduces the
size of file to large extent. size but less as compared to lossy
compression.
Algorithm Transform coding, Discrete Cosine Run length encoding, Lempel-Ziv-
used Transform, Discrete Wavelet Welch, Huffman Coding, Arithmetic
transform, fractal compression etc. encoding etc.
KEY LOSSY COMPRESSION LOSSLESS COMPRESSION
Uses Lossy compression is used Lossless compression is
to compress audio, video used to compress text,
and images. images and sound.
Capacity Lossy compression Lossless compression has
technique has high data low data holding capacity
holding capacity. as compared to lossy
compression.
Key Questions
What is Multimedia?
What are the multimedia software’s?
What are the multimedia Hardware’s?
What is Animation?
What are WMV files?
What is Video-on-demand?
What is interactive multimedia?
What is the differences between MP3 and MP4?
What is rendering as it is used in Multimedia/
Mention the major uses of Multimedia
What are the areas where Multimedia elements are used?
What is Virtually reality?
What are the common files used in Multimedia?