I. Introduction
A. Uses of multimedia information
B. Historical background
II. Survey of hardware
A. Graphic boards and accelerators
B. Sound boards
C. Video capture boards
D. Magnetic and optical storage devices
E. DVD. Blu-Ray, HD-DV (macrovision, VCDs, SVCDs, VOBs, ripping techniques)
III. Survey of software
A. Graphic standards
B. Music computer formats
C. Video computer standards
D. Gaming
E. Authoring Systems
IV. Multimedia Platforms (QuickTime, MCI, Video for Windows, Activemovie, Direct-X)
V. Multimedia Programming (Java, Active-X, MCI, Windows Foundation Classes)
VI. The creative process: hardware, software, development team and methodology
VII. Media Types – Media Objects (Implementations and methods)
A. Text
1. Encoding – ASCII, Unicode
2. Formatting – in-line (.dot notation, HTML, SGML)
3. Page description languages – Adobe pdf
B. Image
1. bit mapped vs. vector based representations
2. Color Space Representations – RGB, CMY, HSU
3. CLUTs
4. color depth and resolution
5. Image File Formats BMP, GIF, JPEG, PNG, TIFF
6. Editing tools and effects (pixel methods, masking, morphing, etc.)
C. Graphics – Internal and external modeling techniques, mapping, lighting, viewing and rendering
D. Audio
1. The physics of sound
2. Sound fields, the environment and acoustics – multi-channel/surround sound
3. quantization and sampling rate
4. The Nyquist theorem
5. Audio formats
6. Digital encoding (PCM, ADPCM, A-law/m-law
7. Digital Audio Effects & Filtering
E.
Music –
F. Video – analog, digital and broadcast
1. Luminance and Chrominance representations
2. Fields, frames and interlacing
3. Color encoding (Camera, transmission and receiver: RGB, YUV, YIQ, YCbCr)
4. RF, Composite, S-Video and Component video
5. NTSC and HDTV
6. Editing techniques (traditional vs. NLE systems)
7. Transitions, keying, and scaling
8. Storage and distribution
G. Animation – Modeling & Rendering
H. Video Conferencing
I. Other Media types (speech, digital ink, virtual reality)
VIII. Multimedia and the Internet
A. WWW
B. Web browsers
C. HTML, VRML, CGI, Active-X and Java
IX. System survey (multimedia examples taken from science, entertainment, gaming, etc.)
X. Design issues
A. System design issues
B. Implementation issues
C. Usability evaluation
XI. Compression Techniques
A. Requirements
B. Basic information theory
1. Entropy vs. energy
2.
3. entropy vs. source encoding
C. General Purpose compression algorithms
1. Run Length Encoding
2. Relative Encoding
3. Huffman Coding
4. Arithmetic Coding
5. Lempel-Ziv Coding
D. Intraframe compression algorithms
1. Sub-sampling
2. Course quantization
3. Vector quantization
4. Transform encoding
E. Interframe Compression algorithms
1. Sub-sampling
2. Difference coding
3. Block based difference coding
4. Block based notion compensation
F. JPEG and the DCT
G. MPEG file structure and I-, P-, B-frames
H. Practical compression techniques
1. mp3,
2. DivX, MPEG-4
Outline.doc(01/18/08)