Comprehensive Study Notes on Digital Media, Multimedia, and Image Enhancement

Fundamentals of Digital Media and Multimedia

• Digital Media Definition:

  • Digital: Refers to data in digitized form, specifically represented by numbers, text, and images.

  • Media: Refers to the broadcast or transmission methods such as TV, radio, and the internet.

  • Digital Media: Digitized content delivered via screens and speakers.

  • Examples: Online articles, podcasts, streaming videos, and social media posts.

• Applications of Digital Media:

  • Common types: Software, images, video, games, web pages, social media, audio, documents, and books.

  • Specific examples: $MP3$ files, e-docs, digital images, video games, and websites.

  • Modern Additions:

  • Augmented Reality (AR): Pokémon GO, Snapchat filters.

  • Virtual Reality (VR): Oculus Quest, PlayStation VR.

  • Interactive Web Media: TikTok, Canva templates.

  • Generative AI Content: Firefly, DALL·E, Synthesia.

• Multimedia Elements and Integration:

  • Multimedia is a form of communication combining different media elements into a single interactive presentation.

  • Five Elements of Multimedia:

  • Text

  • Audio

  • Images

  • Animations

  • Video

  • Integration: The process of combining these elements to create interactive experiences, exemplified by TikTok, YouTube, games, and eCommerce.

Audio Quality and Formats

• Audio Engineering Concepts:

  • Audio Codecs: These compress audio for transmission and decompress it upon receipt.

  • Sound Quality Factors:

  • Bitrate: The amount of data in the audio per second, measured in $kbps$. Higher values result in better quality but larger file sizes.

  • Bit Depth: The amount of detail in each sound sample, measured in $bits$. More detail leads to less noise.

  • Sample Rate: The number of sound samples taken per second, measured in Hertz ($Hz$). Higher rates ($44.1 kHz$ or $48 kHz$) provide clearer, more accurate sound but result in larger files.

• Measurement and Common Values:

  • Bitrate: Recommended range is $128\text{--}320 kbps$.

  • Bit Depth: Common values include $16\text{-}bit$ and $24\text{-}bit$.

  • Sample Rate: Industry standards are $44.1 kHz$ (CD quality) and $48 kHz$.

• Reasons for Storing/Exporting Audio:

  • Preview for client approval.

  • Final mix.

  • Collaborative work.

  • Backup purposes.

• Categories of Audio Formats:

  • Uncompressed Formats: Keep all original sound data intact for the highest quality. Files are very large and remain the same size from origin to destination.

  • WAV (Waveform Audio File): Standard for Windows; typically uses $PCM$.

  • AIFF (Audio Interchange File Format): Default for Apple computers; utilizes $PCM$.

  • PCM (Pulse-Code Modulation): The underlying coding for uncompressed audio.

  • Compressed Formats:

  • MP3: Popular for consumer streaming/storage. Achieves compression by removing sounds humans cannot hear. Files are approximately $11$ times smaller than $WAV$ or $AIFF$.

  • AAC: Apple’s alternative to $MP3$, commonly used for Apple Music (iTunes) streaming.

Image Processing: Vector and Raster Graphics

• Vector Graphics:

  • Definition: Created using mathematical formulas to define objects made of points, lines, curves, and shapes.

  • Resolution Independence: Maintains sharpness and quality regardless of resizing or magnification.

  • Object Properties: Stores attributes such as color, size, position, line thickness, line style (solid, dotted), and corner shape (curved, squared).

  • Fills and Gradients:

  • Shapes can be filled with colors, gradients (linear or circular), or patterns (repeating groups of objects).

  • Colors are described by numerical values relative to printing ink.

  • Compound Path (Knockout): A curve placed within a closed object (e.g., a star inside a square) selected as a knockout.

  • Applications: Often created in Adobe Illustrator and saved as $EPS$. Converting to $JPEG$ or $PNG$ may reduce compatibility with layout apps like Canva or Visme.

• Raster (Bitmap) Graphics:

  • Definition: Composed of a grid of pixels, where each pixel has a specific location and color.

  • Resolution Influence: Measured in pixels per inch ($ppi$). High resolution ($high ppi$) means smaller, sharper pixels but larger files.

  • Calculation Example: $8 pixels / 0.0228 inches = 350 ppi$.

  • Scaling: Becomes pixelated or "blocky" when magnified beyond actual size.

  • Color and Bit Depth:

  • Bit Depth: Measures color information per pixel. Higher bit depth equals more colors.

  • $8\text{-}bit$ pixel: Supports $256$ color values.

  • $24\text{-}bit$ pixel: Supports approximately $16 million$ colors.

  • Channels: Hold color information (usually $1$ to $4$ channels based on color mode). An Alpha Channel is used to save selections, particularly in grayscale.

Deep Dive into Image File Formats

• Photoshop ($.psd$):

  • Native layered format for editing components (text, masks, transparency).

  • Supports $8/16/32\text{-}bit$ color and $RGB/CMYK$ modes.

  • Large size (generally limited to $2 GB$).

• Encapsulated PostScript ($.eps$):

  • Supports both vector and bitmap graphics.

  • Allows for mask channels and is commonly used in professional publishing.

  • Usually larger than $TIFF$ files.

• Tagged Image File Format ($.tiff$):

  • Pixel-based, widely supported, and used for archiving and high-quality scanning.

  • Smaller than $EPS$ but cannot include features like halftone screens.

• Graphic Interchange Format ($.gif$):

  • Web format supporting short looping animations.

  • Limited to $256$ colors ($8\text{-}bit$); uses palette-based colors.

  • Best for simple memes/graphics; poor for detailed photos.

• Joint Photographic Experts Group ($.jpeg$):

  • Uses lossy compression; most widely used for photography on the web.

  • Lacks transparency support; repeated saving causes quality degradation.

• Portable Network Graphics ($.png$):

  • Lossless format supporting full alpha transparency ($256$ levels of opacity).

  • Best for logos, icons, and UI elements with transparent backgrounds.

• Scalable Vector Graphics ($.svg$):

  • $XML$-based vector format; infinitely scalable and very small file sizes.

  • Supports $CSS$ styling and interactivity; poor for photographic images.

• Portable Document Format ($.pdf$):

  • Universal format for documents; preserves fonts and layouts across devices.

  • Can contain both vector and raster elements; essential for print-ready submissions.

Color Science and Theory

• Primary Color Models:

  • RGB (Red, Green, Blue):

  • Primary colors of light used for screens.

  • Additive Mixing: Produces lighter colors; wider gamut for digital use.

  • RYB (Red, Yellow, Blue):

  • Traditional artists' model used for pigments.

  • Subtractive Mixing: Produces darker colors; these primaries cannot be created by mixing other colors.

  • CMYK (Cyan, Magenta, Yellow, Black):

  • Used for commercial full-color printing.

  • Subtractive Color: Colors assigned via percentages. Disadvantage: Appears duller than $RGB$ and files are $4$ times larger than grayscale.

• Specialized Color Modes:

  • Duotone: Uses $2$ ink colors to add depth to black and white images; cost-effective for press printing. Varieties include Tri-tone ($3$ colors) and Quad-tone ($4$ colors).

  • Indexed Color: Converts $16 million$ colors to $256$. Reduces file size for the web.

  • Dithering: Using a few colors to create the illusion of more.

• Color Temperature and Organization:

  • Warm Colors: Red, Orange, Yellow.

  • Cool Colors: Blue, Green, Violet.

  • Neutral Colors: Black, White, Grey. These do not lean strongly warm or cool and function as base colors.

• Color Harmony:

  • Complementary: Opposite hues on the color wheel (e.g., Violet and Yellow). Highest contrast; offers bold effects.

  • Analogous: Any three colors adjacent to each other (e.g., Green, Yellow-Green, Yellow).

  • Monochromatic: One color using different shades and tones.

• Human Perception of Color:

  • Bright colors make objects appear larger than dark colors (e.g., a white vase looks bigger than a black one of identical size).

  • Contrast affects intensity: A red circle looks dull on orange but vibrant on blue. A red circle appears larger on black backgrounds than others.

Copyright and Legal Guidelines

• Creative Commons (CC):

  • A system for legal sharing; allows creators to define usage rights via six main license types.

  • Requires giving credit to the creator.

• Types of Property Protected:

  • Literary Works: Books, articles, song lyrics, computer source code.

  • Artistic Works: Paintings, drawings, photographs.

  • Sound Recordings: Tapes, $CDs$.

  • Films: Videos, digital videodisks, television productions.

• Ownership Rights:

  • Performing Rights: Control over public performance, broadcasting, or cable inclusion.

  • Reproduction Rights: Permissions over copying. Includes:

  • Mechanical Rights: Recording onto physical/digital media.

  • Synchronization Rights: Adding work to soundtracks (film/ads).

  • Advertising Rights: Use in commercials/jingles.

• Term of Protection:

  • Literary Works: $70 years$ after creator’s death.

  • Sound Recordings: $70 years$ from first publication.

  • Broadcasts: $50 years$ from end of year recorded.

  • Published Editions: $25 years$ from first publication.

Data Compression and Video Standards

• Lossy Compression:

  • Permanently eliminates redundant info. User usually doesn't notice loss in audio/video.

  • Formats: $JPEG$, $MP3$, $MP4$, $AAC$, $AV1$.

• Lossless Compression:

  • Original and decompressed data are identical. No quality loss.

  • Formats: $PNG$, $GIF$, $FLAC$, $ZIP$.

  • Techniques:

  • Run-Length Encoding (RLE): Counts sequences of repeating symbols. Efficient if average run-length is $> 2$.

  • LZW (Lempel-Ziv-Welch): Translates data sequences into codes ($0\text{--}255$ and up to $4095$). Used in $GIF$ and $TIFF$.

• Video Formats and Codecs:

  • MOV: Apple QuickTime format; high quality but large file size.

  • MP4 ($MPEG-4 Part 14$): Universal sharing format. Uses $H.264$ or $MPEG-4$ for video and $AAC$ for audio.

  • MKV (Matroska Video): Open-source container; can hold unlimited tracks (video, audio, subtitles) and supports lossless audio.

  • H.264 / AVC: Most common codec; supports up to $8K UHD$ at lower bitrates.