NCA-AIIO

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/20

encourage image

There's no tags or description

Looks like no tags are added yet.

21 Terms

1
New cards

Artificial Intelligence (AI)

Broad field of computer science focused on building systems that perform tasks requiring human-like intelligence.

2
New cards

Machine Learning (ML)

Subset of AI where systems learn patterns directly from data instead of following hand-written rules.

3
New cards

Deep Learning (DL)

Subset of ML using neural networks with many layers, requiring large datasets and heavy computation.

4
New cards

Generative AI

Branch of artificial intelligence focused on models that create original content such as text, images, audio, and code.

5
New cards

Large Language Model (LLM)

Transformer-based model trained on vast amounts of text to understand, process, and generate natural language.

6
New cards

Training

Process of adjusting a model's weights by learning from data, typically requiring heavy computation on multi-GPU clusters.

7
New cards

Inference

Stage of using a fully trained model in production to generate predictions or outputs continuously for users.

8
New cards

Fine-tuning

Process of further training a pretrained model on smaller, task-specific datasets to adapt it for a distinct use case.

9
New cards

Accelerated Computing

Use of specialized processors (like GPUs) alongside traditional CPUs to speed up compute-intensive workloads.

10
New cards

CPU vs. GPU Architecture

Hardware distinction where sequential processing uses a few powerful cores, whereas parallel processing uses thousands of simpler cores built for matrix math.

11
New cards

CUDA

NVIDIA's parallel computing platform and programming model that forms the foundation of its software stack.

12
New cards

CUDA-X

Collection of GPU-accelerated libraries built on top of parallel computing platforms, including cuDNN, cuBLAS, and NCCL.

13
New cards

cuDNN

GPU-accelerated library providing deep neural network building blocks for frameworks like PyTorch and TensorFlow.

14
New cards

NCCL

NVIDIA Collective Communications Library providing fast multi-GPU data exchange across single or multi-node systems.

15
New cards

NGC

Catalog of GPU-optimized software containing containers, pretrained models, Helm charts, and SDKs.

16
New cards

NVIDIA AI Enterprise

Licensed, enterprise-supported software suite for building and deploying production AI applications.

17
New cards

Triton Inference Server

Open-source software designed to serve models from multiple frameworks in production with features like dynamic batching.

18
New cards

TensorRT

SDK that optimizes trained models for high-speed execution on GPUs via layer fusion and lower precision (FP16/INT8).

19
New cards

NIM

NVIDIA Inference Microservices that package optimized models with standard APIs inside prebuilt containers for rapid deployment.

20
New cards

RAPIDS

Suite of GPU-accelerated software libraries for data science and data processing.

21
New cards

On-Premises vs. Cloud Infrastructure

Deployment model contrasting owned hardware (capex, full control) with rented, elastic hardware (opex, pay-as-you-go).