AI 2 (Confidence certificates for classification)

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/13

encourage image

There's no tags or description

Looks like no tags are added yet.

14 Terms

1
New cards

What is formula for True Error?

knowt flashcard image
2
New cards

What is the problem with True Error (CD)?

The quantity is unknown as distribution is unknown

3
New cards

What is the formula for Observed error (ĉS)?

knowt flashcard image
4
New cards

Is cD a deterministic quantity (a number) or a random variable?

If c is a fixed function then cD is deterministic (a number in [1,0]), if c is the classifier trained on sample S then cD is a random variable as a function of c

5
New cards

What is the distribution of n * ĉS ?

knowt flashcard image
6
New cards

What is Binomial CDF (cumulative distribution function)?

knowt flashcard image
7
New cards

What is the pivot of the cumulative?

The largest True error such that the probability observing k or fewer errors in n trial (test points) is at least the confidence interval (δ), where p is the True Error.

<p>The largest True error such that the probability observing k or fewer errors in n trial (test points) is at least the confidence interval (δ), where p is the True Error. </p>
8
New cards

What is an upper bound approximation (pivot of cumulative) that is simpler to compute but makes the bound less tight (Corollary)?

knowt flashcard image
9
New cards

What does the Test Set Bound tell us?

knowt flashcard image
10
New cards

What is S?


<p></p>
11
New cards

What would happen if S was a Training sample?

knowt flashcard image
12
New cards

What is Occam’s Razor Bound Theorem?

knowt flashcard image
13
New cards

What is Corollary for Occam’s Razor Bound?

knowt flashcard image
14
New cards

Conclusions of this topic:

knowt flashcard image