Questions tagged [vc-dimension]
The VC dimension (for Vapnik–Chervonenkis dimension) is a measure of the capacity (complexity, expressive power, richness, or flexibility) of a statistical classification algorithm, defined as the cardinality of the largest set of points that the algorithm can shatter.
49 questions
-1 votes
1 answer
117 views
How to calculate the growth function of a hypothesis class?
I have this hypothesis class: H = {ha : R → {0, 1} | a > 0, a ∈ R, where ha(x) = 1−a,a = { 1, x ∈ [−a, a] 0, x ̸ ∈ [−a, a] } I need to compute the growth function for m>= 0. So I think that this ...
1 vote
0 answers
446 views
Infinite VC Dim not PAC learnable
This is usually shown by an application of the Statistical No Free Lunch Theorem. But is this possible to show this by working simply with the definition of PAC learnability and the sample complexity ...
1 vote
1 answer
439 views
How can I understand the proof of the VC dimension of half-spaces in d-dimensions?
Statement : A half space is set of all points on one side of a linear separator, i.e., a set of the form $\{x \mid w^{T}x \ge t\}$. The VC-dimension of half spaces in $d$-dimensions is at least $d+1$. ...
2 votes
0 answers
85 views
Multi-class sample complexity for PAC learning using "VC dimension"
VC dimension covers the binary classification case, i.e. when we want to get a predictor $X \to \{0, 1\}$. Using VC dimension, we can get the upper bound on the sample complexity for PAC-learning. In ...
1 vote
0 answers
48 views
pseudo dimension of the minimum of functions
Suppose a real-valued function class $\mathcal{F}$ with pseudo dimension less than $d$, I am wondering what is the pseudo dimension of the following function class \begin{equation} \mathcal{F}_2 = \{\...
1 vote
0 answers
145 views
Hoeffding's inequality applicability for sample complexity
I am trying to determine some bounds for sample complexity. Suppose we have a bounded loss function $\ell$ and target function $f:\mathcal{X}\to\mathcal{Y}$. Hypothesis $h$ is learned, then the ...
0 votes
1 answer
168 views
Uniform convergence of union of hypothesis
Let $H_{1}$ and $H_{2}$ are two hypothesis classes over some domain $X$1. If both $H_{1}$ and $H_{2}$ have the uniform convergence property, then do $H_{1}$ U $H_{2}$ have uniform convergence?
0 votes
0 answers
69 views
Question about machine learning
Hello everyone I am new to the site, I have a question that was in the test and did not understand the parts that are in the question. This question from a test I failed to pass, in a machine learning ...
2 votes
1 answer
130 views
prove that 2 collection have the same VC-dimensions
I'm new here on the site, I'm a final year student in computer science. In a machine learning course, there was a question on a test that I could not understand. The question goes like this: Suppose ...
1 vote
1 answer
610 views
Proof of Calculating VC-Dimensions
I still have some doubts for finding the VC-dimension. Suppose $\mathcal{H}$ has VC-dimension $n$. This is the process of how I think about it: (1) Show that there is a set of $n$ points that can be ...
1 vote
1 answer
560 views
VCdim of concentric circles
I have researched this topic in the last time, but no usefull results for me. So I'm here and I please you to help me with the following problem: What is $VCdim$($\mathcal{H}$), where $\mathcal{H}$ is ...
1 vote
0 answers
162 views
VC Dimension of the class of $k$-dimensional cross-polytope (1-norm ($l_1$) ball)
What is the VC Dimension of the class of $k$-dimensional cross-polytope (1-norm ($l_1$) balls)? A $k$-dimensional $l_1$ ball with radius $r\in \mathcal R$ and center $\mathbb v\in \mathcal R^k$ is $\{\...
0 votes
1 answer
192 views
Pseudo-dimension of a subset of affine functions
Let's say there are two sets of affine functions. $\mathcal{A} = \{ax +b \mid a,b \in \mathbb{R}\}$ $\mathcal{H} = \{2x + 1, x, 3x + 4, 4x\}$ I know that the $\mathrm{Pdim}(\mathcal{A}) = 2$. From ...
0 votes
0 answers
294 views
VC dimension of a combination of two hypothesis classes
I have found this exercise and I cannot solve it: In $X=\mathbb R^2$, let's observe two models $H_1$ (rectangle with sides parallel to the coordinate axes) and $H_2$ (lines). We define a model $H_3$ ...
0 votes
0 answers
188 views
VC dimension of axis-aligned hyperplanes and their complements
This is a problem of VC that I've been trying to solve. Any help is appreciated. Let's assume hypothesis classes $H_{\mathit{init}}$ of initial segments over domain $X = \mathbb R$ and $H_{\mathit{...