12
$\begingroup$

Suppose $(\Omega, \mathcal{A}, P)$ is the sample space and $X: (\Omega, \mathcal{A}) \rightarrow (\mathbb{R}, \mathcal{B})$ is a random variable.

  1. Using language of measure theory, $P(A \mid X)$, the conditional probability of an event given a random variable, is defined from conditional expectation as $E(I_A \mid X)$. So $P(\cdot \mid X)$ is in fact a mapping $\mathcal{A} \times \Omega \rightarrow [0,1]$.
  2. In elementary probability, we learned that $$P(A \mid X \in B): = \frac{P(A \cap \{X \in B\})}{P(X \in B)}.$$ If I understand correctly, this requires and implies $P(X \in B) \neq 0$. So $P(\cdot \mid X \in \cdot)$ is in fact a mapping $\mathcal{A} \times \mathcal{B} \rightarrow [0,1]$.

My questions are:

  1. When will $P(\cdot \mid X)$ in the first definition and $P(\cdot \mid X \in \cdot)$ in the second coincide/become consistent with each other and how?

  2. Is there some case when they can both apply but do not agree with other? Is the first definition a more general one that include the second as a special case?

  3. Similar questions for conditional expectation.

    • In elementary probability, $E(Y \mid X \in B)$ is defined as expectation of $Y$ w.r.t. the p.m. $P(\cdot \mid X \in B)$. So $E(Y \mid X \in \cdot)$ is a mapping $\mathcal{B} \rightarrow \mathbb{R}$.
    • In measure theory, $E(Y \mid X )$ is a random variable $\Omega \rightarrow \mathbb{R}$.

    I was also wondering how $E(Y \mid X \in \cdot)$ in elementary probability and $E(Y \mid X )$ in measure theory can coincide/become consistent? Is the latter a general definition which includs the former as a special case?

Thanks and regards!

$\endgroup$

1 Answer 1

3
$\begingroup$

$$\int_C P(A|X)(\omega)dP(\omega)=\int_C E(I_A|X)(\omega)dP(\omega)=\int_C I_A(\omega)dP(\omega)=P(A\cap C)$$ for $C$ in the sigma algebra generated by $X$. So, for $C=\{X\in B\}$, $$\frac{\int_{\{X\in B\}} P(A|X)(\omega)dP(\omega)}{P(X\in B)}=P(A\mid X\in B).$$

$\endgroup$
9
  • $\begingroup$ @Didier: Right, maybe I should change it to $\omega$. $\endgroup$ Commented Mar 13, 2011 at 17:42
  • $\begingroup$ @Rasmus: Thanks! I was wondering if the two definitions of conditional expectation are related via this relation between the two definitions of conditional probability? $\endgroup$ Commented Mar 13, 2011 at 18:14
  • $\begingroup$ @Tim: Yes, they are -- in a similar way that I have indicated for conditional probability. $\endgroup$ Commented Mar 13, 2011 at 18:20
  • $\begingroup$ see en.wikipedia.org/wiki/… $\endgroup$ Commented Mar 13, 2011 at 18:25
  • $\begingroup$ @Rasmus: It seems to me that $P(\cdot \mid X)$ in the first definition is only connected to the denominator in the definition of $P(\cdot \mid X \in \cdot)$. $P(\cdot \mid X)$ actually does not require the conditioning event in $P(\cdot \mid X \in \cdot)$ to be related to $X$, so $P(\cdot \mid X)$ can in the same way be connected to $P(\cdot \mid C)$ for $C$ seemingly unrelated to $X$. Can I say $P(\cdot \mid X)$ in the first definition and $P(\cdot \mid X \in \cdot)$ in the second are actually totally unrelated in concept, instead of the former is the generalization of the latter? $\endgroup$ Commented Mar 13, 2011 at 20:35

You must log in to answer this question.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.