In the post that derives the least squares estimator, we make use of the following statement:
This post shows how one can prove this statement. Let’s start from the statement that we want to prove:
Continue reading Derivation of the Least Squares Estimator for Beta in Matrix Notation – Proof Nr. 1
One reason why the omitted variable leads to biased estimates is that omitting a relevant variable violates assumption 3 of the necessary assumptions of the classical regression model that states that all explanatory variables must be exogenous, i.e.
From this post, we know that omitting a relevant variable from the regression causes the error term and the explanatory variables to be correlated.
Continue reading Omitted Variable Bias: Violation of CLRM–Assumption 3: Explanatory Variables must be exogenous
When studying the classical linear regression model, one necessarily comes across the Gauss-Markov Theorem. The Gauss-Markov Theorem is a central theorem for linear regression models. It states different conditions that, when met, ensure that your estimator has the lowest variance among all unbiased estimators. More formally, Continue reading The Gauss Markov Theorem
In economics, especially in theoretical economics, it is often necessary to formally prove your statements. Meaning to show your statements are correct in a logical way. One possible way of showing that your statements are correct is by providing an indirect proof. The following couple of lines try to explain the concept of indirect proof in a simple way.
Proof of Unbiasness of Sample Variance Estimator
(As I received some remarks about the unnecessary length of this proof, I provide shorter version here)
In different application of statistics or econometrics but also in many other examples it is necessary to estimate the variance of a sample. The estimator of the variance, see equation (1) is normally common knowledge and most people simple apply it without any further concern. The question which arose for me was why do we actually divide by n-1 and not simply by n? In the following lines we are going to see the proof that the sample variance estimator is indeed unbiased.
Continue reading Proof of Unbiasedness of Sample Variance Estimator
Economic Theory Blog 