<p>Since this question asks for an intuition behind the idea:</p>
<p><a href="https://stats.stackexchange.com/q/633476/287262">What is the intuition behind the idea that for linear regression, the number of observations should exceed the number of parameters?</a></p>
<p>I thought I might also add something that is not about a linear regression but might lead to the same intuition. Therefore, I wrote about the problem of a logistic regression instead, and my <a href="https://stats.stackexchange.com/a/633501/362671">answer</a> got deleted. I see the point that this was too far-fetched, but my idea when I heard that observations should exceed the number of parameters was that <a href="https://stats.stackexchange.com/q/469799/287262">Why is logistic regression particularly prone to overfitting in high dimensions?</a> also showed this intuition to me.</p>
<p>I doubt that it was even right to see both questions as dealing with the <em>same</em> intuition, so that this question here is not about reopening the deleted answer (unless someone wants to). Yet, the answer was not deleted for being wrong, as far as I can see, but just since it was not about linear regression, at least if you check the only upvoted remark for this (which was again upvoted right before the answer was deleted).</p>
<p>If I show that in other models, you also have to avoid that the number of parameters (or dimensions) are too many, is this clearly off-topic for a question that asks about &quot;the intuition of the idea that for linear regression, ...&quot;? Mind that the question also becomes clearer in the body:</p>
<blockquote>
<p>If a population model has k independent variables and 1 intercept, why
are k+1 observations required to perform OLS estimates?</p>
<p>What is the intuition behind this?</p>
</blockquote>
<p>But even then, the other link about logistic regression might lead to this intuition, or take anything else that is not about linear regression and still helps understanding this.</p>
<p>Is the wording of the question right? English is not my mother tongue, and I understood it as a much broader question.</p>
