<p>It will disappear from the main page after enough other questions have been edited to replace it.  </p>

<p>I think this is actually a feature since it allows the community to <em>see</em> closed questions, and hence be part of the debate around whether they are on-topic, etc.</p>
