It seems as though a recent update to the Apache2 package, upon a fresh install, renders the UserDir module not loaded by default. That is the ability to serve web pages from the ~/public_html directory on a per user basis.
Here's how to quickly enable this module at load time:
# a2enmod userdir
# /etc/init.d/apache2 force-reload