Here’s the trick:
apt-get install postfix libsasl2 sasl2-bin libsasl2-modules libdb3-util procmail
Got it from here. I chose Internet Site as my configuration option. I was afraid this would require further configuration to work with PHP, but it’s actually working fine, so I’m really happy.