I tried it for a little while back in 2010 or so, and it was a big pain in the side. Lots of emails would bounce, and blocklists were a big pain point especially because cheap commercial hosts tended to have their subnets range-banned.
The setup was highly manual and involved a lot of moving parts (postfix, courier, mariadb, roundcube, amavis, etc)
It wasn't impossible, mind you, but it occupied too much of my time, and it wasn't nearly as reliable as I needed it to be. The self-hosting community is a lot bigger now than it was back then, and there are a lot of very good off-the-shelf products for a variety of purposes, and I'm wondering if email is among them.