Ceph is a very interesting project. RADOS, their distributed block store is now mainline I believe and the project is coming along in leaps and bounds.
I'm unsure if anybody has a large scale RADOS based blob store though. It would be interesting to see how it holds up.
Seeing her send SIGSTOP to a running MSWORD.EXE process and observe it stop updating its window in response to expose events was splendid. :-)