The whole point of wanting to work in an office is being surrounded by colleagues. That means everyone on the team needs to be in the office on the same days.
I don't see why someone's desire to be surrounded by colleagues should trump someone else's desire to not be surrounded by colleagues and just work in peace.