Is it possible to build a house that has all its walls facing the south direction?

Yes, if you build the house at the north pole, it will fulfill the requirement.

Discussion