Hey DeDiary , sorry, I am just now seeing your reply.

In Navigation you could hide the visibility of the block and buttons, that way no one will see it's an option. 

In Pages you can remove the blocks that list 'Members' that way it doesn't show as empty, if it's on the Org homepage.

There may be a setting to disable, but this is my immediate thought. I will investigate more later today.