If I'm understanding your question correctly:

You will end up having multiple blocks on the page with sets of them being visible for each user group you desire. Each block can have its own visibility.