Comment to Conversations Notifications
There is already email notification when there is new reply in conversation. You can edit email template for this notification to make it to look like you want.
Do they already have to be in conversation with you in order for them to receive an email notification that you responded to the conversation?
I've started some conversations with people and they haven't been alerted that they've received a new conversation.