Do they already have to be in conversation with you in order for them to receive an email notification that you responded to the conversation?

I've started some conversations with people and they haven't been alerted that they've received a new conversation.