But that's exactly what's happening right now as far as i can see. The person who starts the conference needs to make sure that everyone is premium because free members can't join the conference.
The intention is to make it so that only premium can start the conference but free members can join.