Hello. If the app was installed then could you please check Actions menu -> More submenu on a profile which you want to block. By default new buttons are added at the end of the list.