Okay, I found a workaround myself. Save all stuff to script. Make the changes there. Start the script, which makes the application builder appear again, with the correct stuff now, and then save it as your application. Is of course a general way to change all kinds of boxes where you are missing options.