For testing we need a way to create executables that start a non-interactive task instance and immediately evaluate it without starting a webserver and waiting for user input.
