Found the answer here: How to add icons on the homescreen that link to emulators?
Restarting is the way to do it.