Does Alt+F4 work? If so, you might be able to avoid the Safe Mode start offer that you normally get after using the Task Manager.
Personally, I've had the sim take as much as 10 seconds to close after using the UI method, but it has never hung more than that.