It takes a few seconds for the former hosts to regain thought. That would be long enough for Visser to take control of Logan. The he basically cant die while protected by Logan's adamantium skull.
Actually, it's the other way around. It takes the new host a few seconds to regain thought.