This is something that we are actively working on. We hope to have a hotfix out soon that will help your follower vanish so keep an eye out for it.