There is a bug where those Idols only work while you are using a shield. This will be fixed in the next patch.