I know! :( You can minimize this window (and any overlay window) by holding alt. There's also a minimize button on the top-right if you prefer that.