It looks really useful but is uncomfortable that the popup keeps floating at the top of the screen whenever I move around the page. I think it would be great if the popup could be toggled with a small floating button or keyboard shortcut.

I think you're right. I will implement the change.

I updated it, check it out. Version 1.6 or higher.