This is a bug I have managed to cause a few times by fat-fingering something while working on object labels in the quick properties. It causes buttons to appear over the quick properties label section of all objects (not just the object where the bug originates) until resolved.
It happens with some combination of clicks while editing the label name or value. I am not sure if it happens when clicking on the label name/value, the add/remove/move buttons, or the space between. I cannot seem to intentionally recreate it.
Clicking the Edit button opens a Tracked Variable pop up window and the Script window opens up a blank script window. Changes in these windows, pressing Apply/OK, etc. does not clear the buttons. I believe scrolling the mouse wheel with a label selected is what made the buttons go away, but cannot be sure as I was trying a variety of things to remove them.