Button corner changes on hover

Does this happen in the backend?
If so, I think this is some kind of Gutenberg behavior/limitation.

When hovering an element, it gets kind of highlighted and a blue border appears for visual indication purposes.
This border comes with a border-radius of 0 or so.

Related topic to the actual issue.