Nevertheless if in combat or not, if for long or not, or if any materials needed (potions are "needed materials" too
):
If you press 1 key and can then look around via the other keybind and focus on other stuff (watch your back e.g.) instead of the need to repeat the key press and check for correct quickslot selected, if the wall still needs repair or not, etc.:
It's still an advantage and not the designed way to work, no matter if for 1, 2, or 30 seconds.
You got a benefit there and you'd do nothing than pressing 1 key to gain it.