Hi Raaomoka
I agree with you. Ideally we would like to be able to give the ability to fully customize the quick panel. We aren't there yet. In the mean time what you can do is bring the mouse pointer up to the closed quick panel (or open, both work, but closed is faster) right click and choose "right" from that menu. Pretty fast, I'd like faster.
Hope this helps!
Justice