In VLC player:
1. Click Tools -> Preferences or press CtrlP to open the Preferences dialog.
2. In Preferences dialog, click "Interface" and check "Start in minimal view mode", then click Save.
To toggle toolbar visibility, press CtrlH.
The hidden toolbar in windowed mode: