If you work with fixed playlist, make sure "Advanced Queue Mode" is disabled and don't worry about the queue. Just work with playlists.
If you don't have a fixed playlist and build your song order on the fly, I would recommend getting used to the queue mode in "Advanced Queue Mode".
The user guide has a long description on how the queue works.