Swipe all the way to the right, not only until you see the buttons. Then it will be immediately added to the queue. The tap is already used to edit a song.
This long swipe does work very nicely and is just one fluent motion. But I will try if double tap works equally well.