Select the playlist you want to play. At the top of the playlist there is a Queue all button. Click that and every song in that playlist will be added to your Queue.