If you already have songs in your queue, all you need to do is click the Join queue button. When you've clicked the Join queue button, you'll be added to the Room queue.
Alternatively, if you go to My Queue and see a light blue bar at the top, you can click on it to Join queue.