Click the playlist button in the upper right hand side of the video window,
or use the "next" and "previous" arrows under the video to scroll through videos