If the movie has not started to play, it is still downloading. Quicktime analyzes your connection speed and decides when to start playing while downloading the rest of the movie in the background. The slower the connection speed, the longer it waits to start playing.

If the movie skips or pauses at any point, you can drag the playhead (the moving circle at the bottom of the window) to the left in order to replay any portion of the movie.