Usually for me it works very instinctively, but I make choices: I'll start with the music if my main idea is a group of sounds, chord progressions, instruments I like for some particular reason. Often, though, it is just a theoretical concept, some story I want to tell, something in particular I want to talk about, so, in that case, I'll go with the lyrics first.
