It's quite fast yeah. I can see where you are trying to go on the premo tip. I think some of the notes of the sample are a fraction of a second earlier than the drum hits and that is throwing it off a bit.
Some bass wouldn't hurt, but I dunno if you're avoiding that because of the bare Premier style you are going for.