I usually work with a core library of less than 10 drum samples (kicks/hi hat/ snares/claps) that I've carefully worked on to give a satisfactory sound. Since I mainly produce trip hop, the serve their purpose in most of my songs. Also, layering synth percussion over samples can help