I think the general concensus of the music community is that the only real rule in a creative endeavor is that there are no rules. So unless you're just blatantly playing someone else's music and claiming it's your own, sample whatever the heck you want! haha.
I see it this way. Did daft punk rip the shit out of their samples? yes. did they do much to change them? not really, maybe a tempo change on a few, BUT the music they created using those samples was totally NEW, and AMAZING. Personally, I'd rather enjoy their music than hate on their samples.
I think when most new people get into producing they look at someone using a loop, or even a premade drum kit, and they're like, "youre not doing anything youre just using sounds already in there thats lame." well, sorry to say it but if it sounds bomb at the end of production, who the fk cares? lol. I'd like to see that noob whos hating on samples try to make some amazing stuff using only sinewaves and squarewaves, beatbox his own drums, clap his own claps, then when he makes a chart topper he can whine all he wants. not describing OP btw, since you see the value of samples yet hold yourself to a higher merit of finding uncommon samples that everyone's not using. Definately creative points there.