Just to clarify Eminem didn't sample the song from a real vinyl record, he just used the melody of the children's lullaby song and had one of his musicians REPLAY it. I mean, it's just a piano and drums and a little violin in the background. If you check the production credits, there's no credit to the author of the original song, because I heard that no one originally copyrighted the song since it's a little children's song that got passed by from nannys and daycares.

The big difference between sampling a song off a record and just replaying it is usually a quite large amount of money. It's much cheaper to have someone replay it and only have to pay a mechanical license instead of paying usually 5-10x more to get the full sample off the record cleared.