I'm talking about how two sub or bass sources playing different notes sound horrid together. Like if you loaded a bass sample and played a chord
So we've established that frequency masking is a psycho acoustic theory, but is it practical in the bass areas? Or do these sound bad simply cause of mud. To your point on orchestras and how that is an example of how frequency masking isn't real, they are still spacing out the bass instruments.
The more specific part was not do producers layer instruments in general, it was do they layer their bass instruments (say a sub bass under a bass guitar)
how does that relate to "masking"?
"sounds like shit" does not equal "masking".
"frequency masking" is a "psychoacoustic theory", sure.... But it has nothing to do with mixing.... nor has it ever been used correctly (as far as I have ever seen) in a "mixing" context.
Forget about the term "frequency masking".
"frequency masking"= you can't hear quiet sounds because there is too much other noise around.
Like "hey, I can't hear you with this parade going on. let's go inside where it's quiet so I can hear better"
It is not a case of "make sure you carve out frequency space in this instrument so you can hear that other instrument because the frequency will be masked"
To go into why some sounds are better monophonically and some are better polyphonically is really off topic and too much to go into here for a concept unrelated to the one at hand.
"frequency masking" is the incredibly basic concept of "if you have too much loud shit playing, you wont hear the quieter stuff."
And in the real world, that is how it will be referred to... "i can't hear that part in your mix because there is too much shit going on in there."