Also are you putting a limiter on your master bus? The problem might be that when the volume of the full mix gets lower because the bass frequency is gone, the volume of the rest of the tracks is being raised and the hi hats are the most noticable thing you hear.