RCA cables are unbalanced. XLR and TRS cables are balanced. There are two issues:
1. Over the length of the cable, noise can build up. How much depends on a lot of factors like where the cables are located relative to other devices and cables (power supplies, power cables, MIDI cables, etc. are the worst offenders of introducing "junk" into audio cables. The way balanced cables work is they accumulate this added noise across two different conductors (a positive one and a negative one) and then at the receiving device the phase is flipped. This cancels out any of the noise that has built up. This usually makes for a cleaner signal, but not always - and even if it does, the amount is highly variable.
2. Unbalanced cables will simply carry less signal - the signal will be lower at the input device (in this case the amp for the speakers). That means in order to get to the same volume, you will need more gain (ie. turn up the volume on your speakers). The gain will introduce more noise because it will pull up everything - the signal AND the noise floor. And depending upon the amp, it may introduce a minuscule or large amount of it's own hiss.
Bottom line: always use balanced (TRS or XLR) cables for monitors (assuming the speaker amp accepts balance inputs, which almost all do). RCA or other unbalanced lines can work in a pinch, but the quality will be slightly degraded. Whether or not you will notice the degradation depends on a lot of variables.