Neutrik has a reputation for making good patchbays.
But a small mixer might not be such a bad idea.
It would satisfy your current needs and allow for some expansion. It would give you additional pre-amps. And, it would allow you to record several signals simultaneously.
You'd still be re-patching with a patchbay; you just wouldn't have to get behind your equipment to do it. Plus, a patchbay wouldn't give you any of the aforenmentioned bonuses.
A good patchbay will run you somewhere in the neighborhood of $100. A pretty decent 6- or 8-track mixer shouldn't cost you that much more--especially if you "do it eBay!"