Get it tested? Could just be a defective battery, or parasitic draw.
Yeah, I'd run it all there if you can. Granted, the less than a quarter amp draw when off on Terminators shouldn't be killing batteries, but if it's sitting, it's sitting.
Do you have a single ground for both batteries, or...