Can I leave the batteries in myTommeeTippeeCloser to Nature electric breast pump when it is connected to the mains?

Yes, that's fine. The mains connection will simply override the battery supply.