What is "conserved" is the theoretical concept of information, as proposed by Claude Shannon - a measurable amount of "non-noise". No specific piece of data is conserved.

This isn't a great explanation, though it's fairly accurate. The issue is I'm trained in mathematics BUT I don't understand Information Theory in my bones, so you get crappy, hand-wavy arguments.