The concept of information as being a concept on a level with energy or charge or mass seems really quite cool.
Or, some would say, more fundamental still...
Yeah, the whole topic is almost excruciatingly fascinating, and I'm sad to say I know almost nothing about it. People like Penrose are doing interesting work now at the interface of quantum mechanics, information theory and GR - quantisation of black hole entropy, that sort of thing - that may have profound implications for cosmology.
A few years ago I picked up a second-hand copy of a book called
The Matter Myth that was published back in 1992, and I remember it concluded with a chapter called 'From It to Bit', about how we may come to see matter as the embodiment of fundamental information - rather than information merely as a way of describing matter. I suppose this probably ties in with the zeitgeist of the time, along with selfish genes and 'memes', the burgeoning Internet and 'information economy' and so on.