OK. I avoided responding to this before since I am not an expert in the subject. But it is a good question. And since no one else has responded yet, at risk of demonstrating my ignorance, I'll have a go at it (read: take this with a grain of salt, or a whole shaker maybe

).
The CMB represents the earliest point in the history of the universe that we can directly observe and the most distant. Before this, the universe was light impermeable because primeval hydrogen existed as a plasma which doesn't allow transmission of light. The CMB existed everywhere at the point in time represented by the CMB, but since it is electromagnetic radiation, it moves through space just like the light from stars, etc. The CMB we are observing is the heat of the big bang that started out from the most distant points currently observable. An observer at one of these points looking in our direction would also see the CMB but the radiation they observe would be the radiation that started out in our part of the universe. You can't think of the CMB like an egg shell since it looks the same from any view point in the universe (even from points on our observational limit eggshell). You are correct about the CMB being highly red shifted due to the expansion of the universe. The light of the CMB was radiated from every point in the universe and currently every point in the universe is receiving an approximately equal amount of that energy radiated from points at a distance equal to the distance light has traveled in the time since the CMB was released, red shifted to the temperature now observed.
If wouldn't be accurate to say that space is radiating this energy. It would be correct to say that space (or maybe I should say the plasma in space) radiated it at a certain point in the past, from everywhere to everywhere.
The polarization observed in the CMB is due to the fact that the hydrogen didn't cool into a non plasma evenly. Some areas cooled to a non plasma sooner and light bounced around in these areas until the rest had cooled enough to transmit it. This bouncing resulted in the observed different polarization in different regions of the CMB.
The temperature variations are (warning - I'm stepping out on thin ice here) slight variations in matter density resulting from quantum flux. Quantum flux occurs at a small scale but hyperinflation in the first few moments of the big bang expanded the effect of this small variation so as to produce the large scale structure of the universe that we observe today.
The inflationary theory, as I understand it, brings us back to about 1 Planck time unit (a very small unit of time) after the big bang (at least in theory - observationally we are limited to the time of the formation of the CMB). I don't think it is possible, even theoretically, to get closer than that.
I hope this helps. I hope this is correct.
