Ok, I've done some work and and a bunch of testing and I think I've pretty much got it figured out.
We sealed around the CC door some more and that didn't seem to make much difference.
I also tried the foil idea that was earlier in this thread, along with replacing the foil with and actual steel plate, neither of which helped at all.
Next I added the baffle in the firebox like in the earlier diagram, and that made a few degrees difference, but made it much easier to control the overall temp.
Then I took a laser temp gun and ran it all over the CC while it was running and discovered that the temps made a pattern like this:
That left 2 options in my mind, raise the chimney or put a baffle in the other end. So I went the easy route and added the baffle, so I now have modifications like the following image:
I am now getting end to end temp differences consistently in the <10* range, with the hot end now being the far end away from the FB.