First off... nice job! Pretty nice build, and hopefully we can work through the design flaws. So far based on the pictures you provided It doesn't look serious.
I think that the 2ea. 4x4 square hollow tubes connecting the firebox to the chamber may not be allowing enough heat to enter the box, however you did mention that it is 10 degrees where you are currently and yes that can have a big factor in why you cannot reach higher temps than 175F. Remember there is no such thing as cold, only lack of heat. Therefore any heat source will always immediately go directly to a low heat area to first equalize temperature. This is a huge waste of energy trying to heat 10 degree steel with the low temps surrounding it absorbing any heat the fire throws at it.
OK... enough of the thermodynamics lesson!! I personally would remove the 2ea. 4x4 tubes and replace them with 1 large rectangular tube outlining the existing welds of the 2 tubes you have currently. I think the current combined volume of the 2ea. 4x4's may not be enough to heat the box in colder weather. Also keep in mind that your smoke and heat will take the shortest path to the chimney, so the 4x4 closest to the chimney will be operating at a higher velocity than the other.
Lastly I do not believe your chimney to be much of a factor at this time, it looks as if it is sized appropriately as it is. And should you hog out and open those 2ea. 4x4's like I suggested, I feel it will even become more efficient. You don't want your chimney to be a larger volume that your intake from the firebox. You want smoke and heat to build up in the box somewhat. An over sized chimney allows too much heat and smoke to escape too fast!!
So in closing.... you might end up needing to make a smaller fire after all of these changes, which would be a good thing!! More wood efficient!!
Good luck too ya!!