Question 1: What temp is your smoker at when youre experiencing this problem?
Question 2: Do you have the attachment connected directly to the smoker, as it is recommended?
If yes, don't do that. Get a 3ft section of 3in duct to separate the units. Pic below. It helps with the air flow and with quality if the smoke.
Also, turn the smoke generator off as soon as you see smoke rising from the smoker.
View attachment 643256