I would advise against removing the fan, as that will likely cause too much airflow and longer roast times. As Randy indicated, reducing the airflow through the filter with his filter mod allowed for shorter roast times with higher batch sizes.
I have not noticed any significant difference in the cup based on lower fan speeds and more smoke coming out of the bean chute or top filter (I lowered fan speeds to reduce the intake of cold air during very cold roasting sessions).
As far as temperature control with the fan, what I've found troubling so far since my installation an ET thermocouple is that too much reliance on fan to slow down/lengthen the roast after 1st crack tends to drop the ET, which could cause problems with the surface reactions on the beans. I've not confirmed whether this is or is not a significant problem with the hottop and the beans I've roasted, but I plan to conduct tests to see if profiles like this

show superior results in the cup compared to something like this
