It is dyno proven that the more heat you can keep inside the manifold, the more efficient the results will be. You will not only spool faster but reach full boost quicker as the pressure difference is somewhere around 30% not 0.5%.
That is why most people complain about power loss after swapping their cast manifold for a custom stainless one, because cast holds the heat in for longer whereas the stainless will dissipate it more quickly.
As you already know, it is heat that drives the turbine....so the more you can get into the housing...the better.