Simply put, as long as your pool has less than multiple millions of active stake the 340 ada mandatory minimum fees will weight down a lot on the delegator returns. All other factors are not really significantly relevant. This results in about 35% less annual return for delegators who delegate to small pools.
You might want to also check my post about this same subject: