Any additional weight and drag, will impact the flight performance, that's why fighters eject their fuel tanks, before entering air combats for example. The solution for that is, either freing weapon stations, by using CFTs instead of wing fuel tanks, or adding more weapon stations.
P.S. PAFs...