I think aside from the fact that fisk gained weight, it may also show that as he's attempted to stray from his villainous side being the mayor, he's stopped wearing his "armored" suits. He no longer has his connection with his tailor, since Matt befriended him and him start making his suits. Since fisk gained weight he hasn't been able to get new suits that have the armor built in.