He says gravity only because we are talking about global collapse (not collapse initiation, in which impact and fire were a catalyst for global colapse) in which the gravitational potential energy released is the only energy available to deform the structure.
Things like the impact wont matter on floors that did not receive impact damage, and fire can only decrease resistance on the fire floors as well, and it will do so by decreasing the compressive strength of the steel, as well as the energy dissipated per degree of rotation when a plastic hinge forms in post buckling, and less energy will be required to pulverize concrete, due to the built up internal pressures from evaporated water in the pores of the concrete, as Dr. Greening has discussed.
Dr. Benson, who recently started posting here, notes that it only takes 2 seconds for the collapse front to travel past the fire affected floors, so in terms of global collapse, fire and impact don't make a big difference.
You might not want to throw the word 'lie' around so hastily.