Colts’ worn-down, short-handed defense adding to late swoon