Boris Johnson defends actions as extra Conservative allies resign