The Inverse function Delayed model (ID model) is a neuron model with negative resistance dynamics. The negative resistance can destabilize local minimum states, which are undesirable network responses. The ID network can remove these states. Actually, we have demonstrated that the ID network can perfectly remove all local minima with N-Queen problems or 4-Color problems, where stationary stable states always give correct answers. However this method cannot apply to Traveling Salesman Problems (TSPs) or Quadratic Assignment Problems (QAPs). Meanwhile, it is proposed that the TSPs are able to be represented in terms of the quartic form energy function. In this representation, the global minimum states that represent correct answers and the local minimum states are separable clearly, thus if it is applied to the ID network, it ensures that only the local minimum states are destabilized by the negative resistance. In this paper, we aim to introduce higher order connections to the ID network to apply the quartic form energy function. We apply the ID network with higher order connections to the TSPs or QAPs, and show that the higher order connection ID network can destabilize only the local minimum states by the negative resistance effect, so that it obtains only correct answers found at stationary stable states. Moreover, we obtain minimum parameter region analytically to destabilize every local minimum state.