In this paper, we propose a novel adaptive feedforward controller for periodic disturbance and noise cancellation, with a frequency tracking capability. It can be added to an existing feedback control system without altering the original closed-loop characteristics, which is based on adaptive algorithm. We introduce novel algorithm "Constrained AFC(adaptive feedforward controller) algorithm" that increase the convergence region regardless of the delay in the closed loop system. In the algorithms, coefficients of the controller are adapted using the residuals of constrained structure which are defined in such a way that the coefficients become time invariant. The proposed algorithm not only estimate the magnitude and phase of the tonal disturbance and noise but also track the frequency of the tone, which changes in quasi-static manner. The frequency tracking algorithm uses the instantaneous frequency approach based on Hilbert transform. A number of computer simulations have been carried out in order to demonstrate the effectiveness of proposed method under various conditions.