The structural changes of kinetic Alfven solitary waves ( KASWs) due to higher-order terms are investigated. While the first-order differential equation for KASWs provides the dispersion relation for kinetic Alfven waves, the second-order differential equation describes the structural changes of the solitary waves due to higher-order nonlinearity. The reductive perturbation method is used to obtain the second-order and third-order partial differential equations; then, Kodama and Taniuti's technique [J. Phys. Soc. Jpn. 45, 298 (1978)] is applied in order to remove the secularities in the third-order differential equations and derive a linear second-order inhomogeneous differential equation. The solution to this new second-order equation indicates that, as the amplitude increases, the hump-type Korteweg-de Vries solution is concentrated more around the center position of the soliton and that dip-type structures form near the two edges of the soliton. This result has a close relationship with the interpretation of the complex KASW structures observed in space with satellites.