Recently, various robots are being used for the purpose of structural inspection or safety diagnosis, and their needs are also rising rapidly. Among the structural inspection using robots, a lot of researches has recently been conducted on inspection of various facilities and structures using an unmanned aerial vehicle (UAV). However, since GNSS (Global Navigation Satellite System) signals cannot be received in an environment near or below structures, the operation of UAVs has been done manually. For a stable autonomous flight without GNSS signals, additional technologies are required. This paper proposes the autonomous flight system for structural inspection consisting of simultaneous localization and mapping (SLAM), path planning, and controls. The experiments were conducted on an actual large bridge to verify the feasibility of the system, and especially the performance of the proposed SLAM algorithm was compared through comparative analysis with the state-of-the-art algorithms.