Effect of the columnar grain boundaries on the perpendicular magnetic domain structure of epitaxial L10 FePt (001) thin film has been studied using electron holography. The analysis of stray fields shows that both the continuous and columnar epitaxial films of L10 FePt (001) consist of perpendicular magnetic domain walls. In the columnar epitaxial film, however, the perpendicular domain walls tend to be confined to columnar grain boundaries, because columnar boundaries act as pinning sites for the domain walls. The domain wall pinning by columnar grain boundaries leads to a significant hysteresis effect in the perpendicular magnetization of L10 FePt epitaxial films.