This study proposed a mobile virtual reality-based application for on-site risk management using Historical Building Information Modeling (HBIM) to alleviate the inefficiency of paper-based risk management of architectural heritage. In this research, we focused on the design of the metadata and the database structure that is based on the point of interest (PoI), anchor, and content metadata for advanced context-aware information retrieval from HBIM system in the mobile environment. To verify our method, we created a mobile VR-based application of the Gwandeokjeong building in Korea. After, we conducted a comparative experiment on performance time, task load and usability and proved the efficiency of our method for on-site risk management. In conclusion, our metadata and database structure in this study contribute to suggest a method to interoperate between HBIM system and mobile VR system and conduct advanced context-aware information retrieval.