Energy harvesting is required for the uninterrupted operation of Wireless Visual Sensor Networks (WVSNs). Solar energy is considered one of the effective energy harvesting sources for WVSN applications. In this paper, we propose an efficient energy management scheme for solar-powered WVSNs. The proposed scheme aims to maximize the overall quality of captured video while maximizing the network operation time. Our energy management is based on the prediction of energy supply and demand. The simulation results show that the proposed method achieves higher sampling quality of video data and longer WVSN operation time by 26.66% on average (up to 33.14%) compared to the greedy energy distribution approaches.