An effective approximation is applied to Maxwell's equations with an anomalous axion interaction. A new set of Maxwell's equations acquired from this approximation describes only reacted fields generated by the anomalous interaction. Unlike other approaches, this set of Maxwell's equations inherently satisfies the boundary condition for haloscope searches. The electromagnetic field solutions are evaluated for both cylindrical and as toroidal cavity geometries. A small but non-zero difference between electrically and magnetically stored energies appears in both cases. The difference may come from an anomalous non-dissipating current induced by oscillating axions. A possible haloscope search with an external electric field is also studied from the duality that naturally arises in this approach.