Epitaxially grown quantum dots (QDs), especially embedded in photonic structures, play an essential role in various quantum photonic systems as on-demand single-photon sources. However, these QDs often suffer from adjacent unwanted emitters, which contribute to the background noise of the QD emission and fundamentally limit the single-photon purity. In this paper, a nanoscale focus pinspot (NFP) technique using focused-ion-beam-induced luminescence quenching enables us to improve single-photon purity from site-controlled QD as a proof-of-concept experiment. The optical quality of the QD emission is not degraded while the signal-to-noise ratio of the QD is improved. Moreover, the QD after the NFP technique reveals the single-photon nature at further elevated temperatures owing to the reduced background noise. As the NFP technique is nondestructive, it retains the apparent physical structures and photonic functions, thereby indicating its promising potential for applying diverse high-purity quantum emitters, particularly integrated in photonic devices and circuits.