In the growing field of brain machine interface (BMI), the interface between electrodes and neural tissues plays an important role in the recording and stimulation of neural signals. To minimize tissue damage while retaining high sensitivity, a flexible and a smaller electrode with low impedance is required. However, it is a major challenge to reduce electrode size while retaining the conductive characteristics of the electrode. In addition, the mechanical mismatch between stiff electrodes and soft tissues creates damaging reactive tissue responses. Here, we demonstrate a neural probe structure based on graphene, ZnO nanowires, and conducting polymer that provides flexibility and low impedance performance. A hybrid Au and graphene structure was utilized to achieve both flexibility and good conductivity. Using ZnO nanowires to increase the effective surface area drastically decreased the impedance value and enhanced the signal-to-noise ratio (SNR). A poly[3,4-ethylenedioxythiophene] (PEDOT) coating on the neural probe improved the electrical characteristics of the electrode while providing better biocompatibility. In vivo neural signal recordings showed that our neural probe can detect clearer signals.