We report a miniaturized probe-based combined two-photon microscopy (TPM) and optical coherence tomography (OCT) system. This system is to study the colorectal cancer in mouse models by visualizing both cellular and structural information of the colon in 3D with TPM and OCT respectively. The probe consisted of gradient index (GRIN) lenses and a 90 degrees reflecting prism at its distal end for side-viewing, and it was added onto an objective lens-based TPM and OCT system. The probe was 2.2 mm in diameter and 60 mm in length. TPM imaging was performed by raster scanning of the excitation focus at the imaging speed of 15.4 frames/s. OCT imaging was performed by combining the linear sample translation and probe rotation along its axis. This miniaturized probe based dual-modal system was characterized with tissue phantoms containing fluorescent microspheres, and applied to image mouse colonic tissues ex vivo as a demonstration. As OCT and TPM provided structural and cellular information of the tissues respectively, this probe based multi-modal imaging system can be helpful for in vivo studies of preclinical animal models such as mouse colonic tumorigenesis.