In this paper, we propose that deep neural networks that are thinner than typical image recognition networks can perform sketch recognition effectively. As in other computer vision problems, convolutional neural networks (CNNs) outperform other feature extraction methods significantly in sketch recognition. To date, two CNN structures have been proposed for sketch recognition, as described in [4] and [5], achieving classification accuracies of 74.9% and 75.42%, respectively. Although an easy way to improve performance is to design a deeper network, researchers currently tend to avoid an increase in the number of parameters. We attempted to find a more efficient network structure in terms of trade-off between memory usage and performance. Our experiments suggest that making convolutional layers thinner does not result in a significant drop in performance, which correspond to our expectation that low level features are simpler in sketches than those extracted from images.