The thermal conductivity of soils is an important property in energy-related geotechnical structures, such as underground heat pumps and underground electric power cable tunnels. This study explores the effects of geotechnical engineering properties on the thermal conductivity of soils. The thermal conductivities of quartz sands and Korean weathered silty sands were documented via a series of laboratory experiments, and its variations with effective stress, porosity, and water saturation were examined. While thermal conductivity was found to increase with an increase in the effective stress and water saturation and with a decrease in porosity, replacing air by water in pores the most predominantly enhanced the thermal conductivity by almost one order of magnitude. In addition, we have suggested an improved model for thermal conductivity prediction, based on water saturation, dry thermal conductivity, saturated thermal conductivity, and a fitting parameter that represents the curvature of the thermal conductivity-water saturation relation.