Some major issues of human-friendly man-machine interaction/interfaces in an intelligent residential system are dealt with to cope with increasing, needs of the elderly and the handicapped for a higher level of living conditions. Specifically, the existing systems in this area are first examined and the inadequacy of some current remote-control interfaces for the elderly/handicapped is pointed out. Then, some intention-reading techniques are introduced for the elderly and/or the physically handicapped, for easier and more convenient use of machines and engineering systems.