The music faculty is not a monolithic entity that a person either has or does not. Rather, it comprises a set of neurally isolable processing components, each having the potential to be specialized for music. Here we propose a functional architecture for music processing that captures the typical properties of modular organization. The model rests essentially on the analysis of music-related deficits in neurologically impaired individuals, but provides useful guidelines for exploring the music faculty in normal people, using methods such as neuroimaging.