This paper presents InstructSAM, a training-free framework that counts, detects, and segments objects in remote sensing imagery based on tailored instructions.