Localizing touch is fundamental for interacting with our dynamic environment. Such localization requires encoding stimulus position relative to a landmark, which defines a reference frame. These frames are assumed to be centered on specific body parts and are usually studied using localization reports or stimulus-evoked potentials. Here, we introduce an innovative method to uncover reference frames and show that they flexibly scale to the stimulated area. We recorded humans’ spontaneous gaze behavior following tactile stimulation of the fingers, with hands positioned on either side of the body. When stimulating both hands, the left-to-right direction of gaze shifts reflected the left-to-right position of hands relative to the body, consistent with a body-centered reference frame. In contrast, stimulating the right hand only revealed a hand-centered frame: stimuli to the right of the middle finger elicited rightward gaze shifts, whereas stimuli to the left elicited leftward shifts. Crucially, the middle finger was associated with a central gaze position despite the hand’s rightward location. When stimuli were further restricted to the last three fingers, gaze shifts were re-centered on the ring finger. These findings challenge body-part-centered accounts and reveal dynamic reference frames that scale to fit the stimulated area and center on its midpoint.