Memory traces, stored in the form of attractors or appearing as the result of recent perceptual experience, can actively shape processing and categorization of visual stimuli. Electrophysiology in monkey IT cortex and computational modeling indicate the existence of categorical boundaries in the dynamics of cortical networks. Our psychophysical experiments in humans show that these boundaries can be shifted following recent visual experience, in adaptation and priming paradigms.