From Manifestations to Cognitive Architectures: a Scalable Framework