What is a fully distributed representation scheme at one level of analysis is a locally distributed scheme at another level, and a localized scheme at yet another level.
If, for example, we had a distributed representation of cup with coffee and also a distributed representation of cup without coffee, and if we subtracted the latter from the former, we would not end up with a context-independent representation of coffee but rather a representation of coffee in the particular context of being inside a cup.
Keywords: distributed representation
of data, geometric algebra, HRR, BSC, scaling
An ideal distributed representation
system needs to meet several criteria in order to successfully perform cognitive tasks.
1]), it would normally require a distributed representation
We will ground our developments in relevant applications, particularly to natural language processing (learning distributed representations
for language modelling and compositional semantics) and genetics (modelling genetic variations arising from population, genealogical and spatial structures).
Aerts entitled Distributed Representations
Based on Geometric Algebra: the Continuous Model introduces a new model of distributed representations
of complex structures (sentences in natural languages) based on geometric algebra.
To include light quarks in their calculations, Davies and her colleagues distributed representations
of these quarks over many points on the lattice.
This chapter first covers semantic networks and their development into frames and scripts, and then turns to interactive activation models, connectionist models with distributed representations
, and finally to 'symbolic connectionism', which might be thought of as a generalization of ideas embodied in interactive activation models.