next up previous
Next: Avoiding Goal Conflicts Up: Results Previous: Adaptivity

Bias to Ongoing Plans

The algorithm demonstrates an implicit bias mechanism. It favors modules that contribute to the ongoing goal and subgoals except when there is enough urge to start working on something different. The main reason bias is exhibited is that the activation levels are not reinitialised every time a module is activated. As a consequence the history of past activation spreading plays a role in the selection of action, in particular when the effect of the state and goals is relatively small in comparison with the mean activation level. But even if that is not the case, the algorithm exhibits bias towards ongoing plans. More specifically, it demonstrates two types of bias: horizontal and vertical.

1. Horizontal Bias

A first type of bias demonstrated by the action selection algorithm is the favoring of actions that contribute to the current goal (the goal on which it was working before). Given the set of modules in figure gif and an initial state , and global goals . One to five are the competence modules necessary to achieve goal , while one' to five' are the modules that contribute to goal .

  
Figure: A toy network to test horizontal bias.

When simulated this network does not jump back and forth between modules that contribute to and modules that contribute to . Instead it starts working on one goal, completes it and then works on the other goal (cfr. figure gif). This is the case, because when either module one or one' is chosen, the distance of that path to the goals is shorter than that of the other path. Therefore, the spreading of activation backwards has a larger effect and makes sure that the started path is finished first. As the paths from state to goals grow longer, the threshold has to be increased to obtain this effect (more on the effect of the threshold in the next section).

  
Figure: When the threshold is high enough, the action selection behavior exhibits a horizontal bias (left-hand experiment). When the threshold is not high enough, the system jumps between modules contributing to one goal and modules contributing to the second goal (right hand experiment).

2. Vertical Bias

A second type of bias is the favoring of actions that contribute to a `brother' goal (a subgoal of the same overall goal). Consider the modules in figure gif. The initial state of the environment is , the goals are .

  
Figure: A toy network to test vertical bias.

Again, if the threshold is high enough, this network first executes all the actions that contribute to one goal and then starts working on the other goal (cfr. figure gif). The reason is that once a predecessor of a module has been active, the node itself receives more activation energy from the state of the environment. Therefore it has more activation to spread to its remaining predecessors.

  
Figure: When the threshold is high enough, the action selection behavior exhibits vertical bias (left-hand experiment). When the threshold is not high enough, the system jumps between modules contributing to the first goal and modules contributing to the second goal (right hand experiment).

As already stated in the previous section, the system can be given a higher or lesser degree of `inertia' with respect to the changing environment and goals by selecting the ratio of the global parameters appropriately. Especially in very dynamic environments, it might be necessary to make the system adapt slower, otherwise it might never get anything done.



next up previous
Next: Avoiding Goal Conflicts Up: Results Previous: Adaptivity



Alexandros Moukas
Wed Feb 7 14:24:19 EST 1996