Negative lessons are very important. And they supposed to be stored very specifically in its own categories. These categories will provide only negative feedback during inference obviously.
Standard ANNs allow mixed weights but they heavily rely on gradient descent to keep the process stable.
In ANNs those random negative weights don’t really make sense. They cannot have “reasoning” about what part of the signal should be suppressed. Maybe it could get such adjustments from the back propagation. But how often in order to produce a strong memory? We don’t create training sets with negative expectations.
We can consider fully unsupervised learning where the negative observation will just go to another category. But that category would never have a color of undesirable event/object. In the recent Reinforcement Learning development researchers, indeed, try to give “colors” to such undesirable categories (maybe vectors or areas in the latent space).
So this is about the propagation in neural networks I think this happens not with numbers, but with matrices not with derivatives I think it happens with the areas where when signal tries to go forward, it’s not continue. It’s not passing the neuron so it stops there. some negative I don’t know let’s call it energy and when that reaches threshold, some controller that knows about all neurons sees that and send back and as a signal to start making connections to altering connections and affect many neurons in that area I think it’s just chemical process there that affect not one single neuron but many of them, so then when the same signal repeats now it will make some new connections to appear there. Maybe it will take some time before you right or will.
So in similar way, it works with excitation when when you pass when signal finds a new path that’s where to confirm it. This dopamine is sprinkled so we feel this emotion that last for sometime and for this time that connection improves so it finds a new path and maybe something happens with the old one maybe the boss still work but to confirm the new one it releases this chemicals, and that’s how new Francis established