Bias has something profound to teach us about the human condition, which relates to attention.
We all have a limited amount of attention and give our attention to the things we value.
But how do we know what objects to give our attention to?
How does the evaluation happen?
It happens a prior. We don’t have enough time to scan the environment and evaluate everything single object.
Instead, we simply filter the world for what we value.
As a result, we are more familiar with and prefer what we value. These preferences can make us blind to other information and miscalculate its importance and value, which leads to Bias.
So, Bias first happens a priori; it happens before we give our attention to an object, person, experience, or event.
The second level of Bias occurs as a result of perspective.
When we look at an object, we don’t see all the information about it.
We see it from one viewpoint at one point in time. Our perspective is even more limited with people as we see them in a given situation, environment, and context. So, no matter how we slice it, we have an incomplete and skewed sample of data.
And lastly, is mean-making.
We are interpretative beings that give meaning to experiences. Experiences don’t have a specific meaning. For example, no universal object or situation called ‘anger’ that produces the feeling of being angry in every human. We interpret ‘the situation’; some people may get angry, and others might not care.
So now we have the complete Bias Loop:
- Attention Level
- Perspective Level
- Meaning Making Level
And this has a direct impact on LLMs.
First, LLMs work via a mechanism called ‘Attention’. (To learn more about how this works, check out the paper ‘Attention is all you need”.)
from
https://fatsfixedassettracking.com/what-is-bias-why-does-it-happen-in-llms-by-stefan-kojouharov-oct-2023/9491/
No comments:
Post a Comment