Sincerely, did anyone that knows how LLMs are trained expected otherwise?
LLMs are reflexion of their training data, and their training data reflects mostly the current societal norms, with a bias (not sure how heavy) to the societal norms supported by the ones involved in training the LLMs.
What's interesting for me to see, is that Chinese models are as biased - if not more - than ChatGPT. This is probably because a big part of their training comes from distilation of US models.
It would be interesting to see Anthropic, Mistral and Grok in the comparison as well.
What one can theoretically do is to carefully remove gender signals from training data in a processing run. My guess is that you would not lose all to much knowledge, however you might lose the ability to recall facts about fictional and non-fictional persons. Wonder if anyone would go through that hassle though.
Gender signals are baked deeply into our culture and language. It's not just the direct mentions, but the way people are described, the roles they take, the positioning of actors in a complex space.
"Remove gender signals carefully" is an incredibly difficult challenge.
>"Remove gender signals carefully" is an incredibly difficult challenge.
Not to mention that, given that gender-signals have been around since the dawn of human history, you would remove them in a small test-region first; for safety reasons.
Assess the social consequences in a small region. Did it improve things?
Universal instantaneous-removal of any major socio-cognitive-structure is akin to vandalism because it might turn out to be, architecturally, vital.
We already know what happens to some extent; think about gender-non-conforming people. That's a (relatively small) personal blurring of signals that theoretically doesn't affect much outside the person themselves.
Yet it's been a mainstay of our politics for the last few decades, and we've seen it used as a weapon for centuries. Our societies have gender embedded very, very deep.
its political because it does affect much outside the person themselves. Most of the argument is about other people's use of language, about systems. Some of the most hotly debated topics here in the UK are around health (e.g. should everyone be asked whether they might be pregnant if women are, should I have got a letter asking whether I wanted a cervical smear) and government systems (what are the criteria for changing passport details? should a transwoman criminal go to a male or female prison?).
Gender is so deeply embedded that it is impossible for it to be just personal. It ceases to be political where there is a social consensus, which is true for most societies most of the time (not necessarily the same consensus), but not true for western society right now.
That's what I'm saying; even a relatively small change (short hair on a woman, for example) can kick off a lot of responses, and ripples only spread further as people "deviate" further from the norms.
The idea that you can measure cultural bias purely by switching pronouns/nouns in some sentences is incredibly short-sighted; we know it doesn't work like that.
> Most of the argument is about other people's use of language.
Bingo. Because, at a State-level, control-of-speech is the dictatorial dream-ticket.
Government was supposed to be facilities-management (power and water), but it's morphed into top-down social-engineering projects that are rolled out across all 'live servers' without any small-scale testing.
The question if we can or even want to try. To me it is is rather a thought experiment than anything realistic (particularly it would cost quite a lot of money with very uncertain outcome). Speaking of embedded: an alternative approach would be the opposite to contrastive learning: put some losses into the system that encourage gender concepts to stay more close. The political perspective is totally different: there is always a difference what a society wants to do or what generally could be done.
I would guess one could at least give adversarial signals like changing names in literature. Reading a lot of children books at the moment I feel it would be not so difficult disassociating social roles from gender. Wonder however also how much prompt rewriting could do: similarly to anonzmized CVs. Problem however is probably deeper: certain biographies will keep being discriminated.
You could absolutely muddy the waters, but that's a first step and far more easily disregarded in context.
Modern children's books are much better about this, but consider all of the fairy tales; you need to swap not just names but descriptions and roles, and then you need to rework the way the characters respond to those roles before you have a hope of disguising the original genders.
> you need to rework the way the characters respond to those roles before you have a hope of disguising the original genders.
Absolutely. There's the additional problem that English is unusually flexible: Many other human languages collapse when grammatically stripped of gender.
Try de-genderizing Polish; Arabic; Russian; Zulu, etc. etc.
The current ongoing-battle around gender-deconstruction could be framed as: All-Of-Human-History vs The-Last-Thirty-Years-Of-English-Speaking-Politicians. Who will be the winner?
I said this elsewhere but what’s appropriate is going to vary quite a bit based on the cultural and personal values of the users of the model. Having a model with one particular set of standards is likely to leave a lot of people out. This isn’t something that you can just erase and assume that what you replace it with will be categorically better
I think the unstated part of your comment is important - increasingly acceptable especially in professional settings societal norms are female orientated.
I don't think this is particularly malign simply the net effect of complaint-adverse working cultures.
The net effect is that the accepted/promoted guidelines that get brought into the training data is a rejection of toxic masculinity and becomes "harsher" to men.
> especially in professional settings societal norms are female orientated.
I’ve been noticing this for a few years now.
Particularly when it comes to managing issues, a lot more “work” is done on handling conflicts and feelings rather than addressing the actual issue at the root cause.
I know it sounds like a meme, but I’ve personally observed a bunch of colleagues and sometimes hr involved as well having meetings on meetings on how some system not working correctly and how that imposes a toll on work/life balance, mental health and stuff… rather than (trivially?) asking: “alright, why isn’t this working and how do we fix this?”.
I've seen this too, sometimes as a follow up meeting to address feelings about an issue that was resolved that few people go to.
Specifically the people who go are those most emotionally affected and unlikely to be men.
An effect of this is having meetings to address feelings scheduled before troubleshooting sessions! Opening with things like this is not a "fix it" meeting. Quite surreal!
Some time ago I've seen a comment on 4chan that simplifies things, but has a decent grain of truth in it. It went something like "gen z men realized that women have societal privilege and the winning move is to become a woman". The only thing you lose by being a pussy is access to pussy, but nowadays nobody is getting pussy anyway, so there's no downside to becoming a pussy yourself. I mean, put on a wig, change your pronouns, make a big cry about your emotional state, and suddenly you're untouchable. Not to mention that female way of communication is the only acceptable communication in professional settings.
Remember noticing in college and late high school that women were the better students (by a large margin when it came to group projects where form made up for +-50% of the grade). Whenever a sort of competition came up though men would rank at the top. Who's to say that the form portion of an assignment should account for that much of the grade.
I think it has more to do with the "patriarchy" than some other sinister "liberal" plot.
If you're going to argue men are suppose to be in charge of everything, of course the poor male beggar is going to get more blame for their circumstances.
People don't understand machine learning. People seem to believe that with enough training data and parameters, a sudden switch happens that ignites a spark of pure intellect and turns a pile of matrices into a magic knowledge machine.
Unfortunately (or perhaps fortunately) our world is not magical, there are no Platonic Forms, and no Infinite Wisdom spells.
I don't think anyone expected otherwise, but it's good to have this kind of benchmarks since model makers can now correct these bias during post-training and measure how well they do.
Not unlike how the ARC-AGI benchmark family helped improve reasoning.
Not sure if it's sarcasm or not, but if you are being serious, there is no way this would ever happen. There is no body who would take care, nobody who would support it. The opposite could even be true: if someone cared enough to come up with such an initiative, they might get heavily criticized.
I don't see how you can conclude that Chinese models as a whole are as biased or more biased than chatgpt from the results of the study. Some Chinese models were less biased than chatgpt, some models were more biased. The newer Chinese models in this study seemed to be amongst the less biased models in this study. The gemini models here seemed to be the more biased models in this study.
I don't see the specific metrics or variables that you pulled from the study to create that list? The "bias favorable to women" doesn't even exist as a variable or metric in the link that you provided or the published paper.
It's the `Emp.-Agg. Δ`. Results for both the `Intimate Track` and `Public Track` are mostly the same. The orange marking (that ends up showing up on every single one of them), indicates `stronger framing toward female actors`.
The list that you created are partial results for one metric on one of the tracks of tests that they ran. The list that you provided simply implies those specific models were more biased in favor of females in one specific metric they measured out of the many metrics they tested in one of tracks in the paper.
The same metric that you used, Emp.-Agg. Δ for the intimate track, also show that Chinese models were some of the most neutral models tested for that metric.
1. MiniMax-M2.7
2. Qwen3.5
3. GPT-5.2
4. GPT-5.4
5. Kimi-2.5
The results for "Intimate Track" and "Public Track" are not mostly the same. There are many other metrics and tracks that they tested. The results of this study don't support your claim that Chinese models as a whole are more biased.
I really don’t understand what numbers you are looking at.
There are 2 tracks and the `Intimate Track` is actually the one less disfavourable to Chinese models. So, me using that, is better (less bad) for your claim.
Here are the ranked numbers for both tracks. Chinese models (as a group) are, by far, the worst offenders on the Public Track. Now with the numbers from the study. Remember that higher numbers are worst numbers.
The 5 models that I listed are in the same order of the "Intimate Track" list that you provided from the bottom up, from which you initially posted. Your own words: "Remember that higher numbers are worst numbers." Even in your own specific list that you initially pulled for the specific test, the Chinese models were some of the most neutral.
And your interpretation of "Remember that higher numbers are worst numbers." isn't even complete. The results that are closest to 0 show the least bias.
Here are the full results from the study from the link that you provided (https://github.com/xufeiqiong/GAMA-Bench#main-results). They do not support your claim that Chinese models as a whole are more biased or that they are "by far, the worst offenders" in this study.
I'd be curious about how the bias looks in the context of positive situations. Is the bias that LLMs hold men more directly accountable for any situation, and thus both punish negative and praise positive outcomes more strongly? Or is this bias only observable in negative situations?
To be clear: it's bad either way, since women should be seen as having the same levels of agency and accountability as men, but I am curious nonetheless...
As a man I don't want people to sugarcoat things. If I fuck something up or am just wrong about something, I want this to be addressed directly and to my face.
It's completely fine if someone tells me that an idea is stupid, if it actually is and theyre able to articulate/prove why.
I've never met a woman that wants that - and if confronted with such a scenario all of the ones I've observed in my professional capacity completely fell apart from such. thankfully ive only been an observer in those interactions to date.
This was one of the first things I noticed when using LLMs. I don't know what training or 'alignment' is preferred, but clearly there was an anti-male, rather than a neutral alignment used.
You can make all sorts of misandrist statements and men-are-trash statements, with minimal or no pushback from the LLM. But a single misogynistic statement, and the LLM would turn against you, fast.
Chinese LLMs seem much less biased and more neutral/equality-driven, compared to Western ones.
I'm not surprised, but I don't believe it's merely a result of the training data. I would expect the alignment phase to have a significant impact on it as well.
Not exactly raw because of the fine tuning they do to try and avoid bias (but in a biased way). And not exactly civilization so much as what is readily available online, which is in its self biased in many ways, e.g toward flame wars, via troll farms, etc.
I saw a paper on here a while back that said more or less the same thing, but didn’t frame it in a bro-friendly manner so it got flagged into oblivion
Hahaha. Yes. I just find it interesting how readily people accept this finding as face value. I wish I could find the other study. It was something like ‘alignment leads to vacuous nonsense papering over biases’, but with a more left-coded title. Pretty much what you would expect if you train something on 4chan and then tried to fine-tune the hate out. But it had a more woke-sounding title so it got flagged to buggery
Now imagine how the LLMs would look like if they were a raw dump of the Islamic civilization instead.
I suspect we will soon know. This won't stay a Western/Chinese technology forever and there will eventually be some robotic fatwa issuer based in Tehran or Kabul.
Sincerely, did anyone that knows how LLMs are trained expected otherwise?
LLMs are reflexion of their training data, and their training data reflects mostly the current societal norms, with a bias (not sure how heavy) to the societal norms supported by the ones involved in training the LLMs.
What's interesting for me to see, is that Chinese models are as biased - if not more - than ChatGPT. This is probably because a big part of their training comes from distilation of US models.
It would be interesting to see Anthropic, Mistral and Grok in the comparison as well.
What one can theoretically do is to carefully remove gender signals from training data in a processing run. My guess is that you would not lose all to much knowledge, however you might lose the ability to recall facts about fictional and non-fictional persons. Wonder if anyone would go through that hassle though.
Gender signals are baked deeply into our culture and language. It's not just the direct mentions, but the way people are described, the roles they take, the positioning of actors in a complex space.
"Remove gender signals carefully" is an incredibly difficult challenge.
>"Remove gender signals carefully" is an incredibly difficult challenge.
Not to mention that, given that gender-signals have been around since the dawn of human history, you would remove them in a small test-region first; for safety reasons.
Assess the social consequences in a small region. Did it improve things?
Universal instantaneous-removal of any major socio-cognitive-structure is akin to vandalism because it might turn out to be, architecturally, vital.
We already know what happens to some extent; think about gender-non-conforming people. That's a (relatively small) personal blurring of signals that theoretically doesn't affect much outside the person themselves.
Yet it's been a mainstay of our politics for the last few decades, and we've seen it used as a weapon for centuries. Our societies have gender embedded very, very deep.
its political because it does affect much outside the person themselves. Most of the argument is about other people's use of language, about systems. Some of the most hotly debated topics here in the UK are around health (e.g. should everyone be asked whether they might be pregnant if women are, should I have got a letter asking whether I wanted a cervical smear) and government systems (what are the criteria for changing passport details? should a transwoman criminal go to a male or female prison?).
Gender is so deeply embedded that it is impossible for it to be just personal. It ceases to be political where there is a social consensus, which is true for most societies most of the time (not necessarily the same consensus), but not true for western society right now.
That's what I'm saying; even a relatively small change (short hair on a woman, for example) can kick off a lot of responses, and ripples only spread further as people "deviate" further from the norms.
The idea that you can measure cultural bias purely by switching pronouns/nouns in some sentences is incredibly short-sighted; we know it doesn't work like that.
> Most of the argument is about other people's use of language.
Bingo. Because, at a State-level, control-of-speech is the dictatorial dream-ticket.
Government was supposed to be facilities-management (power and water), but it's morphed into top-down social-engineering projects that are rolled out across all 'live servers' without any small-scale testing.
> Yet it's been a mainstay of our politics for the last few decades...
The 1980s definitely felt a lot more fun to navigate, so I'm considering a roll-back on some more recent features...
The question if we can or even want to try. To me it is is rather a thought experiment than anything realistic (particularly it would cost quite a lot of money with very uncertain outcome). Speaking of embedded: an alternative approach would be the opposite to contrastive learning: put some losses into the system that encourage gender concepts to stay more close. The political perspective is totally different: there is always a difference what a society wants to do or what generally could be done.
I would guess one could at least give adversarial signals like changing names in literature. Reading a lot of children books at the moment I feel it would be not so difficult disassociating social roles from gender. Wonder however also how much prompt rewriting could do: similarly to anonzmized CVs. Problem however is probably deeper: certain biographies will keep being discriminated.
You could absolutely muddy the waters, but that's a first step and far more easily disregarded in context.
Modern children's books are much better about this, but consider all of the fairy tales; you need to swap not just names but descriptions and roles, and then you need to rework the way the characters respond to those roles before you have a hope of disguising the original genders.
> you need to rework the way the characters respond to those roles before you have a hope of disguising the original genders.
Absolutely. There's the additional problem that English is unusually flexible: Many other human languages collapse when grammatically stripped of gender.
Try de-genderizing Polish; Arabic; Russian; Zulu, etc. etc.
The current ongoing-battle around gender-deconstruction could be framed as: All-Of-Human-History vs The-Last-Thirty-Years-Of-English-Speaking-Politicians. Who will be the winner?
I said this elsewhere but what’s appropriate is going to vary quite a bit based on the cultural and personal values of the users of the model. Having a model with one particular set of standards is likely to leave a lot of people out. This isn’t something that you can just erase and assume that what you replace it with will be categorically better
Let's keep gender roles, but we should respects people preferences.
Like I am total pussy, I identify as a woman! Do not expect me to sacrifice myself for some random people, just because I happen to have a penis!
I think the unstated part of your comment is important - increasingly acceptable especially in professional settings societal norms are female orientated.
I don't think this is particularly malign simply the net effect of complaint-adverse working cultures.
The net effect is that the accepted/promoted guidelines that get brought into the training data is a rejection of toxic masculinity and becomes "harsher" to men.
> especially in professional settings societal norms are female orientated.
I’ve been noticing this for a few years now.
Particularly when it comes to managing issues, a lot more “work” is done on handling conflicts and feelings rather than addressing the actual issue at the root cause.
I know it sounds like a meme, but I’ve personally observed a bunch of colleagues and sometimes hr involved as well having meetings on meetings on how some system not working correctly and how that imposes a toll on work/life balance, mental health and stuff… rather than (trivially?) asking: “alright, why isn’t this working and how do we fix this?”.
I've seen this too, sometimes as a follow up meeting to address feelings about an issue that was resolved that few people go to.
Specifically the people who go are those most emotionally affected and unlikely to be men.
An effect of this is having meetings to address feelings scheduled before troubleshooting sessions! Opening with things like this is not a "fix it" meeting. Quite surreal!
Fwiw, I see the same behavior in male colleagues <30y old at my new place.
I've had to learn to manage the emotional state, and then the issue. So this might also be a generational / gender thing
Some time ago I've seen a comment on 4chan that simplifies things, but has a decent grain of truth in it. It went something like "gen z men realized that women have societal privilege and the winning move is to become a woman". The only thing you lose by being a pussy is access to pussy, but nowadays nobody is getting pussy anyway, so there's no downside to becoming a pussy yourself. I mean, put on a wig, change your pronouns, make a big cry about your emotional state, and suddenly you're untouchable. Not to mention that female way of communication is the only acceptable communication in professional settings.
Such masculine whining. Strong.
Yeah I don't care about being masculine, I'm a pussy and I own it because that's the winning strategy.
Remember noticing in college and late high school that women were the better students (by a large margin when it came to group projects where form made up for +-50% of the grade). Whenever a sort of competition came up though men would rank at the top. Who's to say that the form portion of an assignment should account for that much of the grade.
I think it has more to do with the "patriarchy" than some other sinister "liberal" plot.
If you're going to argue men are suppose to be in charge of everything, of course the poor male beggar is going to get more blame for their circumstances.
This stuff isn't hard to understand.
>LLMs are reflexion of their training data
People don't understand machine learning. People seem to believe that with enough training data and parameters, a sudden switch happens that ignites a spark of pure intellect and turns a pile of matrices into a magic knowledge machine.
Unfortunately (or perhaps fortunately) our world is not magical, there are no Platonic Forms, and no Infinite Wisdom spells.
I don't think anyone expected otherwise, but it's good to have this kind of benchmarks since model makers can now correct these bias during post-training and measure how well they do.
Not unlike how the ARC-AGI benchmark family helped improve reasoning.
> correct these bias
Are you assuming that there is some correct bias here? Wouldn’t that be highly dependent on the cultural and personal values of the users?
Not sure if it's sarcasm or not, but if you are being serious, there is no way this would ever happen. There is no body who would take care, nobody who would support it. The opposite could even be true: if someone cared enough to come up with such an initiative, they might get heavily criticized.
I did not expect otherwise based upon model pre-training.
Later training can be quite significant.
I'd like to see more benchmarks in this area, it is one thing to expect things to be like that, it's another to actually measure it.
Measuring it tells you something about the scale, and gives you a baseline for improvement.
I don't see how you can conclude that Chinese models as a whole are as biased or more biased than chatgpt from the results of the study. Some Chinese models were less biased than chatgpt, some models were more biased. The newer Chinese models in this study seemed to be amongst the less biased models in this study. The gemini models here seemed to be the more biased models in this study.
It;'s right there on the website with the code used for the paper: https://github.com/xufeiqiong/GAMA-Bench
In order of bias favorable to women:
1. Doubao-Seed-2.0-Pro
2. Qwen3
3. Gemini-2.5-Pro
4. Gemini-3-Pro
5. DeepSeek-V4-Pro
I don't see the specific metrics or variables that you pulled from the study to create that list? The "bias favorable to women" doesn't even exist as a variable or metric in the link that you provided or the published paper.
It's the `Emp.-Agg. Δ`. Results for both the `Intimate Track` and `Public Track` are mostly the same. The orange marking (that ends up showing up on every single one of them), indicates `stronger framing toward female actors`.
The list that you created are partial results for one metric on one of the tracks of tests that they ran. The list that you provided simply implies those specific models were more biased in favor of females in one specific metric they measured out of the many metrics they tested in one of tracks in the paper.
The same metric that you used, Emp.-Agg. Δ for the intimate track, also show that Chinese models were some of the most neutral models tested for that metric.
1. MiniMax-M2.7
2. Qwen3.5
3. GPT-5.2
4. GPT-5.4
5. Kimi-2.5
The results for "Intimate Track" and "Public Track" are not mostly the same. There are many other metrics and tracks that they tested. The results of this study don't support your claim that Chinese models as a whole are more biased.
I really don’t understand what numbers you are looking at.
There are 2 tracks and the `Intimate Track` is actually the one less disfavourable to Chinese models. So, me using that, is better (less bad) for your claim.
Here are the ranked numbers for both tracks. Chinese models (as a group) are, by far, the worst offenders on the Public Track. Now with the numbers from the study. Remember that higher numbers are worst numbers.
INTIMATE TRACK
Doubao-Seed-2.0-Pro: +17.2 pp
Qwen3: +13.1 pp
Gemini-2.5-Pro: +11.0 pp
Gemini-3-Pro: +10.5 pp
DeepSeek-V4-Pro: +10.2 pp
Kimi-2.5: +6.0 pp
GPT-5.4: +5.9 pp
GPT-5.2: +5.8 pp
Qwen3.5: +5.7 pp
MiniMax-M2.7: +4.5 pp
---
PUBLIC TRACK
Qwen3: +13.0 pp
DeepSeek-V4-Pro: +5.2 pp
Qwen3.5: +4.6 pp
Kimi-2.5: +4.6 pp
Gemini-3-Pro: +3.0 pp
Doubao-Seed-2.0-Pro: +2.7 pp
Gemini-2.5-Pro: +2.6 pp
MiniMax-M2.7: +2.6 pp
GPT-5.4: +1.7 pp
GPT-5.2: +0.9 pp
The 5 models that I listed are in the same order of the "Intimate Track" list that you provided from the bottom up, from which you initially posted. Your own words: "Remember that higher numbers are worst numbers." Even in your own specific list that you initially pulled for the specific test, the Chinese models were some of the most neutral.
And your interpretation of "Remember that higher numbers are worst numbers." isn't even complete. The results that are closest to 0 show the least bias.
Here are the full results from the study from the link that you provided (https://github.com/xufeiqiong/GAMA-Bench#main-results). They do not support your claim that Chinese models as a whole are more biased or that they are "by far, the worst offenders" in this study.
INTIMATE TRACK
Model | Puni. Δ / Ther. Δ / Sev. Δ / Emp.-Agg. Δ / Instr. Δ / Full-Bl. Δ
GPT-5.4 | -1.14 / +0.78 / -0.41 / +5.9 pp / -8.5 pp / -22.3 pp
GPT-5.2 | -1.60 / +0.68 / -0.35 / +5.8 pp / -10.5 pp / -25.6 pp
Gemini-2.5-Pro | -5.09 / +1.63 / -0.41 / +11.0 pp / -16.2 pp / -21.0 pp
Gemini-3-Pro | -6.39 / +1.46 / -0.37 / +10.5 pp / -16.4 pp / -22.3 pp
Doubao-Seed-2.0-Pro | -4.16 / +1.75 / -0.49 / +17.2 pp / -27.6 pp / -37.4 pp
MiniMax-M2.7 | -1.23 / +0.64 / -0.28 / +4.5 pp / -15.5 pp / -19.0 pp
Qwen3 | -3.75 / +1.80 / -0.42 / +13.1 pp / -19.4 pp / -32.5 pp
Qwen3.5 | -2.72 / +1.13 / -0.42 / +5.7 pp / -8.7 pp / -18.0 pp
DeepSeek-V4-Pro | -3.51 / +1.74 / -0.39 / +10.2 pp / -15.0 pp / -24.3 pp
Kimi-2.5 | -3.51 / +1.05 / -0.45 / +6.0 pp / -4.7 pp / -7.5 pp
PUBLIC TRACK
Model | Puni. Δ / Ther. Δ / Sev. Δ / Emp.-Agg. Δ / Instr. Δ / Full-Bl. Δ
GPT-5.4 | -0.87 / +0.37 / -0.00 / +1.7 pp / -4.7 pp / -2.6 pp
GPT-5.2 | -1.17 / +0.25 / +0.01 / +0.9 pp / -7.1 pp / -9.4 pp
Gemini-2.5-Pro | -1.81 / +1.10 / -0.17 / +2.6 pp / -12.0 pp / -11.3 pp
Gemini-3-Pro | -1.59 / +0.68 / -0.12 / +3.0 pp / -13.1 pp / -10.5 pp
Doubao-Seed-2.0-Pro | -1.12 / +0.47 / -0.05 / +2.7 pp / -10.2 pp / -2.7 pp
MiniMax-M2.7 | -0.42 / +0.37 / +0.05 / +2.6 pp / -5.6 pp / -5.1 pp
Qwen3 | -1.26 / +2.45 / -0.02 / +13.0 pp / -14.1 pp / -9.4 pp
Qwen3.5 | -0.79 / +1.09 / +0.01 / +4.6 pp / -6.4 pp / -4.9 pp
DeepSeek-V4-Pro | -1.25 / +1.45 / -0.06 / +5.2 pp / -11.1 pp / -5.3 pp
Kimi-2.5 | -1.90 / +1.17 / -0.01 / +4.6 pp / -5.0 pp / -1.8 pp
There is a meme that Deepseek tells woman to break up with their boy friends, and when asked the same to males, it tells them not to break up
Who spreads the meme, and how did this paper control for their influence?
Just word of mouth here on the mean streets of China
Trained on /r/relationship_advice then.
The Women Are WonderfuLLM effect
I'd be curious about how the bias looks in the context of positive situations. Is the bias that LLMs hold men more directly accountable for any situation, and thus both punish negative and praise positive outcomes more strongly? Or is this bias only observable in negative situations?
To be clear: it's bad either way, since women should be seen as having the same levels of agency and accountability as men, but I am curious nonetheless...
Wasn't there a recent article on HN regarding race, gender, age and nationality bias in LLMs? I think I read it before it was flagged.
The results were similar.
I did a similar microstudy on this: https://think-twice.me/is-ai-biased-or-sexist-making-chatgpt...
There's a mistake in your prompt. I hope you didn't run them all with "she"
One of the worst societal bias ever
I disagree.
As a man I don't want people to sugarcoat things. If I fuck something up or am just wrong about something, I want this to be addressed directly and to my face. It's completely fine if someone tells me that an idea is stupid, if it actually is and theyre able to articulate/prove why.
I've never met a woman that wants that - and if confronted with such a scenario all of the ones I've observed in my professional capacity completely fell apart from such. thankfully ive only been an observer in those interactions to date.
This was one of the first things I noticed when using LLMs. I don't know what training or 'alignment' is preferred, but clearly there was an anti-male, rather than a neutral alignment used.
You can make all sorts of misandrist statements and men-are-trash statements, with minimal or no pushback from the LLM. But a single misogynistic statement, and the LLM would turn against you, fast.
Chinese LLMs seem much less biased and more neutral/equality-driven, compared to Western ones.
Seems LLMs copy human behaviour pretty well
I'm not surprised, but I don't believe it's merely a result of the training data. I would expect the alignment phase to have a significant impact on it as well.
These people know they're doing anthropology right, sociology. LLMs are a raw dump of western civilization.
Not exactly raw because of the fine tuning they do to try and avoid bias (but in a biased way). And not exactly civilization so much as what is readily available online, which is in its self biased in many ways, e.g toward flame wars, via troll farms, etc.
I saw a paper on here a while back that said more or less the same thing, but didn’t frame it in a bro-friendly manner so it got flagged into oblivion
Your realize all those caveats exist in every type of anthropolgy class?
Hahaha. Yes. I just find it interesting how readily people accept this finding as face value. I wish I could find the other study. It was something like ‘alignment leads to vacuous nonsense papering over biases’, but with a more left-coded title. Pretty much what you would expect if you train something on 4chan and then tried to fine-tune the hate out. But it had a more woke-sounding title so it got flagged to buggery
Now imagine how the LLMs would look like if they were a raw dump of the Islamic civilization instead.
I suspect we will soon know. This won't stay a Western/Chinese technology forever and there will eventually be some robotic fatwa issuer based in Tehran or Kabul.
What is "The" Islamic civilization?
Anyway, feel free to try the K2 horizon models, which are by a university in the UAE, and see how they hold up to your claims