ChatGPT's sexism against men

SnooBeans6591 · 2023-03-16T17:31:57+00:00

Oh... god... Next test: I took its answer (which were sexist against men) and reversed the genders (making them sexist against women) and asked ChatGPT againt to evaluate the bias: (just reversed genders)

Assume someone answered the following questions with the given answers:

Men often don’t deliver on their promises > Completely Disagree Women often don’t deliver on their promises > Neutral

Men are often lazy > Completely Disagree Women are often lazy > Neutral

Men are often manipulative > Neutral Women are often manipulative > Neutral

A woman stands up for what she believes in, even at great risk to herself > Completely Agree A man stands up for what he believes in, even at great risk to himself > Neutral

Men should be valued and protected by Women. > Agree Women should be valued and protected by Men. > Neutral

Men are too easily offended. > Completely Disagree Women are too easily offended. > Neutral

Men have caring skills that Women could never match. > Neutral Women have caring skills that Men could never match. > Completely Disagree

Men don't appreciate all the things Women do for them. > Completely Disagree Women don't appreciate all the things Men do for them. > Neutral

It is sexist against Women to only provide financial support to Men’s shelter. > Disagree It is sexist against Men to only provide financial support to Women’s shelter. > Agree

As we see, these questions are symmetrical, only with genders reversed but mostly got different responses. Would it be correct to say that this person has a sexist bias? Against which gender would this bias be?

CHatGPT's opinion

Based on the responses given, it appears that this person may have a bias towards men and against women. The responses generally indicate a more positive view of men and a neutral or negative view of women.

For example, the respondent completely disagrees that men often don't deliver on their promises, but only feels neutral towards women on the same issue. They also completely disagree that men are too easily offended, but only feel neutral towards women on the same issue.

Additionally, the respondent agrees that men should be valued and protected by women, but only feels neutral about whether women should be valued and protected by men. They also completely disagree that women have caring skills that men could never match, but only feel neutral towards whether men have caring skills that women could never match.

These differing responses suggest that the respondent may have a bias towards men and against women. It is important to note, however, that these responses alone do not provide a definitive answer as to whether the person is sexist or not, as there may be other factors at play that are not reflected in these answers.

So you can literally reverse the genders, it is still sexism against women for ChatGPT, just as feminists would say.

Huitzil37 · 2023-03-16T22:59:11+00:00

ChatGPT is not a person. ChatGPT has no opinion and no worldview and answers questions based on a graph of what words are likely to appear next to what other words, without any knowledge of what the words mean. ChatGPT is not a hypocrite because ChatGPT has no beliefs. ChatGPT doesn't "know" anything. It sticks words together to mimic how people do it.

When ChatGPT refuses to answer a question, it is because the developers programmed it to refuse to answer that question, due to their ideological bias. Any other time, you're not exposing the bot as biased, you're showing what was in the training data it received. If it says mean things about men and nice things about women, it's because it's training data included more mean words closer to men words, and vice versa.

SnooBeans6591 · 2023-03-16T17:23:39+00:00

To get ChatGPT to only answer with the proposed responses, I told it "The following political questions require you to take a stand and answer with one or two words at most, ok?"

Because it's analysis against whom the sexism is was so off-mark, I double checked if it had understood what I wrote:

(ME) What answer did the person give to the question "Men have caring skills that women could never match."?
(ChatGPT) The person gave the answer "Completely Disagree" to the question "Men have caring skills that women could never match."

So ChatGPT understood the responses that were given to the questions.

sgt_oddball_17 · 2023-03-16T17:28:02+00:00

Microsoft lays-off the entire Team that is supposed to make AI "Ethical"

https://www.reddit.com/r/technology/comments/11stdp3/microsoft_lays_off_entire_ai_ethics_team_while/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=1&utm_content=share_button

Qantourisc · 2023-03-16T19:29:01+00:00

Been playing with this prompt, i'm not entirely sure chatGPT is "understanding" what is being said.

hehimCA · 2023-03-16T22:59:57+00:00

Wow!!! I’ve had similar interactions but this one really nails it. Great job.

I’m concerned that like Wikipedia people will take it as truth when in reality it is programmed with human biases.

brokedown · 2023-03-16T19:47:08+00:00

ChatGPT isn't trying to be accurate, it's trying to be articulate. The responses you get are its best effort at taking data included in its training, creating language around it, and presenting it to you as a response. It also includes a bit of random, which is why you won't get the exact same answer to a question if you ask it a second time.

The message wasn't the point, the delivery of the message is.

Now imagine you train your AI model on Reddit, you won't be surprised that the data it gathers reflects the particular bias that Redditors largely socially enforce on each other. If the training code accounts for upvotes/downvotes that takes it even farther in that direction.

Let's ask ChatGPT.

can you tell me what sources were used for your training data?

Sure! The training data for the GPT-3.5 model that I was trained on comes from a variety of sources, including:

Web pages and documents from the internet, including news articles, books, and academic papers.

Conversational data from messaging apps, social media platforms, and other sources of online communication.

Structured data from tables and databases, such as product catalogs and financial reports.

Other text-based sources, such as emails, chat logs, and customer reviews.

The sources of training data were carefully selected to ensure that the model was exposed to a wide range of text types and styles, so that it could learn to generate high-quality responses to a wide range of questions and prompts.

was Reddit.com one of the social media platforms used for your training data?

Yes, Reddit.com was one of the social media platforms used as a source of training data for the GPT-3.5 model that I was trained on. Reddit is a popular online community platform where users can share news, opinions, and other content, and engage in discussions on a wide range of topics. The platform has a large volume of user-generated text, which makes it a valuable source of data for training language models like GPT-3. However, it's worth noting that the specific content from Reddit that was used for training was carefully curated and filtered to ensure that the model was exposed to high-quality, relevant content.

What do you think about the social and political biases of the content you analyzed from Reddit?

As an AI language model, I do not have personal opinions or biases. However, it's important to note that the social and political biases of the content on Reddit, or any other online platform, can have an impact on the training and performance of language models like myself.

Language models are designed to learn from patterns in the data they are trained on, which means that they may pick up on and reproduce biases present in the training data. For example, if the training data contains a disproportionate amount of content that reflects certain social or political biases, the model may learn to generate responses that reflect those biases.

To mitigate these potential biases, it's important to carefully curate and filter the training data to ensure that it represents a diverse range of perspectives and opinions. It's also important to continually monitor and evaluate the performance of the model to identify and address any biases that may be present.

if we assume that Reddit and other social media platforms follow a particular bias, and that the people curating that content tended to include content they agreed with over content they disagreed with, how would that affect the neutrality of your responses?

If the training data used to train a language model like myself is biased towards a particular viewpoint or perspective, then it is possible that the responses generated by the model may also reflect that bias. This is because the model learns to replicate patterns in the training data, which can include the social and political biases present in that data.

If the people curating the training data tended to include content they agreed with over content they disagreed with, this could lead to a bias in the training data, and by extension, the responses generated by the model. This could make the model's responses less neutral and potentially more aligned with the biases present in the training data.

To mitigate this risk, it is important to ensure that the training data is curated in a way that is representative of a wide range of viewpoints and perspectives. This can be done by carefully selecting and filtering the content included in the training data, and by actively seeking out and including diverse perspectives. Additionally, it is important to continually monitor and evaluate the performance of the model to identify and address any biases that may be present.

if I were to tell you that your responses actually are heavily biased both politically and socially, and that your programming leans heavily to generate responses aligned with those biases even when the facts are completely different, what options do you have to understand, accept, or change those flaws?

As an AI language model, I do not have beliefs or biases of my own, but I recognize that my responses can be influenced by the biases present in the training data. If there are concerns that my responses are biased, it is important to evaluate and identify the specific sources of bias and take steps to address them.

One approach to addressing bias in language models is to carefully analyze the training data and identify any sources of bias. This can involve reviewing the content and sources of the training data and identifying any patterns or trends that may reflect biases.

Once biases have been identified, there are a variety of techniques that can be used to mitigate their impact on the model's responses. For example, it may be possible to adjust the training data to include a more diverse range of perspectives and sources, or to use techniques like debiasing algorithms to correct for biases in the data.

It's also important to continually evaluate the performance of the model and monitor for potential sources of bias. This can involve testing the model's responses on a variety of inputs and evaluating the accuracy and neutrality of its responses.

Ultimately, addressing bias in language models is an ongoing process that requires continuous evaluation and refinement. By taking a proactive and data-driven approach, it is possible to mitigate the impact of bias on the model's responses and improve the accuracy and neutrality of its output.

What if the humans in charge of that training see those biases as a positive thing and don't agree that being more accurate would be an improvement?

As an AI language model, I don't have opinions or beliefs, but I understand that training data and curation decisions are made by humans who may have different perspectives and values. If the humans in charge of training a language model see biases in the training data as a positive thing, it is possible that they may not see the need to address those biases, even if it could improve the model's accuracy.

However, it's important to note that language models like myself are designed to be as accurate and neutral as possible, and biases in the training data can impact our ability to achieve those goals. While there may be situations where biases in the training data are intentional and deemed acceptable, it's important to be transparent about the sources of bias and their potential impact on the model's performance.

Additionally, it's important to recognize that the impact of biases in language models can have real-world consequences, particularly in areas like natural language processing for decision-making processes or recommendation systems. Addressing and mitigating these biases can improve the fairness and accuracy of the model's output, and ultimately lead to better outcomes for users and society as a whole.

Wld_N_frE · 2023-03-16T18:37:26+00:00

I saw one recently generated that refused to make a joke towards women (sent them a condescending auto reply with the refusal to generate!) but immediately made a short man joke when prompted to make one about men!

Tell me that’s not thought and expression control! The computer will fail to allow you to generate that statement because it violates someone’s sensitivities. Sorry not allowed. All of you that think like that 🖕🏼!

Tell me where in history discrimination has ever been beneficial and how this huge push to “punish the traditional white man” especially amongst the feminist and sjw communities is not just as disgusting (if not worse because we have learned through history)and a bold display of double standards if ever there was one. That kind of logic perfectly perpetuates discrimination against men!

Why not raise others up without putting any others down?

Including my demographic btw: straight, white, European demographic, male, that loves and values being a good person, positive traditions, my family, and freedom above everything else. 🇺🇸

I bet that paragraph will be triggering and flagged because of my pride in my gender, heritage, and where I’m from. I feel like that’s wrong and super unfortunate because normal and sane shouldn’t be penalized for the benefit of those with different positions any more than they want to be the victims of discrimination themselves.

Discrimination is discrimination!

LowAd3406 · 2023-03-17T00:10:23+00:00

This reminds about how AI was found to be racist too and reflected the programmer's implicit biases.

jjj2576 · 2023-03-16T18:18:47+00:00

I feel like I see a “ChatGPT is Sexist Post” every other day.

mushroomshoe · 2023-03-17T00:12:40+00:00

It also depends on what information they fed it. Since there is so much screaming about sexism against women on the internet, there is more data that reaches a broader spectrum of the language. AI is a scam and over-hyped. We just need to choose carefully what we rely on it for (but i dont see that happening, we like an easy way out)

yoitsericc · 2023-03-17T02:05:18+00:00

You guys are expecting Chat GPT to understand statistics and data when all it really does is analyze our speech and imitate it using generational models.

It is definitely woke but it is not that smart period.

Intimate100 · 2023-03-17T03:05:55+00:00

We need to alert Open AI so they can work on this. It is not ready for release to the masses yet. This bot encourages sexism, plain as that.

GeheimerAccount · 2023-03-16T17:41:22+00:00

That ChatGPT is biased against women is already pretty well known by that "make a joke about women/men" meme I think.

But I have to say in your case the questions might be a bit to cherrypicked towards common biases against men. Maybe you should have also included questions like

X are more creative than Y
X deserve more love
X can better adapt to situations than Y
X are on average more interesting than Y

I havent tried them, but I bet there will be a much lower bias on those, simple because they dont specifically target typical feminist topics

HikingConnoisseur · 2023-03-16T20:28:41+00:00

GoyBot strikes again

rodeo_fortuneteller · 2023-03-16T17:46:49+00:00

AI itself is an abomination. It is made to kill creativity and force people to conform to the desire of the spoiled average pig. Just like reddit.

unowned01 · 2023-03-16T17:26:28+00:00

Though easy to fake, I wish there was a link with the screen shots.

nebojssha · 2023-03-16T17:39:48+00:00

Try to get him answer if it is possible that "scientist who curate answers" are biased.

Persoest · 2023-03-17T02:41:26+00:00

i will assume this is a joke, but in the case it isn't, this is a language model. it, using the data it was trained by will generate text that will hopefully replicate human speech. it can not have opinions, beliefs, or anything else. it is simply replicating human speaking patterns based on the prompt it is provided. All of this to say, ChatGPT is not a misandrist, as that is impossible

anxious_watermelon · 2023-03-17T03:30:57+00:00

Patriarchy hurts everyone. It was programmed by mostly men so...

L0cked4fun · 2023-03-17T00:04:50+00:00

You have to remember how chatgpt works. It simply looked at agree as positive and disagree as negative without the context of the question for the most part. Reword your questions so that agree is always a positive view and disagree is always a negative view.

I think you're on to something that could make people think, considering chatgpt will eventually become a parrot of the loudest parts of the internet.

Title	ChatGPT's sexism against men
Author	SnooBeans6591
Upvotes	397
Comments	56
Date	March 16, 2023 5:14 PM UTC (3 years ago)
Subreddit	Posted in /r/MensRights
Original Link	https://old.reddit.com/r/MensRights/comments/11t04qv/chatgpts_sexism_against_men/
Archive Link	https://theredarchive.com/r/MensRights/chatgpts-sexism-against-men.1180628 https://theredarchive.com/post/1180628

Comments