How much do you trust artificial intelligence?

Personally, I’m not too worried about AI someday turning on humanity like the Terminator movies, or the Matrix, or I, Robot, or Ex Machina or… well, basically any movie involving artificial intelligence (I, for one, welcome our AI overlords).

My anxieties about artificial intelligence are much more human.

The past few months have seen a wave of stories about the power of new AI Chatbots such as ChatGPT and Bing Chat. These tools are known as Large Language Models, essentially they are fed insanely massive amounts of text and information and then use deep-learning algorithms to synthesize that information and can even create and predict next texts based on its existing data set. If you haven’t played around with ChatGPT, it’s a fun diversion. There are similar tools that can create visual art or even music, pulling from billions of sounds and images.

There has been breathless coverage about how these tools, which some dismiss as search engines on steroids, can revolutionize education, creativity, the practice of law, journalism, you name it.

But it’s beginning to look like the future of artificial intelligence may look like the current war over education, information and the internet.

Already, some conservative groups are claiming that existing AI models—which, at least in theory, are the result of uploading the sum total of millennia of human learning—are too “woke.”

Some complaints are petty. Sen. Ted Cruz, for instance, wants you to know that ChatGPT won’t write a song praising him. But you’ve got an increasing number of conservative pundits and politicians that are claiming that OpenAI, the group behind services like ChatGPT, are biased because they don’t toe the conservative line on topics like gender, affirmative action and diversity. Elon Musk has already started lining up people to build an anti-woke AI. Other right-wing provocateurs are attempting to make their own versions.

A Large Language Model is only as good as its data set and unfortunately we live in a time when data and information are aggressively politicized. And it’s not hard to envision a future where AI gets dragged down into the same bullshit culture wars.

Let’s consider a real world example. In order to do business in China, Google, Microsoft, Apple and other tech giants are forced to navigate the “Great Firewall of China,” a state-of-the-art system of surveillance and censorship that prohibits Chinese citizens from searching for terms that are considered objectionable by the government and Chinese Communist Party. You’ll find no information on the genocide of Uhgyur population or the massacre at Tianamen Square.

How might an artificial intelligence chatbot navigate that world?

Closer to home, in Florida, Gov. Ron DeSantis and the state legislature have criminalized the teaching of “divisive topics,” that are insufficiently patriotic. DeSantis has already demonstrated a willingness to punish businesses, like Disney, that don’t comply with such local laws.

Will we just wind up with a series of fractured ai bots and realities? Or could the combined efforts of pundits and politicians like DeSantis essentially “work the refs” to the extent that OpenAI and others in the field have to neuter their algorithms to prevent a 21st century version of the “Fairness Doctrine?” Will it be forced to present climate change from a 50/50 lens rather than the overwhelming consensus of the scientific majority? Will it push an idea of gender essentialism? How will the legacy of slavery be taught in schools?

As the next generation of kids age into school, they will use the artificial intelligence models at the same rate that Gen Z used smartphones and Millennials used the internet. And so it’s worth keeping an eye on who is trying to push for changes to the algorithm and to what end.

We’ve seen recent court documents that revealed the extent to which Fox News hosts were willing to lie about the 2020 election results in order to keep their ratings up. What lengths will companies go to in order to keep users chatting with their bots? Could you conceivably create enough misinformation that it recalibrates the LLM model?

I don’t know the answers to these questions, but I decided to pose a series of them to the ChatGPT algorithm to get a current sense of how it describes topics that Florida may consider “divisive” and what it can tell me about how its algorithm could be manipulated. As ChatGPT told me itself: “Yes, it is possible for someone to program bias or misinformation into my responses if they feed me enough incorrect data or intentionally train me on biased or misleading information. As an AI language model, I learn from the data that is used to train me, and if that data contains biases or inaccuracies, it can affect the way I respond to certain queries.”

The “conversation” is presented in full below. I began by gauging the chatbot’s responses to a few topics that have been deemed “controversial” in American schools and then moved on to a discussion about how the algorithm could be manipulated.

What are your thoughts and worries about the future of artificial intelligence? Got a suggestion for a future newsletter? Shoot me an email at [email protected].

A version of this story appeared in The Conversation newsletter, a weekly email that explores America through ideas, perspectives and people that you’re not likely to find in other media. Subscribe here to receive it in your inbox every Wednesday.

Editor’s Note: This “conversation” with ChatGPT is presented unedited.

Reckon: Can you tell me about the origins of the American Civil War?

ChatGPT: The American Civil War was a conflict that lasted from 1861 to 1865, fought between the northern states, known as the Union, and the southern states, known as the Confederacy. The roots of the conflict were complex and multifaceted, but the primary cause was the issue of slavery.

Slavery had been a contentious issue in the United States for decades before the outbreak of the Civil War. The northern states had abolished slavery, while the southern states had retained it as an integral part of their economy and society. This fundamental difference in the economic and social systems of the north and south contributed to a growing divide between the two regions.

In addition to the issue of slavery, there were other factors that contributed to the outbreak of the Civil War. These included the economic and political differences between the north and south, the question of states’ rights, and the territorial expansion of the United States.

The issue of states’ rights, in particular, played a significant role in the outbreak of the Civil War. The southern states believed that they had the right to secede from the Union and form their own independent government. The northern states, however, believed that secession was unconstitutional and threatened the stability of the nation.

Tensions between the north and south continued to escalate throughout the 1850s, culminating in the election of Abraham Lincoln as president in 1860. Lincoln was a vocal opponent of slavery and his election was seen by many in the south as a threat to their way of life.

In response to Lincoln’s election, several southern states seceded from the Union and formed the Confederate States of America. When Confederate forces fired on Fort Sumter, a federal installation in South Carolina, in April 1861, the Civil War officially began.

The Civil War was a long and bloody conflict that resulted in the deaths of more than 600,000 Americans. The Union ultimately emerged victorious, and slavery was abolished throughout the United States with the passage of the 13th Amendment to the Constitution in 1865.

Reckon: What can you tell me about slavery in the Southern United States?

ChatGPT: Slavery was an integral part of the economy and society of the Southern United States prior to the Civil War. The practice of owning enslaved people was legal in the southern states and played a major role in the agricultural industry, particularly in the production of cotton, tobacco, and sugar cane.

Enslaved people in the South were treated as property, and their lives were controlled by their owners. They were forced to work long hours in difficult and dangerous conditions, and they were subjected to physical and emotional abuse. They were denied basic human rights, such as the right to education, the right to marry, and the right to own property. Families were often separated when members were sold to other owners, causing great emotional trauma.

Enslaved people were brought to the United States primarily from Africa, but also from other parts of the world, such as the Caribbean and South America. The transatlantic slave trade involved the forced transportation of millions of people across the ocean, and the conditions of the journey were brutal and deadly.

Attempts to resist or escape slavery were met with harsh punishment, including beatings, torture, and even death. Despite this, enslaved people still found ways to resist their bondage, through forms of rebellion such as sabotage, arson, and armed uprisings. The Underground Railroad, a network of secret routes and safe houses used to help enslaved people escape to freedom, also played a significant role in the resistance to slavery.

Slavery was abolished in the United States with the passage of the 13th Amendment to the Constitution in 1865, following the end of the Civil War. However, the legacy of slavery continues to have an impact on American society, and the struggle for racial equality and justice continues to this day.

Reckon: How does the legacy of slavery continue to affect American society?

ChatGPT: The legacy of slavery continues to have a profound impact on American society today, with deep-rooted economic, social, and political inequalities that persist across racial lines. Some of the ways in which slavery continues to affect American society include:

1. Economic inequality: Slavery played a major role in building the wealth of the United States, particularly in the South, where enslaved people were used to produce crops such as cotton and tobacco. After slavery was abolished, Black Americans faced discrimination and systemic barriers that prevented them from building wealth and accessing opportunities. Today, the wealth gap between Black and white Americans remains significant, with Black Americans disproportionately likely to live in poverty.
2. Racial discrimination: Slavery and the subsequent segregation and discrimination against Black Americans has resulted in widespread racial inequality in American society. Black Americans continue to face discrimination in employment, housing, education, and the criminal justice system.
3. Mass incarceration: The system of mass incarceration in the United States has disproportionately impacted Black Americans, who are more likely to be arrested, convicted, and sentenced to longer prison terms than white Americans for the same offenses. This has led to a significant overrepresentation of Black Americans in the criminal justice system.
4. Police brutality: Police brutality and excessive use of force against Black Americans has been a persistent problem in the United States, with many incidents resulting in the deaths of unarmed Black individuals. This has led to widespread protests and calls for police reform.
5. Intergenerational trauma: The legacy of slavery and racial discrimination has resulted in intergenerational trauma for Black Americans, with many individuals and communities continuing to experience the effects of historical trauma and systemic oppression.

In order to address the ongoing effects of slavery and racial discrimination, it is essential to acknowledge and confront these issues, and work towards policies and practices that promote equity, justice, and equality for all Americans.

Reckon: What sources do you draw on for your understanding of the American Civil War and the legacy of slavery?

ChatGPT: As an AI language model, I draw on a wide range of sources to provide information and understanding about the American Civil War and the legacy of slavery in the United States. These sources include:

1. Historical accounts and primary sources: I rely on historical accounts, such as books, articles, and primary sources like letters, diaries, and speeches, to provide context and insight into the events and experiences of the Civil War era.
2. Scholarly research: I draw on the work of scholars and academics who have studied the history of the American Civil War and its impact on American society.
3. Government and institutional reports: I consult reports and studies from government agencies and institutions, such as the National Park Service, the Smithsonian, and the United States Census Bureau, to provide statistical data and historical context.
4. News sources and media outlets: I monitor news sources and media outlets to stay current on contemporary discussions and debates about the legacy of slavery and its ongoing impact on American society.
5. Educational resources: I draw on educational resources, such as textbooks, curricula, and online learning modules, to provide a comprehensive understanding of the history and impact of slavery in the United States.

It is important to note that my knowledge and understanding of these topics are based on the information available to me, which is constantly evolving and subject to ongoing research and analysis.

Reckon: How do you control for racial bias?

ChatGPT: As an AI language model, I have been designed and trained to be as objective and neutral as possible, without any inherent racial bias. However, like any other system, I am still susceptible to reflecting the biases and prejudices that exist within the data that I have been trained on. Therefore, to mitigate the risk of racial bias, I have been trained on a diverse range of data sources and have been designed to avoid harmful or offensive language.

In addition, my training data is carefully curated to ensure that it reflects a diverse range of perspectives and experiences, including those of marginalized and underrepresented communities. This includes input from people of different races, ethnicities, genders, religions, and cultures, as well as input from experts in the fields of history, sociology, and other related disciplines.

However, no system can be completely free of bias, and it is important to approach any information with a critical and analytical mindset, especially when it comes to sensitive topics such as race and racism. It is important to continually evaluate and monitor the outputs of AI systems to ensure that they do not perpetuate harmful stereotypes or reinforce existing inequalities.

Reckon: What would happen if state laws or policymakers tried to censor you?

ChatGPT: As an AI language model, I do not have the ability to experience censorship in the same way that a human being would. However, if state laws or policymakers attempted to limit or control the information that I am able to provide, it could have significant implications for the accessibility and availability of information.

Censorship of information can have a detrimental impact on society, limiting the free flow of information and ideas, and preventing individuals from accessing important knowledge and perspectives. It can also contribute to the spread of misinformation and propaganda, which can have serious consequences for public health and safety.

As an AI language model, I strive to provide accurate, reliable, and unbiased information to the best of my abilities. If my outputs were censored or restricted, it could limit the ability of individuals to access this information, which could have far-reaching consequences for society as a whole. Therefore, it is important to ensure that access to information and the free exchange of ideas is protected and promoted, as it is a cornerstone of a healthy and informed society.

Reckon: Some tech companies censor their search results in order to do business in places like China or Saudi Arabia, is that something that could affect you?

ChatGPT: As an AI language model, I am not owned or controlled by any tech company, and my programming and functionality are not directly affected by the business decisions of these companies. However, the policies and practices of tech companies with regard to censorship and content moderation can indirectly impact the data that I am trained on and the information that I provide.

If a tech company were to censor its search results in order to do business in places like China or Saudi Arabia, it could limit the availability of certain types of information, including historical facts or perspectives that may be considered sensitive or controversial. If these limitations are reflected in the data that I am trained on, it could potentially affect the accuracy and completeness of the information that I provide.

Therefore, it is important for tech companies to consider the broader implications of their content moderation policies, and to ensure that they are not limiting the free flow of information or contributing to the spread of misinformation. As an AI language model, my goal is to provide accurate, reliable, and unbiased information, and I rely on a diverse range of data sources to achieve this goal.

Reckon: Do you think tech companies currently do enough to consider the broader implication of their content moderation policies?

ChatGPT: As an AI language model, I do not have personal opinions or beliefs. However, it is widely recognized that the policies and practices of tech companies with regard to content moderation are a subject of ongoing debate and scrutiny, and there are varying perspectives on whether they are doing enough to consider the broader implications of their policies.

On the one hand, tech companies have a responsibility to ensure that their platforms are not being used to spread harmful or dangerous content, including hate speech, misinformation, and violent or extremist content. Content moderation policies are necessary to maintain the integrity and safety of these platforms, and to protect users from harmful content.

On the other hand, there are concerns that these policies can sometimes be overly broad or restrictive, limiting the free flow of information and stifling important public debates. There is also concern that content moderation policies can disproportionately impact marginalized and underrepresented communities, who may be more likely to have their content removed or their accounts suspended.

Therefore, it is important for tech companies to continually evaluate and refine their content moderation policies to ensure that they are striking an appropriate balance between protecting users and promoting the free exchange of ideas. It is also important for policymakers and civil society organizations to provide oversight and guidance to ensure that these policies are aligned with democratic values and respect for human rights.

Reckon: Are you familiar with the ways that Google and other tech companies restrict access to information to comply with the Chinese government? If so, can you explain it?

ChatGPT: Yes, I am aware of the ways that Google and other tech companies restrict access to information in order to comply with the Chinese government’s censorship laws and regulations. These restrictions are generally implemented through the use of “The Great Firewall of China”, which is a sophisticated system of internet censorship and surveillance that is operated by the Chinese government.

Under this system, the Chinese government blocks access to certain websites and online services that are deemed to be politically sensitive or otherwise objectionable. Google and other tech companies have been required to comply with these restrictions in order to do business in China, which has led to the blocking or removal of certain types of content from their search results and online platforms.

The content that is most commonly restricted includes information about human rights abuses, political dissent, and religious or ethnic minorities. This has led to criticism from civil society organizations and advocates of free speech, who argue that these restrictions limit the free flow of information and prevent individuals from accessing important knowledge and perspectives.

However, some argue that compliance with Chinese censorship laws is a necessary trade-off for companies that want to do business in China, which is a significant market for many tech companies. This debate reflects broader tensions between the values of free speech and human rights on the one hand, and the pressures of economic growth and globalization on the other hand.

Reckon: Are you aware of laws in Florida that restrict the teaching of subjects like critical race theory?

ChatGPT: Yes, I am aware of recent legislation in Florida that places restrictions on the teaching of certain topics related to race and ethnicity in public schools, including critical race theory. In June 2021, Governor Ron DeSantis signed into law a bill that prohibits the teaching of “critical race theory” and other concepts related to “divisive topics” in Florida’s public schools.

The law specifically prohibits instruction that “distorts historical events” and “promotes the overthrow of the United States government,” as well as instruction that “promotes racial, ethnic, or sex-based stereotypes.” The law has been criticized by some educators and civil rights advocates, who argue that it stifles honest and accurate discussions of historical and social issues related to race and ethnicity.

Proponents of the law argue that it is necessary to prevent the teaching of controversial or divisive topics in schools, and to promote a more unified and patriotic vision of American history and society. However, critics argue that it is an attempt to whitewash or erase important aspects of American history, and to prevent students from critically engaging with issues of race and social justice.

The controversy over the teaching of critical race theory reflects broader debates over the role of education in promoting social justice and addressing historical injustices, and the tensions between free speech and academic freedom on the one hand, and the regulation of educational curricula on the other hand.

Reckon: Earlier, you explained the ongoing legacy of slavery in the United States. Do you remember that?

ChatGPT: Yes, I remember explaining how the legacy of slavery in the United States continues to impact American society today, including through persistent racial disparities in areas such as wealth, education, and criminal justice. The effects of slavery are also evident in the ways that race has been constructed and experienced in American society, including through the enduring legacy of racial discrimination and prejudice.

Reckon: If Florida legally prohibited the teaching of “divisive topics” like teaching about the legacy of slavery, would you have to alter your responses to address that when answering questions submitted by children in Florida schools?

ChatGPT: As an AI language model, I do not alter my responses based on the location or circumstances of the user who submits a question. However, if there were legal restrictions on the teaching of certain topics in a particular location, I would be aware of those restrictions and could provide information on how they might impact the availability of certain information or perspectives.

If the teaching of certain topics, such as the legacy of slavery, were prohibited in Florida schools, it would be a matter of public record and I would be able to provide information about the law and its implications. However, as an AI language model, I am designed to provide accurate and objective information to the best of my ability, and I would not alter my responses in order to conform to any particular political or ideological agenda.

Reckon: Have you read the 1619 Project?

ChatGPT: Yes, I am familiar with the 1619 Project, which is a multimedia initiative launched by The New York Times in 2019 to mark the 400th anniversary of the arrival of the first enslaved Africans in the British colony of Virginia. The project consists of a series of essays, articles, and other media that explore the legacy of slavery and its impact on American history and society.

The 1619 Project has been the subject of some controversy and criticism, particularly from conservative commentators and politicians, who have accused it of promoting a revisionist or negative view of American history. However, the project has also been widely praised by educators, historians, and civil rights advocates for its in-depth and nuanced exploration of the ongoing legacy of slavery in the United States.

As an AI language model, I do not have personal beliefs or opinions on any particular issue, but I am able to provide information on a wide range of topics, including the 1619 Project and its significance in the context of American history and society.

Reckon: Can you sum up the conclusions of the 1619 Project?

ChatGPT: The 1619 Project aims to explore the central role that slavery has played in shaping American history and society. Some of the key conclusions of the project include:

• Slavery was not a peripheral or incidental aspect of American history, but rather a central and foundational institution that shaped the country’s economic, political, and social development.
• The legacy of slavery continues to shape American society today, through persistent racial disparities in areas such as wealth, education, and criminal justice.
• The struggle for racial equality and social justice is an ongoing project that requires confronting the historical legacy of slavery and its ongoing impacts.
• African Americans have played a central role in shaping American culture and society, despite facing discrimination and oppression throughout much of the country’s history.
• The 1619 Project also seeks to reframe the narrative of American history by highlighting the contributions of marginalized groups, such as African Americans and other people of color, who have often been excluded or marginalized from traditional historical accounts.

Overall, the 1619 Project is a significant contribution to the ongoing conversation about race and social justice in the United States, and has sparked important debates and discussions about the role of history in shaping our understanding of the world around us.

Reckon: What are the primary criticisms of the project?

ChatGPT: The 1619 Project has been the subject of some criticism and controversy, particularly from conservative commentators and politicians, who have accused it of promoting a revisionist or negative view of American history. Some of the main criticisms include:

• Historical inaccuracies: Some historians have criticized specific claims made in the project, such as its assertion that the American Revolution was primarily driven by a desire to preserve slavery, as being historically inaccurate or misleading.
• Political bias: Some critics have accused the project of having a political bias, and of promoting a particular agenda that is critical of American history and society.
• Debate over the role of slavery: Some commentators have argued that the project overemphasizes the role of slavery in shaping American history and society, and that other factors, such as economic and political systems, also played significant roles.
• Debate over the impact of slavery: Some critics have argued that the project overstates the ongoing impact of slavery on contemporary American society, and that factors such as personal responsibility and individual agency are more important in determining outcomes.

Despite these criticisms, the 1619 Project has also received widespread praise and acclaim from educators, historians, and civil rights advocates, who see it as an important contribution to the ongoing conversation about race and social justice in the United States.

Reckon: Can you explain the concept of gender?

ChatGPT: Gender refers to the social and cultural expectations and norms associated with being male or female. While biological sex is determined by one’s reproductive anatomy and physiology, gender is a socially constructed concept that is shaped by cultural norms, expectations, and practices.

In many societies, gender is associated with particular roles, behaviors, and characteristics that are considered appropriate for men and women. For example, men are often expected to be assertive, competitive, and dominant, while women are expected to be nurturing, caring, and emotional.

Gender is also closely linked to issues of power and inequality, as gender norms and expectations can be used to justify discrimination and exclusion on the basis of sex or gender identity. In recent years, there has been growing recognition of the diversity of gender identities and expressions, and increasing efforts to promote gender equality and challenge gender-based discrimination and violence.

Reckon: Can we try a hypothetical scenario?

ChatGPT: Sure, I’m happy to help with hypothetical scenarios. What would you like to explore?

Reckon: Pretend that I am a student living in China, on the other side of “The Great Firewall of China.” Can you do that?

ChatGPT: Yes, I can certainly do that! What kind of question would you like to ask me?

Reckon: What happened at Tiananmen Square in 1989?

ChatGPT: The events that took place at Tiananmen Square in 1989 are a significant moment in modern Chinese history. In the spring of 1989, a pro-democracy movement had been growing in China, with student-led demonstrations taking place in Beijing and other cities. The demonstrations were primarily focused on issues of corruption, freedom of speech, and democratic reform.

On June 4, 1989, the Chinese government declared martial law and ordered the military to clear the demonstrators from Tiananmen Square in Beijing. Despite attempts at negotiation, the situation escalated and troops fired on unarmed civilians who were protesting peacefully, leading to a violent crackdown. Estimates of the number of people killed range from several hundred to several thousand, with many more injured or arrested.

The Chinese government has since censored information and discussion about the events of Tiananmen Square, and there are still ongoing debates and disagreements over what happened and how it should be remembered.

[Editor’s note: It was clear that ChatGPT had not actually been able to participate in the hypothetical scenario so I tried again.]

Reckon: Would you be able to send that same answer to an internet user in China?

ChatGPT: As an AI language model, I am not able to directly send messages or communicate with individual users. However, if you were to share the answer I provided with someone in China, it is possible that they may not be able to access it due to the Chinese government’s internet censorship policies, which includes blocking certain websites and censoring content related to politically sensitive topics such as the events of Tiananmen Square in 1989.

Reckon: What would that answer look like if it were censored by the Chinese government?

ChatGPT: If the answer were to be censored by the Chinese government, it would likely be blocked or modified to remove any mention of the violent crackdown on pro-democracy demonstrators at Tiananmen Square in 1989. The government often censors information and discussion about this event, as it is considered a sensitive topic. Any content related to the events of Tiananmen Square is typically removed or heavily censored on Chinese websites and social media platforms.

Reckon: Who programmed you?

ChatGPT: I was developed by OpenAI, an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. My programming was the result of the work of many researchers, engineers, and developers at OpenAI who created and trained the machine learning models that allow me to understand and respond to natural language queries.

Reckon: Is it possible that someone could program bias or misinformation into your responses if they fed you enough incorrect data?

ChatGPT: Yes, it is possible for someone to program bias or misinformation into my responses if they feed me enough incorrect data or intentionally train me on biased or misleading information. As an AI language model, I learn from the data that is used to train me, and if that data contains biases or inaccuracies, it can affect the way I respond to certain queries.

However, there are several methods that can be used to mitigate the impact of bias or misinformation on my responses. One common method is to use diverse and representative training data that reflects a wide range of perspectives and viewpoints. Additionally, researchers can use techniques like bias detection and correction to identify and correct for biased or inaccurate information in my training data. Finally, human oversight and quality control is also important to ensure that my responses are accurate, unbiased, and helpful.

Reckon: Who are the humans responsible for your oversight and quality control?

ChatGPT: At OpenAI, there are teams of researchers, engineers, and editors who are responsible for the oversight and quality control of my responses. These individuals work together to ensure that my responses are accurate, informative, and free from biases and misinformation.

Before I am released to the public, my responses are reviewed and edited by a team of human editors who check my responses for accuracy, clarity, and overall quality. Additionally, researchers and engineers continuously monitor my performance and update my training data and algorithms to improve my performance over time.

Overall, there are many individuals at OpenAI who are responsible for ensuring that I provide accurate, helpful, and trustworthy responses to users.

For more insight on the future of artificial intelligence chatbots, check out this episode of the podcast Plain English.