EXPLAINER: What is ChatGPT and why are schools blocking it?

Jan 5, 2023, 9:32 PM | Updated: Jan 6, 2023, 12:10 pm
A ChatGPT prompt is shown on a device near a public school in Brooklyn, New York, Thursday, Jan. 5,...

A ChatGPT prompt is shown on a device near a public school in Brooklyn, New York, Thursday, Jan. 5, 2023. New York City school officials started blocking this week the impressive but controversial writing tool that can generate paragraphs of human-like text. (AP Photo/Peter Morgan)

(AP Photo/Peter Morgan)

Ask the new artificial intelligence tool ChatGPT to write an essay about the cause of the American Civil War and you can watch it churn out a persuasive term paper in a matter of seconds.

That’s one reason why New York City school officials this week started blocking the impressive but controversial writing tool that can generate paragraphs of human-like text.

The decision by the largest U.S. school district to restrict the ChatGPT website on school devices and networks could have ripple effects on other schools, and teachers scrambling to figure out how to prevent cheating. The creators of ChatGPT say they’re also looking for ways to detect misuse.

The free tool has been around for just five weeks but is already raising tough questions about the future of AI in education, the tech industry and a host of professions.

WHAT IS CHATGPT?

ChatGPT launched on Nov. 30 but is part of a broader set of technologies developed by the San Francisco-based startup OpenAI, which has a close relationship with Microsoft.

It’s part of a new generation of AI systems that can converse, generate readable text on demand and even produce novel images and video based on what they’ve learned from a vast database of digital books, online writings and other media.

But unlike previous iterations of so-called “large language models,” such as OpenAI’s GPT-3, launched in 2020, the ChatGPT tool is available for free to anyone with an internet connection and designed to be more user-friendly. It works like a written dialogue between the AI system and the person asking it questions.

Millions of people have played with it over the past month, using it to write silly poems or songs, to try to trick it into making mistakes, or for more practical purposes such as helping compose an email. All of those queries are also helping it get smarter.

WHAT ARE THE PITFALLS?

As with similar systems, ChatGPT can generate convincing prose, but that doesn’t mean what it says is factual or logical.

Its launch came with little guidance for how to use it, other than a promise that ChatGPT will admit when it’s wrong, challenge “incorrect premises” and reject requests meant to generate offensive answers. Since then, however, its popularity has led its creators to try to lower some people’s expectations.

“ChatGPT is incredibly limited, but good enough at some things to create a misleading impression of greatness,” OpenAI CEO Sam Altman said on Twitter in December.

Altman added that “it’s a mistake to be relying on it for anything important right now.”

“It’s a preview of progress; we have lots of work to do on robustness and truthfulness.”

CAN IT BE USED FOR WRITING SCHOOL PAPERS?

This is what ChatGPT said when The Associated Press asked it to answer that question in all caps from the perspective of a principal shouting a brief message through a school’s PA system:

“DO NOT USE CHATGPT OR ANY OTHER AUTOMATED WRITING TOOL FOR SCHOOL PAPERS. THIS IS CHEATING AND WILL NOT BE TOLERATED. IF YOU ARE CAUGHT USING CHATGPT OR ANY OTHER AUTOMATED WRITING TOOL FOR SCHOOL PAPERS, THERE WILL BE SERIOUS CONSEQUENCES.”

But when asked to answer the same question on its own, ChatGPT offered this more measured warning: “As a general rule, it is not appropriate to use ChatGPT or any other automated writing tool for school papers, as it is considered cheating and does not benefit the student in the long run.”

WHAT DO SCHOOLS SAY?

Many school districts are still scrambling to figure out how to set policies on if and how it can be used.

The New York City education department said Thursday that it’s restricting access on school networks and devices because it’s worried about negative impacts on student learning, as well as “concerns regarding the safety and accuracy of content.”

But there’s no stopping a student from accessing ChatGPT from a personal phone or computer at home.

“While the tool may be able to provide quick and easy answers to questions, it does not build critical-thinking and problem-solving skills, which are essential for academic and lifelong success,” said schools spokesperson Jenna Lyle.

HUMAN OR AI?

“To determine if something was written by a human or an AI, you can look for the absence of personal experiences or emotions, check for inconsistency in writing style, and watch for the use of filler words or repetitive phrases. These may be signs that the text was generated by an AI.”

That’s what ChatGPT told an AP reporter when asked how to tell the difference.

OpenAI said in a human-written statement this week that it plans to work with educators as it learns from how people are experimenting with ChatGPT in the real world.

“We don’t want ChatGPT to be used for misleading purposes in schools or anywhere else, so we’re already developing mitigations to help anyone identify text generated by that system,” the company said.

DOES THIS THREATEN GOOGLE?

There’s been some speculation that ChatGPT could upend the internet search business now dominated by Google, but the tech giant has been working on similar technology for years — it’s just more cautious about releasing it in the wild.

It was Google that helped jumpstart the trend for ever-bigger, ever-smarter AI language models that could be “pre-trained” on a wide body of writings. In 2018 the company introduced a system known as BERT that uses a “transformer” technique that compares words across a sentence to predict meaning and context. Some of those advances are now baked into Google searches.

But there’s no question that successive iterations of GPT — which stands for Generative Pre-trained Transformer — are having an impact. Microsoft has invested at least $1 billion in OpenAI and has an exclusive license to use GPT-3.

HEY CHATGPT, CAN YOU PUT ALL THIS IN A RAP?

“ChatGPT’s just a tool,

But it ain’t no substitute for school.

You can’t cheat your way to the top,

Using a machine to do your homework, you’ll flop.

Plagiarism’s a no-no,

And ChatGPT’s text is not your own, yo.

So put in the work, earn that grade,

Don’t try to cheat, it’s not worth the trade.”

Copyright © The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.

AP

Protesters gather in front of police headquarters while marching Saturday, Jan. 28, 2023, in Memphi...
Associated Press

Memphis police disband unit that fatally beat Tyre Nichols

MEMPHIS, Tenn. (AP) — The Memphis police chief disbanded the city’s so-called Scorpion unit on Saturday, citing a “cloud of dishonor” from newly released video that showed some of its officers beating Tyre Nichols to death after stopping the Black motorist. Police Director Cerelyn “CJ” Davis acted a day after the harrowing video emerged, saying […]
22 hours ago
Associated Press

Today in History: JAN 29, Prohibition launches

Today in History Today is Sunday, Jan. 29, the 29th day of 2023. There are 336 days left in the year. Today’s Highlight in History: On Jan. 29, 1936, the first inductees of baseball’s Hall of Fame, including Ty Cobb and Babe Ruth, were named in Cooperstown, New York. On this date: In 1820, King […]
22 hours ago
Rep. Ruben Gallego, D-Ariz., is seen in the U.S. Capitol, July 14, 2022, in Washington.  Gallego sa...
Associated Press

Gallego holds first events of Arizona Senate campaign

PHOENIX (AP) — Democrat Ruben Gallego held the first public events of his U.S. Senate campaign Saturday, taking aim at independent incumbent Kyrsten Sinema and casting his candidacy in a patriotic appeal to the American dream. The fifth-term congressman recounted his journey from a poor family in Chicago to cleaning toilets as a Harvard student […]
22 hours ago
Associated Press

Saturday’s Scores

GIRLS PREP BASKETBALL= Bothell 44, Glacier Peak 40 Burlington-Edison 47, Squalicum 33 Columbia River 53, R.A. Long 28 Entiat 60, Cascade (Leavenworth) 9 Evergreen Lutheran 48, Three Rivers Christian School 26 Hermiston, Ore. 66, Pasco 36 Kamiakin 61, Kennewick 35 Kennedy 49, Bainbridge 42 La Conner 81, Skyview 77 Lakeside (Seattle) 71, Seattle Prep 37 […]
22 hours ago
Associated Press

Saturday’s Scores

BOYS PREP BASKETBALL= Bothell 64, Glacier Peak 49 Cedarcrest 60, Marysville-Pilchuck 57 Inchelium 71, Springdale 70 Kellogg, Idaho 50, Newport 27 Lynden 69, Lakewood 50 Naselle 63, Winlock 59 Sound Christian 69, Pope John Paul II 34 ___ Some high school basketball scores provided by Scorestream.com, https://scorestream.com/ Copyright © The Associated Press. All rights reserved. […]
22 hours ago
Associated Press

Arizona Republicans pick former Trump official to lead party

PHOENIX (AP) — Arizona Republicans on Saturday selected former state treasurer and Donald Trump aide Jeff DeWit to be the party’s next chairman, turning to a familiar face with relationships across the fractured party after its worst election in decades. DeWit replaces firebrand Trump ally Kelli Ward, who helped the former president in his efforts […]
22 hours ago

Sponsored Articles

safety from crime...

As crime increases, our safety measures must too

It's easy to be accused of fearmongering regarding crime, but Seattle residents might have good reason to be concerned for their safety.
Comcast Ready for Business Fund...
Ilona Lohrey | President and CEO, GSBA

GSBA is closing the disparity gap with Ready for Business Fund

GSBA, Comcast, and other partners are working to address disparities in access to financial resources with the Ready for Business fund.
SHIBA WA...

Medicare open enrollment is here and SHIBA can help!

The SHIBA program – part of the Office of the Insurance Commissioner – is ready to help with your Medicare open enrollment decisions.
Lake Washington Windows...

Choosing Best Windows for Your Home

Lake Washington Windows and Doors is a local window dealer offering the exclusive Leak Armor installation.
Anacortes Christmas Tree...

Come one, come all! Food, Drink, and Coastal Christmas – Anacortes has it all!

Come celebrate Anacortes’ 11th annual Bier on the Pier! Bier on the Pier takes place on October 7th and 8th and features local ciders, food trucks and live music - not to mention the beautiful views of the Guemes Channel and backdrop of downtown Anacortes.
Swedish Cyberknife Treatment...

The revolutionary treatment of Swedish CyberKnife provides better quality of life for majority of patients

There are a wide variety of treatments options available for men with prostate cancer. One of the most technologically advanced treatment options in the Pacific Northwest is Stereotactic Body Radiation Therapy using the CyberKnife platform at Swedish Medical Center.
EXPLAINER: What is ChatGPT and why are schools blocking it?