Study finds that LLM use leads to ‘likely decrease’ in learning skills

Scientists from the Massachusetts Institute of Technology have determined that using large language models leads to a “likely decrease” in learning skills.

Time reported the research team’s findings this week. In a preprint paper, the scientists detailed that the new data is the fruit of a months-long study. 

The MIT team asked 54 individuals from the Boston area to write a short essay in 20 minutes. The participants were divided into three groups. The first group wrote the essay without any outside assistance, the second had access to search engines, and the third used ChatGPT.

The researchers repeated the exercise four times. On the fourth occasion, the participants who had access to ChatGPT switched roles with the ones who wrote the essays on their own. The fourth test was conducted four months after the first.

“While the benefits were initially apparent, as we demonstrated over the course of 4 months, the LLM group’s participants performed worse than their counterparts in the Brain-only group at all levels: neural, linguistic, scoring,” the researchers wrote in the paper.

The MIT team collected data from the tests with the help of electroencephalography, or EEG, headsets worn by the participants. Such devices use electrodes to measure the wearer’s brain activity. The researchers also posed a set of questions to the participants in order to round out the data gathered by the headsets.

EGG devices use a metric called dDTF, or Dynamic Directed Transfer Function, connectivity to measure the wearer’s cognitive load. This metric describes the intensity with which different brain regions interact with one another. According to the researchers, the participants who used LLMs exhibited up to 55% lower dDTF connectivity while writing essays than the ones who didn’t have access to ChatGPT.

The LLM-equipped group also exhibited lower frontal-midline theta activity during the writing exercise. Frontal-midline theta brain waves are associated with cognitive activities that involve focused attention. “Theta connections that were prominent in Brain-only group were relatively weak or absent in the LLM group,” the researchers found.

In a subsequent phase of the project, the MIT team asked the study participants to quote from their essays. The group that used LLMs didn’t perform the task as well as the other two. Furthermore, the participants in that group reported lower “perceived ownership” of the essays they produced.

“We demonstrate the pressing matter of a likely decrease in learning skills based on the results of our study,” the researchers wrote. “These findings support an educational model that delays AI integration until learners have engaged in sufficient self-driven cognitive effort. Such an approach may promote both immediate tool efficacy and lasting cognitive autonomy.”

Photo: Focal Foto/Flickr

Enjoy the perfect blend of retro charm and modern convenience with the Udreamer Vinyl Record Player. With 9,041 ratings, a 4.3/5-star average, and 400+ units sold in the past month, this player is a fan favorite, available now for just $39.99.

The record player features built-in stereo speakers that deliver retro-style sound while also offering modern functionality. Pair it with your phone via Bluetooth to wirelessly listen to your favorite tracks. Udreamer also provides 24-hour one-on-one service for customer support, ensuring your satisfaction.

Don’t miss out—get yours today for only $39.99 at Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!