A Generative AI Upped Worker Productivity and Satisfaction

And the lowest-skilled benefited most

Published: Monday, May 29, 2023 - 12:02

Since OpenAI’s release of ChatGPT in November 2022, the buzz around generative AI has been steadily ramping up. Some are excited about its potential to transform the way we work, create, and live, while others are wary of the dangers it poses and the nefarious ways it can be used. We know that programs like Midjourney, DALL-E, and GPT-4 are enabling millions of people to generate images and text, but not many studies have dug into the effect these tools are having, be it positive or negative.

One such study was released this month. Titled “Generative AI at Work,” the paper, by teams from Stanford and Massachusetts Institute of Technology, is one of the first times researchers take a microscope to the way generative AI actually affects peoples’ jobs. The team looked at how employees of a Fortune 500 company were impacted by generative AI when they started using it as part of their day-to-day work.

Tell me what to say

The study followed 5,179 customer service agents at a large software firm (undisclosed name) during the course of a year. The employees, mostly based in the Philippines, were split into two groups: One was given access to an AI they could choose to integrate into their work, while the other continued as usual.

The AI was trained on data from more than 5,000 successful customer service interactions, likely in the form of recordings of high-performing employees having conversations with customers and resolving their issues. The AI then monitored customer interactions in real time and gave agents suggestions of what to say. The employees could choose to use the suggestions word for word, dismiss them altogether, or use a tweaked version.

The researchers looked at how long it took for agents to solve customers’ issues and how successfully they did so. The results? Good things all around.

For one, AI enabled customer service agents to get through calls more quickly, resolve more customer complaints successfully, and even handle multiple customer calls at once. The agents using AI resolved 13.8 percent more issues per hour than they’d been able to without it.

And that’s not all. Since the AI suggestions skewed toward helping agents be patient and empathetic with frustrated customers, the customers treated the agents better, losing their tempers and raising their voices less (it’s not pretty, but let’s be honest—we’ve all been there). As a result, the agents were happier and more satisfied with their work.

Closing the skills gap?

Perhaps not surprising, AI was most helpful for the least-skilled workers and those who had been with the company for the shortest time. Meanwhile, the highest-skilled and most experienced agents didn’t benefit much from using AI. This makes sense, since the tool was trained on conversations from these workers; they already know what they’re doing.

“High-skilled workers may have less to gain from AI assistance precisely because AI recommendations capture the knowledge embodied in their own behaviors,” says study author Erik Brynjolfsson, director of the Stanford Digital Economy Lab.

The AI enabled employees with only two months of experience to perform as well as those who’d been in their roles for six months. That’s some serious skill acceleration. But is it “cheating?” Are the employees using AI skipping over valuable firsthand training, missing out on learning by doing? Would their skills grind to a halt if the AI were taken away, since they’ve been repeating its suggestions rather than thinking through responses on their own?

It’s possible that an overreliance on the tool could be detrimental to employees’ ability to build up and retain skills. But ideally they are learning by doing, just in a faster way, since they’re skipping over the drudgery of many unpleasant interactions with angry customers.

Where does this leave high-skilled employees, though? If their work is being used to train AI that then freely gives its skills to inexperienced employees, that could create issues around fairness and compensation. If you’ve been honing your soothing one-liners for years and then a newbie comes in saying all the same things by Month Two on the job, you’re not going to be thrilled—especially if you’re not getting paid a lot more than the newbie.

Generating more than words

Finally, since AI was essentially training newer employees, their managers didn’t need to spend as much time training them—and more of their time was thus freed up. That means managers could take on bigger teams, which means the company could ultimately hire more employees (if it’s selling enough of its products) and do more business. It seems this particular “generative AI” generated a lot more than just conversation suggestions: It generated employee satisfaction, skill acquisition, and free time.

Will the same hold true for other scenarios where these tools are implemented? Could be, but they should be introduced with caution and oversight nonetheless because there are likely many secondary effects generative AI could have on a workplace that wouldn’t become apparent right away, and might not be wholly positive.

“We need far more research here,” says Brynjolfsson. “The impact of AI on productivity may vary over time, and adding these tools to the office could require complementary organizational investments, skills development, and business process redesign. And AI systems may impact worker and customer satisfaction, attrition, and patterns of behavior. There’s so much we don’t know.”

First published on April 26, 2023, on Singularity Hub.

About The Author

Vanessa Bates Ramirez

Vanessa Bates Ramirez is senior editor of Singularity Hub. She’s interested in biotechnology and genetic engineering, the nitty-gritty of the renewable energy transition, the roles technology and science play in geopolitics and international development, and countless other topics.