Important links

• Paper (preprint)
• ACM Digital Library link
• Medium Blog that summarizes this paper
• Slides
• Reddit discussion on this paper that hit the Reddit front page.
• Hacker News discussion on this paper that hit the site’s front page.

Media coverage

• “Explaining why Reddit posts are removed helps people comply with rules,” New Scientist, August 25, 2019

Abstract

When posts are removed on a social media platform, users may or may not receive an explanation. What kinds of explanations are provided? Do those explanations matter? Using a sample of 32 million Reddit posts, we characterize the removal explanations that are provided to Redditors, and link them to measures of subsequent user behaviors—including future post submissions and future post removals. Adopting a topic modeling approach, we show that removal explanations often provide information that educate users about the social norms of the community, thereby (theoretically) preparing them to become a productive member. We build regression models that show evidence of removal explanations playing a role in future user activity. Most importantly, we show that offering explanations for content moderation reduces the odds of future post removals. Additionally, explanations provided by human moderators did not have a significant advantage over explanations provided by bots for reducing future post removals. We propose design solutions that can promote the efficient use of explanation mechanisms, reflecting on how automated moderation tools can contribute to this space. Overall, our findings suggest that removal explanations may be under-utilized in moderation practices, and it is potentially worthwhile for community managers to invest time and resources into providing them.

BibTeX citation

@article{jhaver2019explanations,
    author = {Jhaver, Shagun and Bruckman, Amy and Gilbert, Eric},
    title = {Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit},
    journal = {Proc. ACM Hum.-Comput. Interact.},
    year = {2019},
    issue_date = {November 2019},
    publisher = {Association for Computing Machinery},
    address = {New York, NY, USA},
    volume = {3},
    number = {CSCW},
    url = {https://doi.org/10.1145/3359252},
    doi = {10.1145/3359252},
    journal = {Proc. ACM Hum.-Comput. Interact.},
    month = nov,
    articleno = {150},
    numpages = {27}
}