Hajin Kim, an Assistant Professor of Law at the University of Chicago Law School, along with a distinguished team of academics, has released a comprehensive working paper that delves into the complex world of voluntary corporate sustainability reporting. The research, which analyzes over 15,000 disclosure documents from more than 2,100 Russell 3000 firms spanning from 1998 to 2023, offers a critical, data-driven perspective on the efficacy and evolution of these crucial corporate communications. The study, co-authored by Ningzi Li (Adjunct Assistant Professor of Organizations and Strategy, University of Chicago), Ronen Feldman (Professor of Data Science, Hebrew University), Yun Liu (Master’s student in Computer Science, University of Chicago), and Yuval Feldman (Mori Lazarof Professor of Legal Research, Bar-Ilan University), leverages the power of large language models to overcome the prohibitive cost of analyzing vast quantities of heterogeneous PDF documents.
The Promise and Peril of Voluntary Sustainability Reporting
For decades, society has placed significant faith in voluntary corporate sustainability reporting. The underlying theory is that these disclosures serve a vital function: empowering civil society groups, financial analysts, and other stakeholders to hold companies accountable for environmental and social externalities that may fall outside the purview of regulation. Furthermore, these reports are intended to provide markets with crucial information to price risks that might be missed in traditional financial statements. However, a persistent criticism has been that these reports are often mere marketing tools – "greenwashing" – lacking credibility due to being unassured, incomparable across firms and time, vague, and selectively disclosing only positive information.
The industry dedicated to rectifying these perceived shortcomings has grown exponentially. Non-profit organizations and shareholder activists relentlessly push companies for greater transparency. Standard-setting bodies have introduced a proliferation of voluntary frameworks, an alphabet soup of acronyms including GRI (Global Reporting Initiative), SASB (Sustainability Accounting Standards Board), TCFD (Task Force on Climate-related Financial Disclosures), CDP (formerly the Carbon Disclosure Project), and SBTi (Science Based Targets initiative). Companies increasingly seek external assurance for their reports, and newer mandatory disclosure regimes often build upon these existing voluntary frameworks. Yet, despite this significant investment and effort, a fundamental understanding of what these reports actually contain and whether the adopted frameworks translate into genuinely better disclosures has remained elusive, primarily due to the sheer scale and heterogeneity of the data.
Unpacking the Data: A Deep Dive into 15,000 Documents
The working paper by Professor Kim and her colleagues tackles this data challenge head-on by employing advanced natural language processing techniques. Their analysis of over 15,000 documents, representing more than 11,000 company-year observations, provides a granular view of sustainability reporting trends. The researchers meticulously extracted metadata that is often inconsistently presented in reports and previously lacked in datasets. This metadata includes each document’s reporting period, the presence of external assurance, the specific voluntary frameworks adopted, and the number of data tables and figures included.
Beyond metadata, the team developed sophisticated sentence-level metrics to quantify key characteristics that stakeholders deem important. Recognizing the absence of an objective "quality yardstick," they translated common critiques of sustainability reports into measurable proxies. These include:
- Specificity: Measuring the level of detail and concrete information provided.
- Quantitative Evidence: Assessing the extent to which claims are supported by numerical data.
- Promotional Language ("Fluff"): Quantifying the use of marketing or overly positive language, modeled on the legal concept of "puffery."
- Disclosure of Negative, Against-Interest News: Gauging the willingness of companies to report unfavorable information.
Key Findings: A Shifting Landscape
The analysis revealed five striking patterns that significantly alter our understanding of corporate sustainability reporting:
1. Mainstreaming of Sustainability Reporting
The data unequivocally demonstrates that sustainability reporting has become a mainstream corporate practice. Following 2015, there was a significant surge in both the issuance of sustainability reports and the adoption of voluntary frameworks, with these trends rising in parallel. Concurrently, reports have dramatically increased in length, reflecting both longer reporting periods and the greater complexity associated with framework adoption. This suggests a growing institutionalization of sustainability communication within corporate strategy.
2. Sticky and Overlapping Framework Adoption
A notable finding is the "stickiness" of framework adoption. Once a company adopts a particular framework, it tends to maintain it over time. Furthermore, rather than substituting for one another, frameworks tend to cluster. For instance, in 2022, over 80% of Global Reporting Initiative (GRI)-aligned reports were also aligned with the Sustainability Accounting Standards Board (SASB) framework. This heavy overlap suggests that firms often adopt multiple frameworks simultaneously, possibly to cater to diverse stakeholder expectations or to gain broader recognition.
3. Deterioration in Key Disclosure Dimensions
Perhaps the most counterintuitive finding is that, on the dimensions stakeholders demand, the average sustainability report has moved in the "wrong direction" as reporting became more widespread. As reporting expanded, reports became less specific, less quantitative (especially after 2015), and contained more "fluff," even as the use of data tables and figures increased. While this trend partly reflects the inclusion of thinner, first-time reporters, the study’s analysis of incumbent reporters—companies that consistently reported over time—reveals a concerning decline in specificity and quantitative content within these established reporting firms. This suggests that the sheer growth in reporting volume may be outpacing a genuine commitment to quality and rigor in many cases.
4. Limited Evidence of "Learning by Doing"
The research also investigated whether experience in reporting leads to improved disclosure quality over time, a concept often referred to as "learning by doing." While companies with longer reporting histories do tend to produce more concrete reports—characterized by greater specificity, more quantitative data, less fluff, and more disclosures of negative news—this association appears to be largely driven by the characteristics of firms that began reporting earlier, rather than by genuine learning gained through experience. When the analysis controlled for the initial selection of reporters and calendar trends, most of the association between reporting tenure and quality disappeared. The limited learning that did persist was confined to the initial years of a company’s reporting journey and primarily related to reduced fluff, increased tables, and slightly improved specificity. This suggests that the structure of voluntary reporting may not effectively incentivize long-term, continuous improvement in disclosure quality.
5. Mixed Associations with Voluntary Frameworks
The study found measurable, albeit mixed, associations between the adoption of voluntary frameworks and report content. The most significant associations were observed with frameworks that directly influence report composition. For instance, GRI adoption was linked to more tables but a lower quantitative density in reports. SASB adoption correlated with less fluff but also less quantitative density. The Task Force on Climate-related Financial Disclosures (TCFD) framework showed associations with less fluff and a greater disclosure of negative news. However, other associations were weaker and less reliable under robustness checks. Crucially, the research found no consistent evidence that adopting a framework automatically leads to an improvement across all desired disclosure dimensions. The possibility of "selection bias"—whereby firms that are already inclined to better reporting are more likely to adopt these frameworks—cannot be ruled out. Nevertheless, the diverging patterns of report content linked to different frameworks, despite high co-adoption rates, do suggest that these frameworks may indeed exert a real influence on what companies choose to report.
Implications for Directors, Standard-Setters, and Policymakers
The findings of Professor Kim and her team offer significant implications for various stakeholders involved in corporate sustainability:
-
Reframing the Voluntary vs. Mandatory Debate: The results suggest that the debate between voluntary and mandatory reporting might be better understood as a distinction between "rules" and "standards." Companies have readily adopted the "rules" of sustainability reporting—the decision to publish a report and to align with a named framework. These are often driven by reputational pressures and clear market signals. However, they have struggled with the "standards" of what constitutes high-quality, meaningful disclosure, such as specificity, quantitative evidence, and transparency about negative news. This suggests that while adoption may be easily achieved, the substantive quality of reporting remains a more significant challenge.
-
The Need for Clearer Standards: For voluntary regimes to drive genuine improvement in disclosure substance, there needs to be a clearer consensus on what constitutes high-quality, specific, and quantitative reporting across various topics. This consensus is also what allows a "standard-like" ask to evolve into a "rule." Standard-setters, such as the GRI and the International Sustainability Standards Board (ISSB) with its IFRS S1 and S2 standards, are already working on topic- and industry-specific guidelines that can serve this purpose. The growing adoption of ISSB standards in mandatory regimes highlights a potential pathway for codifying best practices.
-
Beyond Badge-Collecting: The high rates of overlapping framework adoption and the "stickiness" of these frameworks could be interpreted as firms accumulating disclosure credentials rather than deeply integrating sustainability principles. However, the diverging associations with report content suggest that these frameworks may indeed influence corporate communication strategies. This underscores the importance for companies to move beyond mere compliance and to leverage these frameworks for genuine improvement.
-
The Power of Data Analytics: The study’s methodology, using large language models to analyze disclosures at scale, offers a practical lesson. Automated and human analysis can now readily compare reports, identify trends, and assess performance on specific dimensions like specificity, quantitative content, and the disclosure of negative news. This capability empowers directors and disclosure committees to benchmark their own reports against peers and identify areas for improvement. For regulators and standard-setters, clearer specifications for reporting, such as mandatory alignment language and machine-readable data formats, can significantly enhance the comparability and utility of these disclosures.
Future Directions and Data Availability
While the study provides a robust factual foundation, the researchers acknowledge certain limitations. The metrics used are proxies for stakeholder demands, and the precise impact of each dimension on different stakeholder groups remains an area for further investigation. Furthermore, the observed associations do not definitively prove causality. Nonetheless, the project’s commitment to making the translated text of over 15,000 documents and the complete dataset publicly available will undoubtedly foster future research and contribute to a more informed dialogue on standard-setting and regulatory approaches to sustainability reporting. This work represents a significant step forward in demystifying the effectiveness of voluntary corporate sustainability disclosures and paving the way for more meaningful and impactful communication in the future.
