Company Updates

CalPERS debates AI risks after Anthropic researcher's stark warning

Share
CalPERS debates AI risks after Anthropic researcher's stark warning

CalPERS leaders discussed the risks of AI development during a board meeting, following the resignation of Anthropic researcher Jacob Coxon, who warned of existential threats from AI companies.

TL;DR

  • CalPERS board members debated the potential risks of AI development during a recent meeting.
  • The discussion was sparked by the resignation of Anthropic researcher Jacob Coxon, who warned of existential threats from AI companies.
  • While no immediate action was taken, the debate highlights growing concerns about AI's impact on society and investments.

What happened

During a recent board meeting, California Public Employees' Retirement System (CalPERS) leaders discussed the potential risks of AI development, following the resignation of Anthropic researcher Jacob Coxon. Coxon, who previously worked at OpenAI, publicly resigned, stating that leading AI companies like Anthropic and OpenAI are 'gambling with our lives' by racing to create superintelligence. He warned that these companies could endanger human life by the end of this decade.

CalPERS board President Theresa Taylor urged her colleagues to consider issuing a public statement calling for new guardrails or a moratorium on AI development. She argued that, as a pension fund, CalPERS has a responsibility to prioritize the financial health of its beneficiaries, stating, 'If we don't have retirees, if we don't have state workers because of AI, we don't have a pension fund.'

The CalPERS board did not issue a statement or make changes to its AI investments during the meeting. Chief Investment Officer Stephen Gilmore acknowledged the uncertainty surrounding AI's future, stating that the outcomes could vary widely.

Why it matters

This debate highlights the growing concerns about the societal and financial impacts of AI development. As one of the world's largest pension funds, CalPERS' investments and statements can influence the broader conversation around AI regulation and ethics.

For AI/ML developers and startup founders, this discussion underscores the importance of considering the ethical implications and potential risks of their work. It also highlights the need for open dialogue and collaboration with policymakers and investors to ensure the responsible development of AI technologies.

Tech investors should take note of the potential risks and uncertainties associated with AI investments. While the AI market continues to grow, the debate at CalPERS serves as a reminder that the long-term impacts of AI are still uncertain, and investors should be prepared for a wide range of possible outcomes.

Key facts

  • CalPERS has assets valued at $655 billion, making it one of the world's largest pension funds.
  • Anthropic researcher Jacob Coxon publicly resigned, warning of existential threats from AI companies.
  • Coxon previously worked at OpenAI and has expressed concerns about the race to create superintelligence.
  • CalPERS board President Theresa Taylor called for a public statement on AI risks, citing the fund's responsibility to its beneficiaries.
  • The CalPERS board did not issue a statement or make changes to its AI investments during the meeting.
  • Chief Investment Officer Stephen Gilmore acknowledged the uncertainty surrounding AI's future, stating that outcomes could vary widely.
  • Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have called for a slowdown in AI research following Coxon's statement.

Context

The debate at CalPERS comes amid growing concerns about the ethical implications and potential risks of AI development. As AI technologies continue to advance, there is increasing pressure on companies, investors, and policymakers to ensure that these technologies are developed and deployed responsibly.

The discussion also highlights the interconnectedness of AI development and financial markets. As AI companies continue to attract significant investments, the potential risks and uncertainties associated with these technologies are becoming increasingly important for investors to consider.

The call for a slowdown in AI research by Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman further underscores the need for careful consideration of the ethical and societal implications of AI development.

Topics

Related coverage

Join the discussion

Have a take on this story? Weigh in with our community on Facebook.

💬 Discuss on Facebook →