AI firm Anthropic has drawn a firm line against the Pentagon's demand for unrestricted use of its technology. CEO Dario Amodei stated the company "cannot in good conscience accede" to the military's request.
Anthropic, maker of the chatbot Claude, faces potential repercussions including being "deemed a supply chain risk" if it does not comply. This designation could jeopardize critical business partnerships. Conversely, bending to the demand risks eroding trust within the AI industry and losing top talent attracted by the company's commitment to responsible AI development.
Anthropic sought assurances that Claude would not be used for mass surveillance or fully autonomous weapons. However, the company stated that proposed contract language, framed as a compromise, included provisions that could allow safeguards to be disregarded.
The Pentagon's top spokesman asserted the military "will not let ANY company dictate the terms regarding how we make operational decisions." However, a significant number of tech workers from rival firms, including OpenAI and Google, have voiced support for Anthropic's stance.
Former Pentagon AI leader Gen. Jack Shanahan expressed sympathy for Anthropic's position, noting that AI large language models are not yet ready for critical national security applications, especially for autonomous weapons. He stated Anthropic's red lines are "reasonable."
Despite Pentagon claims of no interest in mass surveillance or autonomous weapons, officials warned they could invoke the Defense Production Act to gain broader authority over Anthropic's products. Amodei maintains that such threats are contradictory and stated Anthropic will facilitate a smooth transition if the Pentagon does not reconsider.