Google Signs AI Contract with US Defense Department, Faces Employee Backlash

Google is facing internal concerns after signing a contract with the US Defense Department to utilize artificial intelligence (AI) technology for sensitive information processing, including military operations. Approximately 600 employees have sent an open letter to the CEO, urging a review of the agreement.

The contract includes a clause stating, "AI systems should not be used for domestic mass surveillance or autonomous lethal weapons without appropriate human oversight." However, it specifies that Google will not have the right to control or veto legitimate government operational decisions. The contract also mandates Google's cooperation in adjusting AI safety settings and filters upon government request. A Google spokesperson stated, "We continue to stand by the principle that AI should not be used for domestic mass surveillance or autonomous weapons without appropriate human oversight."

In their letter, employees expressed concern that AI could be used for lethal weapons or mass surveillance. They urged the company to prevent AI's use in classified defense work. A significant number of signatories belong to DeepMind, a core AI research organization. They declared their desire for AI to benefit humanity and their opposition to its use in lethal autonomous weapons and mass surveillance. They argued that the only way to prevent Google from being associated with such harm is to refuse all classified work.

This contract mirrors a precedent set by competitor Anthropic. Anthropic was excluded from all Defense Department contracts in February after refusing to remove safety measures designed to prevent AI from being used in lethal autonomous weapons and mass surveillance. Subsequently, the Defense Department designated Anthropic as a "supply chain risk company," and the two parties are engaged in legal disputes over the legality of the contract termination.

In 2018, Google halted an AI contract for drone video analysis due to employee opposition. The company later announced principles against using AI in weapons and surveillance, but recently rescinded those restrictions and has been expanding its military contracts. The US Department of Defense declined to comment directly on this contract.