NHRC Flags Children’s Data Privacy Risks in US AI Firm–Pratham Tie-Up, Seeks Reports

New Delhi: The National Human Rights Commission (NHRC) has issued notices to the Union Ministry of Electronics and Information Technology, the Department of School Education and Literacy, the Department of Higher Education, and all states and union territories over concerns regarding the protection of children’s personal data in an Artificial Intelligence (AI)-based education initiative.

A Bench led by NHRC Member Priyank Kanoongo took cognisance of a complaint filed by the NAMO Foundation, which raised apprehensions about potential risks to children’s privacy stemming from a collaboration between US-based AI company Anthropic and education NGO Pratham.

According to the complaint, the partnership involves the use of an AI-driven tool called the “Anytime Testing Machine (ATM)”, which processes children’s handwritten responses and academic data. The complainant alleged that the initiative could expose minors to risks related to data collection, processing, storage and possible cross-border transfer of personal information, potentially violating provisions of the Digital Personal Data Protection (DPDP) Act, 2023.

The complaint cited a report titled “Children’s Privacy at Stake? Assessing Data Breach Risks in the Pratham–Anthropic AI Collaboration under India’s DPDP Act”, claiming that insufficient safeguards may compromise children’s safety and data security.

Noting that the allegations, if proven, prima facie point to violations of children’s right to privacy and protection, the NHRC issued notices under Section 12 of the Protection of Human Rights Act, 1993.

The Commission directed Chief Secretaries of all states and Administrators of Union Territories to probe the matter and ensure that data collected by Pratham, the Central Square Foundation, or other NGOs working with governments is not misused and remains compliant with the DPDP Act, 2023 and other applicable Indian laws. State governments have also been asked to review Memoranda of Understanding (MoUs) or partnerships entered into with such organisations.

Separate notices have been sent to the Secretary of the Union Ministry of Electronics and Information Technology, the Secretary of the Department of Higher Education, and the Secretary of the Department of School Education and Literacy, seeking detailed reports on safeguards governing the use of AI systems in the education sector.

The NHRC has called for Action Taken Reports (ATRs) from all concerned authorities within two weeks.

With inputs from IANS