Millions of students rely on AI chatbots daily for help with schoolwork and emotional support, but few know where their conversations and personal data end up. As artificial intelligence becomes increasingly integrated into classrooms, educators, parents, and kids are growing concerned about how that data is used – and what role schools play in protecting it.
The country’s two largest school districts, New York City and Los Angeles, have taken a cautious approach to AI adoption, announcing a year-long moratorium on student use of the technology while they study its incorporation into education. However, Microsoft has taken a more proactive stance, recently agreeing to adopt guardrails and privacy standards for its AI in schools through negotiations with the American Federation of Teachers (AFT), the country’s second-largest teachers union.
The agreement is significant, but its impact will be limited if other major tech companies don’t follow suit. “This standard sets a high bar for child privacy and AI safety,” said Microsoft’s Vice Chair and President Brad Smith, “and we’ll extend this agreement to every school district across the country.” The agreement prohibits using student or educator data to train AI systems, except in cases where it could help protect students, and prevents the sale of collected data for advertising or product development.
The deal also includes measures to prevent AI companions from fostering emotional attachment or dependency, and requires Microsoft to disclose how its tools work in plain language. AFT President Randi Weingarten hailed the agreement as “the first of its kind” and a crucial step towards setting an industry standard, especially given the lack of federal and state legislation on AI in schools.
The agreement’s effectiveness will depend on whether other major tech companies like Google – which provides education technology to America’s schools – follow suit. Josh Golin, executive director of online safety nonprofit Fairplay, notes that a high-profile framework like this can be misunderstood by schools, leading them to believe that using AI tools is acceptable as long as the company is doing a good job on data privacy and safety.
The AFT has been actively courting Google and other AI companies to sign onto similar agreements. However, Google’s response remains unclear, leaving many wondering if it will adopt the same level of transparency and accountability as Microsoft. The absence of clear industry standards for AI in schools raises important questions about whose interests are being served – students’, educators’, or tech giants’.
Ultimately, this agreement highlights the need for a unified approach to AI adoption in education. Parents, educators, and policymakers must work together to ensure that the benefits of AI in classrooms outweigh its risks. For now, Microsoft’s commitment to AI privacy standards is a step in the right direction, but it’s just one piece of a much larger puzzle.
So what can parents do? Be vigilant about your child’s online activities and ask schools about their AI policies. Demand transparency from education technology companies and hold them accountable for protecting student data. By doing so, we can create safer, more responsible environments for our children to learn and grow in the digital age.
Source: SecurityWeek — 2026-09-15