Instagram Is Using AI to Automatically Enroll Minors Into 'Teen Accounts'

Meta is getting serious about the teens who use its services. Last year, the company rolled out "Teen Accounts" for Instagram, which add a number of restrictions, limitations, and features for users under the age of 18. Earlier this month, Meta rolled out Teen Accounts to Facebook and Messenger as well, and expanded some of those restrictions on Instagram specifically.

If your teen had a standard Instagram account when Meta started rolling this out, their account was automatically changed into a Teen Account. Of course, that only worked if they had their real age attached to the account: If a teen said their birthday made them 18 or older, no Teen Account for them.

Meta's AI is snitching on Instagram teens

In response to this loophole, Meta is tasking its AI with rooting out teens purporting to be adults on Instagram. The company announced the experiment on Monday, revealing that tests will begin in the United States that same day. Meta is brief on the details here, but they do say that if the AI finds a standard account it suspects to be a teen, it will automatically switch them to a Teen Account—even if that account has an adult birthday.

This also isn't Meta AI's first rodeo. The company has used an AI model trained to identify whether a user is underage since 2022. The AI model looks for behaviors associated with teen users, as, according to Meta, people in the same age group react similarly to specific types of content. (Think about all those memes you don't understand.)

One interesting "tell" comes with birthday posts: The AI looks at how users interact with an account on their birthday, and can make a determination from there. If the AI is seeing a lot of "happy 17th birthday" posts and DMs, that's going to be quite obvious, but even if the messages track with how users under 18 tend to wish each other a happy birthday, the AI will get suspicious fast.

What happens if the AI gets it wrong?

There are probably many parents out there that have no issue with Instagram automatically changing their kids' profiles to Teen Accounts. But this tech is driven by AI, and AI doesn't always get it right: As such, there's a good chance that the AI accidentally flags adult accounts as teens by mistake, locking users 18 and older into restrictions meant for minors.

That means your account will automatically take on some pretty drastic restrictions: You'll go private if you aren't already, and adult users won't be able to see your posts or DM you without following first. You won't see "violent" content, or posts promoting cosmetic procedures. (Perhaps no loss there.) Instagram will also warn you whenever you use the app for 60 minutes in one day, advising you to stop. And while you don't need to, your account will enter "sleep mode" between 10 p.m. and 7 a.m., muting alerts and sending auto-replies to DMs. (To be fair, perhaps many of us adults would benefit from these restrictions.)

If Instagram thinks you're 16 or 17, you'll be able to manually disable some of these limitations, but that's not really the point. If you're an adult, you shouldn't expect Instagram to change the parameters of your account because its AI bot got it wrong. Meta knows it, too. As the company says it its blog post: "We’re taking steps to ensure our technology is accurate and that we are correctly placing teens we identify into protective, age-appropriate settings, but in case we make a mistake, we’re giving people the option to change their settings."

The company hasn't said exactly what those mitigation steps are yet, so I'll update this piece once we know for sure. My guess, however, is there will be an option in settings to verify your age and transfer your account back to an adult account.

View the full article