14 Comments

I was a social work intern at a school that used Gaggle to flag instances of suicide/SH language in school emails and G-chats. When a convo was flagged, a real person reviewed it and referred the student to us for a risk assessment. It actually added to our workload rather than reducing it because we had to follow up with every student, even if it was clear they were joking or using the words in other context. That meant other kids who needed services may not get to meet with us right away because we had to meet with them to avoid liability in case they actually did harm themselves.

Expand full comment

I really feel uncomfortable with this as a student. I love what the potential is, being able to help students without them having to talk first (considering many students don’t know how to talk about mental health needs), but honestly, how can a computer program know what we need any better than we do? And what if it starts assigning medication to kids who don’t know they don’t need it? I just don’t like it.

Expand full comment

The use of AI can be so controversial at times but in this case I think it’s a really good use of it as long as it is used specifically for what it was designed.

Expand full comment

That's a REALLY big "if." Reread the section about Nex, then consider if you can trust school administrators to do the right thing.

Expand full comment

What I meant to say is « the intention is good ». I do know that the application is however a different job that could easily get out of control ☺️

Expand full comment

I hear ya - and you're not wrong at all. I'm just so old, crusty, and cynical that it's hard for me to even see the "good intentions" anymore - my default just automatically goes to "how are they gonna twist this around and end up using it to further their evil agenda?" I also realize that probably says more about ME than it does about them, and I really should learn to lighten up a bit, but here we are. I should probably go find a cat to pet or something... kind regards, JS

Expand full comment

I do think youth vaping is a huge issue and should be tackled in schools but this seems like such a gross way to do it. Also I don't think kids should be punished for vaping, that isn't the way to get them to quit.

Also Luce I need to know which Sydney show you're going to because I'm going to the Monday show!!

Expand full comment

I personally think it is too soon and/or early to tell what the unintended consequences and implications of AI-assisted technology will be. Until it has been more robustly vetted - dare I say more restrictions and laws put in place to protect people from being exploited by it - I think it's a very dangerous slope to start down. Especially, especially concerning monitoring children or youth in any form, regardless of good intentions.

Unfortunately in this world, it is so dangerous and easy to manipulate technology and/or use it for unintended or malicious purposes. And it doesn't take a rocket scientist to figure out how to do so.

Expand full comment

The fact that allowing AI tracking is mandatory in some cases to allow the student access to school-provided computers is what worries me - why should families who cannot afford these devices (which are being used more and more in schools) have to forgo privacy that more affluent families can almost like pay to protect?

Expand full comment

Can US readers pre-order the book anywhere?

Expand full comment

How can AI possibly detect suicidal thoughts when the family and friends of the individual cannot detect their intention. After taking a course on the subject we were warned that suicides do not openly exhibit their intent, its very difficult to anticipate so how does AI help?

Expand full comment

I’m 76, so OMG! On the other hand, is it having a positive effect regarding student suicide?

Expand full comment

More a question. Is ALL vaping verboten? I’m an adult so no problem there but not all vape juice has nicotine.

I assume the fear here is for nicotine. Does this sensor only detect nicotine or vaping *anything*?

Expand full comment

As far as I know, schools have a no smoking on campus policy. So, no vaping, period, would be allowed, as well as no smokeless tobacco (please don’t say vaping and chewing tobacco aren’t smoking, I’m sure schools are changing the language to update)

Expand full comment