Trust Infrastructure on ATproto

Oeh, hands up for @erlend.sh following me :sweat_smile:

Your four criteria (non-AI content, DNS, public track record, social graph) are pretty much where I think I’m going with this as well: observable evidence, human conclusion. No ā€œgui.do has trust score 73, proceed with caution.ā€

But there’s an irony I keep running into: you can’t really score bots, because the moment they get a negative signal they just create a new account. Plus they are getting really good at mimicking human behavior at the single-post level. So the only way (at least as far as I can tell, please correct me) to filter bots out is to give positive signals to humans about their profile (not single posts)… which means you end up scoring humans anyway, just to weed out the bots.

At least until the bots figure that one out too? But at least with profile-level scoring that also takes profile-age into account, gaming it becomes much harder (and hopefully economically unfeasible).

And that’s actually also what your @erlend.sh point illustrates: you assign trust to me because someone you trust already follows me. I got lucky, but most newcomers won’t have that, and right now on every new platform you’d start from scratch. That’s fine if you want to, but shouldn’t be necessary. If the trust signal runs in the background (not as a public score, but as infrastructure that helps mods and the system decide you’re probably a real person), your DID could carry that across ATproto apps.

Your Glowrm post gets at a related concern where a cross-app reputation that follows you everywhere is dangerous. But imho there’s a difference between ā€œthis account is part of a coordinated spam clusterā€ (useful signal for everyone) and ā€œthis user got banned from a dating appā€ (nobody else’s business).

On Barazo: no trust problems yet, it’s still in alpha. But I’ve been a community manager and forum mod/admin for 25+ years and based on that I’d rather build defenses before the spam wave hits than after :sweat_smile:

To be clear: nothing wrong with humans checking out who someone is and forming their own judgment, that’s what you did with my profile and it worked. But when your feed is 80% bot slop, you need something automated to help you trust that what you’re reading is from real people. I don’t have a good answer for how to do that without some form of hiding or deprioritizing content (again: let me know if you do :grinning_face_with_smiling_eyes:). The question is how to do it without false positives hurting real newcomers.

1 Like