As the Fediverse grows, the amount and frequency of harmful spam also increases. The feudalistic structure of the network creates notable moderation overhead as every instance admin has to ban offending remote accounts and remove their content themselves, if the originating instance does not act quick enough or such delete actions are not federated properly.
An example (and my motivation for this post) are reports from the last days about accounts which post CSAM content. This is especially problematic, as media content gets duplicated to every receiving instance.

The following idea came to my mind: A software which sits on top of Activity Pub and creates a kind of court. Instances of this software are independent courts. All users can elect admins / mods of their home instance as judge. Everyone can post a case via normal Fedi posts to the court and the elected judges give a verdict via majority vote (votes are also normal Fedi comments with special formatted content). Once a case has a verdict, all instances should immediately apply the decided action against the offending content / account. This can be done via a bot which is set as an instance moderator and follows the published verdicts of a court instance the local admin trusts.

This way swift action can be applied through all instances which follow the court at once. By having periodic elections it is kept democratic.

And the task of the court is to defend universal rules all following instances agree on. Not to handle politics between instances.


What are you thoughts on this matter? Or do other approaches to solve this issue already exist?


Update:
From this came the idea that instances can follow mod actions of other instances and apply them if x% of other instances did the same.

I think this is an interesting approach which might be better than my proposal. So I would like to hear your thoughts about this too.

  • Jupiter Rowland@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 days ago

    This won’t work for three reasons.

    One, technological differences. Not everything in the Fediverse works the same. Not even nearly.

    Managed to implement this on Lemmy or Mastodon? Good for you. Now go implement it on Hubzilla or (streams) or Forte.

    Two, cultural and ethical differences. Mastodon and Lemmy are both part of the Fediverse. But Mastodon’s culture is not Lemmy’s culture. Far from it. You will notice once you witness for the first time the head-butting between a Lemmy moderator and a Mastodon fundamentalist who is trying hard to force Mastodon’s rules and Mastodon’s ideals and Mastodon’s culture and Mastodon’s everything upon the whole rest of the Fediverse, and who completely disregards the very notion that anything that doesn’t have Mastodon’s culture could possibly have any culture.

    Now add even more software to the mix. Like Friendica and Hubzilla which have developed their own cultures with zero influence from either Mastodon or Lemmy, also because they predate both. There’s stuff that’s absolutely bad by Mastodon’s culture and at the same time an integral part of Friendica’s or Hubzilla’s culture.

    Three, bias. Software like Lemmy or Mastodon has loads of moderators. In stark contrast, Hubzilla, (streams) and Forte lack the very concept of moderators that aren’t admins. Why? Because they have unimaginably highly advanced permissions systems that allow for self-moderation on a level unknown on Mastodon, much less in the Threadiverse. Not to mention that there are many more Mastodon servers than there are Hubzilla, (streams) and Forte servers combined.

    Result: Mastodon, with its army of moderators, will overrule Hubzilla’s culture on Hubzilla with Mastodon’s culture which isn’t even compatible with Hubzilla.

  • 𝙈𝙞𝙖@quokk.au
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 days ago

    I’m not a huge fan of a software solution to this, we already have a large group chat open for instance operators to share and discuss details of user bans, spam, etc. This respects each instances ‘culture’ while also facilitating communication and dialogue around potential issues.

    • blued_gear@fedia.ioOP
      link
      fedilink
      arrow-up
      1
      ·
      3 days ago

      Ohh, I didn’t know about that. Would you share the address?

      Also, is there some general onboarding material for new instance admins which is software-unspecific?

  • Kichae@lemmy.ca
    link
    fedilink
    English
    arrow-up
    11
    ·
    5 days ago

    I’m not sure how a process modelled off of a tribunal is supposed to act as a fix to mods or admins not acting quickly enough. Trials and tribunals are notoriously slow, because they are called when correctness is more important than speed.

    By design, these are not vehicles for “swift actions”.

    If a certain website is known to have a problem with their moderation, then that’s what server block lists are for. Communal server block lists already exist. Having a standardized format and the ability to subscribe to one would be nice, but as of right now the amount of effort to update a server’s block list with a new version is relatively simple.

    The thing is, as the fediverse grows, and especially as the group-based part of the fediverse grows, we have to accept network splits as a natural part of that process. It is going to get patchy here. It’s a natural part of social network development. What we need to get ahead of is showing people that that is OK, and that frictionless access to the whole of the social web isn’t necessarily a good thing.

    • blued_gear@fedia.ioOP
      link
      fedilink
      arrow-up
      1
      ·
      5 days ago

      A tribunal is not the fastest solution; true and that is a problem. But on the other hand following the verdicts of just one entity (a list, an instance, a person) brings the risk of abuse of power by that entity where a jury is democratic.
      I don’t want to defend my idea as the right approach, as it has pros and cons and I don’t know what the optimal solution should be myself.

  • Vicinus@piefed.zip
    link
    fedilink
    English
    arrow-up
    9
    ·
    5 days ago

    I think Pylova (a soft-fork of Piefed) is at the forefront of moderation tools in the threadiverse.

    I think their recent addition of shareable user-subscribable block-lists is a good direction to go. I think this can be expanded to instance-level subscribable block-lists. There could be a variety of lists (CSAM, scrappers, scammers, agentics, etc.) and each instance chooses what list(s) to subscribe to or build their own for others to subscribe and contribute to. The lists would be easily fork-able so that any instance can take control of their own moderation, if they disagreed with an addition/subtraction to a list.

    For some lists (like scrappers), I think automatic addition could be set up to quickly “inoculate” the rest of the threadiverse against them. Perhaps one approach could be any IP that clicks on a non-user clickable link or gets stuck(?) in Anubis could be added.

    I think subscribable block-lists for instance admins could be a great way to protect the threadiverse (perhaps expanded to the fediverse as a whole or just any website in general) against any problematic actors quickly and at the first encounter (alternatively: after (x) # or % of instance admins add them to a list).

    Apparently some of these lists may already exist in some form (@Christopher@lemmy.grey.fail: “I was able to implement community maintained blocklists.”). So, my thought would be to make sure these lists are a standard format (if they aren’t already) that instances can auto retrieve and contribute to.

    Anyone: let me know if you have any thoughts or see any issues with the idea (constructive criticism only, please).

    • Onno (VK6FLAB)@lemmy.radio
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 days ago

      Posts hitting the fediverse over the past 24 hours or so are essentially creating a new account for each post. The accounts are across many instances and posts across many communities.

      I’m not sure how this proposal would work in the current environment.

      • Vicinus@piefed.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 days ago

        The accounts are across many instances …

        Good point. If they have a shared identifier (IP or something) than I could see the block list working. If not, and it’s probably not, then yeah, I don’t think the block list would be able to handle that spam.

        I wonder if there is any approach that could. Different origins, different entrances, and different targets, that’s a difficult one. It’s not my knowledge base, so maybe something exists that could handle it? I’d be curious to hear about it, probably pretty cool.

        Maybe machine learning on interaction rates (sign in to post timeline)? I’m assuming it’s automated though…

    • blued_gear@fedia.ioOP
      link
      fedilink
      arrow-up
      2
      ·
      5 days ago

      The difference between blocking and purging is that a blocked account is still residing on the instance (even more so for user blocks instead of admin blocks). As the data is still there, it opens possibility for legal trouble. Full purges by instance moderation action is different.

      The scope of my proposal is not to help curate and filtering content for instances, but to enable widespread coordinated action against content which was already created and is harmful without any room for interpretation.

      approach could be any IP

      That is a whole other issue. Scrapers and request spammers, not content spamming accounts, can be combated with already existing technology at the reverse proxy server. There are big crowdsourced IP banlists which are continuously updated.

      I think subscribable block-lists for instance admins

      This would be the easiest solution. But I think it will lead away from individualism of instances, as all decisions are automatically applied, instead of only a manually reviewed subset.
      Your idea with applying the mod action after a threshold of other instances did it too is something to consider. It will keep individualism but also creates “avalanches” once enough instances in the network agreed on a decision, which might be even better for propagating swift action against general harmful content.

      • Vicinus@piefed.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 days ago

        Appreciate the feedback :)

        The difference between blocking and purging is that a blocked account is still residing on the instance (even more so for user blocks instead of admin blocks). As the data is still there, it opens possibility for legal trouble. Full purges by instance moderation action is different.

        The scope of my proposal is not to help curate and filtering content for instances, but to enable widespread coordinated action against content which was already created and is harmful without any room for interpretation.

        Makes sense. I suppose my described lists could also be made into purge lists.

        That is a whole other issue. Scrapers and request spammers, not content spamming accounts, can be combated with already existing technology at the reverse proxy server. There are big crowdsourced IP banlists which are continuously updated.

        Not my knowledge base, so good to know that already exists.

        This would be the easiest solution. But I think it will lead away from individualism of instances, as all decisions are automatically applied, instead of only a manually reviewed subset.

        Your idea with applying the mod action after a threshold of other instances did it too is something to consider. It will keep individualism but also creates “avalanches” once enough instances in the network agreed on a decision, which might be even better for propagating swift action against general harmful content.

        Definitely a balance needs to be struck, between quick action and preventing abuse.

  • goferking (he/him)@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 days ago

    As with anything it depends on who is in control of the moderation or the ones doing the moderation.

    And part of it sounds like a centralized layer on top of federation that would just be the antithesis of what the purpose of federation is.

    I know you are thinking of csam specifically but as described could end up giving certain mods and instances an essential veto.

    Based on certain instances cough lemmy.world and piefed.social I see that going extremely poorly

  • docus@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    6
    ·
    5 days ago

    Interesting idea. Not an instance owner, and not familiar with the finer details of federation, so no idea if it could be done. My initial concerns is that a majority vote won’t work, if you have to wait for the majority of instance mods to vote it’s going to be too slow. Maybe some degree of instance level config helps. For example, if i had my own instance, i would follow ban/delete recommendations from the likes of .world, .dbzer0, but maybe not from .ml without a human reviewing it first. Also need to ensure the ‘court’ does not get flooded.

        • DioMylo@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          5 days ago

          I’m new to Lemmy so I have tried both there, hexbear and on lemmy.world… Don’t see a big difference, what are they known for?

          • AwesomeLowlander@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            4
            ·
            5 days ago

            Hexbear, lemmy.ml (known as .ml), and lemmygrad.ml (known grad), are colloquially known on the Threadiverse as the ‘Tankie Trio’. In general, they support China, Russia, et al. Moderation on their communities is extremely biased - your opinion on a topic determines if the mods ignore you or come down with the wrath of god.

            You may not have noticed a difference because this refers to communities on their instances. If you were browsing /all, you were probably seeing a mix of communities from across the Threadiverse. However, due to their bad rep, many instances block (defederate) them, which means there is a lot of content you can’t see if you’re using them as your home instance.

            • DioMylo@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 days ago

              okay well so as a ‘non-tankie’ marxist I’d have to keep separate accounts to see all content? or can I just post everywhere?

              • AwesomeLowlander@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                1
                ·
                4 days ago

                You’ll have to check which instance federates with all 3 of them, I’m not up to date on that. There should be some though. Using one of those as your home should suffice.

  • HubertManne@piefed.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 days ago

    I think this is an instance owner thing. They run the instances and ultimately who owns and thus mods the communities on their instance. I doubt anyone running an instance would want anything foisted on them. I honestly am more concerned with development that allows users to control their feed as much as possible. Like being able to subscribe to a mod or someones block list. Or even better filter options that allow for complex blocking.

    • 𝙈𝙞𝙖@quokk.au
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      I honestly am more concerned with development that allows users to control their feed as much as possible. Like being able to subscribe to a mod or someones block list. Or even better filter options that allow for complex blocking.

      PyLova offers those features.

  • slimes@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 days ago

    This is a way for white people to abuse power dynamics and harm marginalized people.

    Moderation is a skill and requires experience, more than most moderators have. It’s ideally a paid role that people have to compensate them for the difficult work they do.

    The mentality that its free or non-skilled work is due to tech companies being terrible role models for morality, worker equity, and justice. You cannot imitate these systems to succeed, they are based in bottomless pits of money that they use to squash human rights violations.

    Judges in court systems are ideally well trained and experienced in the law. Its a paid gig and prone to being terribly abused.

    When some instance that wants mutual aid posts to disappear gets a “judge” to do this would you tell the disabled person on your instance that they cannot ask their community for help? Where would you tell them to go when the people who make the most impact are cut off? Would they be banned for that? What choices to people harmed by “judges” have when they are targeted unfairly?

    The amount of overhead managing moderation on one instance can be difficult, but sifting through decisions made by a bunch of anonymous “judges” sounds like an utterly depraved torture chamber. In the end the choice would be whether the instance agrees with the (unqualified, unvetted, unpaid) “judge’s decision” which ultimately brings this back to where we are now.

  • Pamasich@kbin.earth
    link
    fedilink
    arrow-up
    4
    ·
    5 days ago

    Everyone can post a case via normal Fedi posts to the court and the elected judges give a verdict via majority vote. Once a case has a verdict, all instances should immediately apply the decided action against the offending content / account.

    My immediate thought reading this was, how does that work across jurisdictions? Is the idea that every jurisdiction runs its own instance of this software? Something illegal in one jurisdiction might not be in another.

    There’s also the question of representation. Does every (lemmy/mbin/piefed) instance get the same representation? If there’s proportional representation, that just promotes centralization of the fediverse. If there’s not, you can just set up new instances to manipulate the vote.

    And the task of the court is to defend universal rules all following instances agree on.

    Sure, but are there checks and balances which ensure that?

    • blued_gear@fedia.ioOP
      link
      fedilink
      arrow-up
      1
      ·
      5 days ago

      Is the idea that every jurisdiction runs its own instance of this software?

      That is possible, yes. And an instance can follow the rulings of more than one court (the union of all verdicts would apply).

      There’s also the question of representation.

      Fair representation by election is an issue where I have to read some papers about before specifying the details of this system.

      Sure, but are there checks and balances which ensure that?

      • Elections where a fixed part of current judges is replaced every x months
      • Removal of a judge if x% of fedis MAU or y% of instance admins vote on a distrust

      That would be my current ideas. But keep in mind that I’m a software engineer, not someone who studied politics.

  • slazer2au@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    5 days ago

    It does sound like a decent idea, just not sure how it will work with the different ideologies of the Lemmy instances.
    Things that are banworthy on one instance are not banworthy on another.

  • Onno (VK6FLAB)@lemmy.radio
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 days ago

    The more steps, the less effective any moderation is going to be.

    I literally just reported about 50 or so spam posts, manually, for a message that was being posted by new accounts with only one or two posts, each to a different communities and instances, seconds apart, each username related words with a number that changed, account age less than a day.

    In other words, an automated spamming engine creating accounts across multiple instances and posting at scale.

    Think USENET Green Card from the early 90’s, a pivotal moment in spam history. This is the tip of the iceberg.

    You cannot fight this with judges and voting, you need a better approach.

    • nocturne@piefed.social
      link
      fedilink
      English
      arrow-up
      2
      ·
      5 days ago

      Lemmy & piefed need a multi post report mechanism, or at least the ability to report an account and not just their posts.

      • WhyJiffie@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 days ago

        the reporting system could also keep track of a reporter score, measuring how useful a user’s reports are. the only effect it would have is for ordering of incoming reports in the list moderators see, reports from users with a good track record show earlier in the list

      • Onno (VK6FLAB)@lemmy.radio
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 days ago

        While true, reporting the spam run I saw would not have benefitted from such a system, since there were nearly as many accounts as there were posts and they were across many different instances.

  • it_depends_man@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 days ago

    I recently learned about discourses trust levels:

    https://blog.discourse.org/2018/06/understanding-discourse-trust-levels/

    They’re pretty smart.

    Overall, my utopian vision for the fediverse is local servers per interest, with members who willingly participate because they value the community, including paying for server costs. These local communities then moderate according to their rules and servers block each other based on preferences.

    In that utopian model, spam is not an issue, because the members are locally known, you don’t even really get in without some kind of invite or knowing someone.

    I would be against some overarching court that has the potential to make decisions I disagree with. The freedom of the internet is precisely in not being governed by something like that. Including communities around “wrong opinions” and “disgusting content”.

  • lambalicious@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 days ago

    CSAM

    Wouldn’t disabling media federation get rid of that part of the problem real fast, to then leave people open to work on the moderation issues such as “federated judging” etc?

    • goferking (he/him)@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 days ago

      Not if just using a link to said material. Media blocks would only cover uploads.

      Not to mitigate the issue of csam but also completey separate issue from moderation or federation judgment