A Plug-In to convert Discourse Forum Discussions into Clear Proposal Revisions with Community-Sourced Justifications.

Proposal: Automated DAO Proposal Editing by SimScore.

A Plug-In to convert Discourse Forum Discussions into Clear Proposal Revisions with Community-Sourced Justifications.

Abstract

This proposal introduces SimScore, an AI-assisted governance tool that integrates with ArbitrumDAO’s proposal workflow to analyze community feedback and generate structured proposal edits with comprehensive justifications. The system will operate at two key stages: prior to Temperature Check and after Temperature Check completion, with token-weighted analysis in the second stage.

Motivation

ArbitrumDAO faces challenges in efficiently processing diverse community feedback during proposal development. Currently, proposers must manually synthesize numerous comments across forum discussions and Snapshot temperature checks, which is time-consuming and may lead to valuable insights being overlooked. SimScore addresses this by providing automated, statistical analysis of community consensus with transparent justification for all suggested changes.

Rationale

A challenge that DAOs have identified is a need for governance experimentation particularly related to AI assisted governance. The SimScore Solution involves analyzing Discourse Forum Replies with the SimScore API in order to both edit proposals and post comprehensive justifications.

Key Benefits of Automated Proposal Editing with SimScore.

Quality Improvement

By systematically analyzing diverse community perspectives, SimScore helps refine proposals beyond what any individual contributor might achieve. The statistical approach ensures that valuable insights aren’t lost in the noise of numerous comments, while also providing clarity on genuine consensus patterns across different viewpoints.

Throughput Acceleration

Instead of waiting weeks for proposers to manually process dozens or hundreds of comments, SimScore automates the analysis of community feedback. This can reduce proposal refinement cycles from weeks to days or even hours, dramatically increasing governance throughput.

Enhanced Transparency

Each suggested change includes a clear justification linked to specific community input. This creates an auditable trail showing exactly how community feedback influenced the proposal, reinforcing trust in the governance process.

The SimScore Solution

We (SimScore) propose a system that provides a sophisticated, data-driven approach to analyzing community feedback that operates through multiple integrated components:

1. SimScore / Constrained AI Analysis

  1. Data Collection: A Discourse plugin collects all forum replies and discussions related to a specific proposal.

  2. SimScore API processes this data through three distinct analytical dimensions:

    1. Priority Rankings: Calculates a mathematical “Consensus Point” from all written ideas, then measures each individual response’s similarity to this consensus (expressed as SimScore %)

      Priority Analysis Output #1. (Example Layout)

    Priority# Idea Author SimScore %
    1 Bias amplification through selective patterns Emma 53%
    2 Contextual misalignment in nuanced reasoning Liam 47%
    3 Temporal flattening of evolving opinions Sophia 32%
    4 Cross-source contamination of unique perspectives Gabrial 15%

    Similarity Score

    Similarity Score determines the similarity of a pair of ideas.

    Similarity Score Relative Similarity
    0.0 The pair of ideas have no similarity
    >0.2 The pair of ideas are considered plagiarized
    0.65 - 1.0 The pair of ideas are essentially duplicates

    Consensus Point

    Simscore API calculates the Consensus Point from all the written ideas as a mathematical expression.

    SimScore %

    The similarity of each idea vs the consensus point, expressed as SimScore %.

    ii. Conceptual Space Mapping: Positions each response in a two-dimensional space to visualize clusters and relationships between ideas

    Relationship Graph - Output #2

    Priority # X Y SimScore%
    1 0.515 -0.287 54%
    2 0.515 -0.586 51%
    3 0.104 0.334 49%
    4 -0.580 0.044 42%
    5 0.586 0.367 33%
    6 -0.260 0.615 32%
    7 -0.506 -0.406 31%

    https://docs.google.com/spreadsheets/d/e/2PACX-1vRbK31Zbther54K6vzp96LYYT5ETFNDalc-uSM_acVyq4GhEz4K1v9jkmg0tuYSM0FucUyvGi8p4Jv3/pubchart?oid=471457277&format=interactive

    iii. Pairwise Relationships: Creates a complete similarity matrix showing how strongly each response relates to every other response

    Pairwise Similarity Score Matrix

    SimScore ranks the replies in “most similar” order,

    Reply 1 Reply 2 Reply 3 Reply 4
    Reply 1 1.000 0.469 0.264 0.254
    Reply 2 0.469 1.000 0.235 0.234
    Reply 3 0.264 0.235 1.000 0.161
    Reply 4 0.254 0.234 0.161 1.000

    Note: The SimScore API is complete and ready for deployment. Description Github

  3. Validated Consensus Identification: The system requires evidence across multiple dimensions before confirming community consensus:

    • High-priority feedback with nearby supporting responses in conceptual space
    • Multiple moderate-priority responses that cluster together
    • Strong pairwise relationships (above 20% similarity) between responses from different authors

d. Constrained AI Implementation: AI serves as an interpreter of consensus patterns rather than a primary synthesizer. It is strictly constrained by SimScore’s statistical baseline to prevent misrepresentation of community views.

2. Discourse Plugin

  1. Side-by-Side Proposal Editing: The system integrates directly into Discourse’s edit section, showing original and revised proposals with color-coded differences.
  2. Comprehensive Justification: For each revision, the system generates a detailed justification citing specific community feedback that supported the change, including:
    • Priority rankings with similarity scores
    • Relevant pairwise relationships
    • Analysis of conceptual positioning
    • Direct quotes from community members

3. Human Final Control

  1. Human Final Control: The original proposer reviews all suggested changes and maintains final editorial control before advancing to voting.

Demonstration Screens.

Side by Side Proposal Editing - History Screen in Scroll forum

image.png

Demo of Edit Screen

Comprehensive Justification of each revision

image.png

Discourse / SimScore Integration Plug-in Specification

:page_facing_up: Technical Specification: SimScore-Powered DAO Proposal Editor

Discourse Plug in for SimScore API

User Research Specification

User Research Specification (1)

Proposed Cost

Action Cost Begin End
Discourse Plug-in Integration with SimScore API $15,000.00 Month 1 Month 3
User Research $10,000.00 Month 7 Month 9
SimScore Subscription $7,200 ($800/ month) month 4 Month 12
Action Payment Schedule Payment
Discourse Plug-in integration with Simscore Before Start $15,000
User Research End of Month 6 $10,000
SimScore Subscription End of Month 3 $7,200

About the Author:

With 30 years of leadership experience, the author served as CEO of an industrial water treatment company that achieved remarkable 100x value growth over 12 years. Under his leadership, the company bootstrapped and self-financed through organic growth before a successful private equity exit. His blank boarding methodology was instrumental in this success, identifying strategic priorities and driving organizational alignment. He is now the founder of SimScore, creating technology to make his proven methodologies accessible to organizations of all sizes.

Reference Material

SimScore API - Github - GitHub - Sim-Score/simscore-api

SimScore API - What is it?

SimScore API - Youtube Video - https://www.youtube.com/watch?v=ifi9PNs41G4

SimScore Analysis - Arbitrum Renaissance Incentive Program - Google Sheets

Hi @maets23,

We have moved the proposal to the Technical Discussion category for now. Our discourse instance is hosted by Discourse and not locally run by us. We are unable to install custom plugins beyond what is already available from the Discourse service. Also, it is important to highlight why it needs to be a plugin compared to a bot that simply reads the forum and makes a post? Similar to what @Tally_Support has been experimenting with.

1 Like

Hi, Each you liked a reply that I entered in the Arbitrum Forum regarding SimScore. I hope you may be interested in replying to my proposal. @TempeTechie @Zeptimus @karpatkey @Hawheik @dragonawr @0xTALVO.ETH_MTY @paulofonseca @Juanrah @BrainCarl @0xDonPepe

yeah, this approach is not technically possible to execute in the current Discourse hosted setup of the Arbitrum DAO forum.

Also, @Maets23 did you apply to the New Protocols and Ideas domain in the questbook grants? if not, why?

Hi @paulofonseca There are several reason we did not consider applying for D.A.O. grants. First the Rubric is not established for this type of project. Second, We have been ghosted before by AF before, so felt our efforts were better spent with different approaches including this one.

The inflection point where we decided to post the proposal in Arbitrum was this post from the Rari Forum.

I appreciate your feedback. We’ve opened up a conversation with the Discourse Team and will revise the plug-in aspect while maintaining our intent. We recently got google marketplace approval for our integration of SimScore into google sheets, which had many back and forth’s too.

As far as the “simply reads” part, the main feature we would like to implement for user’s benefit is the side by side edit comparison that would be posted similarly to how proposers edit proposal’s now. This would lead to no delegate transition costs.

DeFi Renaissance Incentive Program (DRIP) - Proposals - Arbitrum

As far as what @Tally_support has been experimenting with, I would love to learn more as we have no visibility on that. There is no point in duplicating work.

Looks like we’re chasing the same governance white rabbit!

This proposal hits on the same pain point I’ve been obsessing over - that gap between forum noise and actual proposal improvements. Seems like we’re in a friendly race to fix governance (may the best tool win, but the ecosystem definitely wins regardless).

This aligns with work I’m planning to execute on my recent questbook proposal where I’m focusing on similar challenges in governance optimization.

Good to see more builders tackling these governance headaches.

1 Like

Hey @paulofonseca, Thanks for the comment today. We’ll definitely add a section on making the integration open source so it can be audited.

Also should the proposal pass, I would like to reach out to you then as you seem to have done similar discourse integration work before…we’d appreciate the help. Thanks

Paul

Hey @entropy…- Matt

Thanks for your comment: Regarding input from highest token holders. Here is the workflow we envision for including the SimScore/AI solution in the Arbitrum Forum.

The system integrates with the existing ArbitrumDAO process as follows:

  1. Open Discussion Phase:
    • Proposal posted on forum with normal community feedback
    • No changes to user experience
  2. First SimScore Analysis:
    • Triggered when admin sends proposal to Snapshot
    • Statistical analysis of forum feedback using SimScore API methodology
    • Creation of edited proposal based on consensus patterns
    • Comprehensive justifications linking edits to specific community feedback
  3. Proposer Review:
    • Proposer reviews suggested edits and makes final revisions
    • Maintains existing permissions and workflow
  4. Hidden Voting Temperature Check:
    • Uses Snapshot’s existing “Hidden Voting” feature
    • Custom Discourse plugin hides voting intentions on forum
    • Ensures independence of thought during voting
  5. Second SimScore Analysis:
    • Statistical analysis of Snapshot-phase replies
    • Token-weighted using established 0.8-1.0 scale from DIP1.6
    • Updated proposal with justifications posted to Discourse
  6. Final Proposer Edit:
    • Proposer reviews and makes final adjustments
  7. Formal AIP Process:
    • Proposal enters the standard on-chain governance process as defined in the Constitution:
      • Formal AIP submission via governance contracts on Arbitrum One
      • 3-day period before snapshot is taken
      • 14-16 day voting period with appropriate quorum requirements
      • Execution phase following successful vote

We feel this approach will provide a first edit that is unregulated indicating the community’s feedback. The 2nd edit would be much stronger as it only includes members with tokens and follows the DIP 1.6 precedent of 0.8-1.0.

I hope this satisfies your concern.

Paul

Also, SimScore is recently are approved as an add-on in google sheets. If you’ d like to install it:

SimScore - Google Workspace Marketplace

Hey SimScore, thanks for the proposal. Assuming that the discourse plugin is solved and can be integrated, we’ve got one concern: commiting to a nine‑month subscription upfront. Lets say usage data shows the tool isn’t adding value in the first three months, the DAO has still paid for additional months.

Proposing an initial shorter pilot might make more sense and an extension depending on feedback and usage data.

1 Like