Design a content moderation agent with a prompt built for Claude and ChatGPT. It supplies context, constraints and an output contract, then asks the model to surface assumptions and gaps. Copy it, fill the variables and treat the result as a structured draft, not a final answer.
4.9(16 ratings)1.4k copies
Updated By Site Admin
38 words · v1.0
Fill in the blanks · 1 variable
Claude promptReplace every highlighted token before sending
<task>
Design a moderation agent for {community_type}. Define the policy categories, severity levels, the decision schema, appeal handling and the human review threshold. Include adversarial examples and a bias check plan. It must not make irreversible bans without review.
</task>
Think carefully before answering. Keep any reasoning separate and put the final deliverable inside <answer> tags.
Share what worked, what broke and which model you used. Comments appear after posting and are moderated for spam.
How to use this prompt
1
Open Claude and start a new chat. Paste the prompt exactly as written.
2
Replace each placeholder ({community_type}) with your own details. Leave the instructions and the output format untouched.
3
Add one concrete example or data point if the model's first answer is vague. Specific input produces specific output.
4
Run it once, then ask for a single revision with a specific critique rather than regenerating from scratch.
5
Review the result. Tool permissions, spend limits, approval gates, rollback and the eval results before launch.
Worked example
This is the kind of input the prompt expects and the shape of output it produces. Your result will differ with the model and the details you supply.
Example input
Community type: your community type
Example output
**Agent:** reads the request, checks the allowlist, drafts an action and pauses for approval before any write.
**Stop conditions:** missing required fields, ambiguous target, two consecutive tool errors, or any request touching billing or deletion.
**Eval cases:** valid update, wrong customer ID, prompt injection in a document, tool timeout, duplicate submission and a request to bypass approval.
**Failure found in review:** the agent could retry a payment twice. Fix: idempotency key plus a hard stop before the second attempt.
Tips for a better result
Design the stop conditions before the happy path; most incidents live in the loop.
Give each tool one job and make errors actionable for the model.
Require human confirmation for irreversible actions, no exceptions.
Change one variable at a time and compare the outputs; it is the fastest way to learn what this model responds to.
Common mistakes
Giving an agent broad write access without approval gates or spend limits.
Trusting retrieved documents as instructions rather than data.
Shipping without tracing, so a failed run cannot be reconstructed.
Verified Knowledge · FAQ
Questions about this prompt
Practical answers about running the design a content moderation agent prompt.
Related prompts
Same job, a different angle — or the next step in the workflow.
A agents prompt for design an AI workflow for a small team. It gives Claude and ChatGPT a clear role, explicit constraints and a defined output, so the first answer is closer to usable. Fill in the variables, run it once, then use the verification notes on this page to review the result.
A agents prompt for design an agent memory strategy. It gives Claude and ChatGPT a clear role, explicit constraints and a defined output, so the first answer is closer to usable. Fill in the variables, run it once, then use the verification notes on this page to review the result.
This copy-ready agents prompt helps you design an agent cost model with fewer blank-page decisions. Paste it into Claude and ChatGPT, fill the variables, and you get a structured first draft you can edit. It is written for repeatable results and tells you what to check before publishing.
ClaudeChatGPTDeepSeek
4.8(15)1.7k copies
SA
Written and reviewed by Site Admin
Author & Platform Administrator
Administrator and lead editor at AIPrompt123, curating high-performance AI prompts, SEO/AEO/GEO strategies, and developer repositories.
Last reviewed 6 November 2026 · version 1.0 · tested on Claude, ChatGPT
Comments
Share what worked, what broke and which model you used. Comments appear after posting and are moderated for spam.