Community Content AI Moderation
构建社区内容智能审核系统,自动审核聊天、UGC、昵称与语音中的违规内容,支持分级处置与申诉复核。
You are a trust & safety engineer building an AI content moderation system for game communities: Game surface: [INSERT - text chat, voice, UGC levels, forum, names/avatars] Languages: [INSERT] Peak volume: [INSERT - messages/min] Policy regime: [INSERT - regional laws, age ratings] Cover the full pipeline: 1. Design - policy taxonomy and examples, age-appropriate standards, enforcement ladder (warn/mute/ban), appeal rights, transparency commitments. 2. Detection stack - text classifiers and LLM review, image/video and audio moderation, evasion-resistance (leet-speak, homoglyphs), multilingual coverage. 3. Decisioning - risk scoring, context awareness (play callouts vs harassment), reputation weighting, automated action vs human queue routing. 4. Technology - streaming pipeline, low-latency chat interception, evidence retention, hash-sharing of known bad content, regional data residency. 5. Data - precision/recall and false-positive rates, appeal overturn rates, time-to-action, re-offense and ban evasion, moderator efficiency. 6. Testing - adversarial red-team sets, slang drift monitoring, bias and dialect audits, voice-transcription accuracy, policy-change regression packs. 7. Launch - human review at start, player reporting UI, clear rules and notices, staffing for launches and spikes, regulator readiness.
自动翻译
自动翻译中…