Overview
Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. Binance's Risk Operations team is executing an AI-First transformation — moving from manual case review toward a fully autonomous decision pipeline powered by ROCA (Risk Operations AI Agent). This role sits at the critical human-in-the-loop node: reviewing cases where ROCA's confidence score falls below the auto-decision threshold, generating structured feedback that drives continuous model improvement, and progressively expanding the automation boundary. This is not a traditional fraud analyst role.
Think of it like the shift from manual labor to the steam engine era — the people who thrived weren't the ones who resisted the machine, but those who learned to operate it. Here, you are the operator: you direct the AI, validate its judgment, correct its blind spots, and steer it toward better outcomes. The machine handles the volume; you provide the expertise it can't yet replicate.
Responsibilities
* Core Review Duties
* Review cases escalated by ROCA where confidence score falls below the auto-decision threshold, using AI-assisted signals within the unified case review UI (no multi-system switching)
* Make accurate pass / block / escalate decisions on a daily queue spanning KYC Audit, ATO investigation, Reset 2FA, POA Review, and Withdrawal anomaly case types etc.
* Escalate Key User cases (Priority ≥ 75) and high-risk patterns to Senior Agent / Team Lead with clear rationale documentation
* Maintain SLA compliance (
* Label every reviewed case as TP / TN / FP / FN with structured root-cause annotations — this data directly feeds ROCA's continuous learning pipeline
* Identify recurring FP/FN patterns and route them through the correct feedback path:
o Type A — Feature weight bias → trigger model retraining / fine-tune
o Type B — Threshold miscalibration → update Decision Hub rules (with A/B validation)
o Type C — SOP gap or logic error → update SOP (version-tracked)
* Actively contribute to improving Precision (>95%) and Recall (>99%) targets by surfacing systematic signal failures to Data and Model teams
* Participate in regular AI model calibration sessions: review misclassification batches, validate ground truth, challenge decision thresholds with data
SOP & Knowledge Management
* Maintain and update Confluence SOP pages for assigned case types; SOP coverage rate target ≥ 80% (directly impacts ROCA first-pass accuracy)
* Flag SOP coverage gaps when ROCA's reasoning chain reveals unhandled scenarios; draft SOP additions for Team Lead review
* Onboard and calibrate BPO agents on AI-assisted review workflows; monitor BPO quality against automated QA benchmarks
Requirements
* 2+ years in fraud review, risk operations, or KYC/KYB case management
* Hands-on experience with ATO (Account Takeover) detection and investigation
* Comfort working in AI-augmented workflows: you read model outputs, interpret confidence scores, and make decisions based on AI-generated signals rather than raw data alone
* Structured, precise written communication: you can document a root-cause annotation in 3 sentences that an ML engineer can act on
* Bilingual English/Mandarin is required to be able to coordinate with overseas partners and stakeholders.
* An operator's mindset toward AI tools: you leverage AI signals to make faster, better decisions — you master the tool rather than compete with it
Nice to have
* Experience in crypto / Web3 / VASP risk environment; familiarity with blockchain transaction patterns (Sybil attacks, wash trading, mule account indicators)
* Exposure to ML model evaluation concepts: Precision, Recall, F1, confusion matrix — you don't need to build models, but you need to speak the language
* Familiarity with prompt engineering or LLM evaluation workflows; experience reviewing or testing AI-generated decisions at scale
* CAMS, CFE, or equivalent AML / fraud certification
* Prior involvement in SOP authoring, QA calibration, or BPO oversight for a risk operations team
Why Binance
* Shape the future with the world's leading blockchain ecosystem
* Collaborate with world-class talent in a user-centric global organization with a flat structure
* Tackle unique, fast-paced projects with autonomy in an innovative environment
* Thrive in a results-driven workplace with opportunities for career growth and continuous learning
* Competitive salary and company benefits
* Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
* Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.
Note: By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice.
#J-18808-Ljbffr