Is the Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote) position at Patronus AI, Inc. fully remote?

Yes, this Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote) position at Patronus AI, Inc. is a remote position. The role is available for candidates in United States.

Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote) at Patronus AI, Inc.

United States

$0.05k - $0.15k

<div class="content-intro"><h2 style="text-align: justify;"><span style="font-family: arial, helvetica, sans-serif;"><strong>About Patronus AI</strong></span></h2> <p style="text-align: justify;"> </p> <p style="text-align: justify;"><span style="font-family: arial, helvetica, sans-serif;">Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.</span></p> <p style="text-align: justify;"> </p> <p style="text-align: justify;"><span style="font-family: arial, helvetica, sans-serif;">We are the team behind some of the earliest and most influential research in AI evaluation like<a class="css-173makr-linkStyle" href="https://arxiv.org/pdf/2311.11944" target="_blank"> <u>FinanceBench</u></a>,<a class="css-173makr-linkStyle" href="https://www.forbes.com/sites/rashishrivastava/2024/07/11/this-ai-powered-coach-catches-hallucinations-in-other-ai-models/" target="_blank"> Lynx</a>,<a class="css-173makr-linkStyle" href="https://arxiv.org/abs/2311.08370" target="_blank"> <u>SimpleSafetyTests</u></a>,<a class="css-173makr-linkStyle" href="https://www.cnbc.com/2024/03/06/gpt-4-researchers-tested-leading-ai-models-for-copyright-infringement.html" target="_blank"> <u>CopyrightCatcher</u></a>,<a class="css-173makr-linkStyle" href="https://arxiv.org/abs/2501.14249" target="_blank"> <u>Humanity’s Last Exam</u></a>, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.</span></p></div><h3><strong>At a glance</strong></h3> <ul> <li><strong>Engagement:</strong> Independent contractor, fully remote, asynchronous</li> <li><strong>Pay:</strong> $50-150/hr for task authoring, paid when the full task is submitted, plus a potential bonus for each accepted task. Strong performers move up within that range or onto productivity-based pay. The trial task is paid.</li> <li><strong>Commitment:</strong> 10+ hours per week</li> <li><strong>Start:</strong> Rolling, as soon as you pass the trial task</li> <li><strong>Location:</strong> Remote<br><br></li> </ul> <h4><strong>About Patronus AI</strong></h4> <p>Patronus AI is a frontier lab building simulation research and infrastructure to accelerate progress toward human-aligned AGI. We built some of the earliest research in AI evaluation, including <a href="https://arxiv.org/pdf/2311.11944">FinanceBench</a>, the first large-scale benchmark of how language models handle financial analysis, along with <a href="https://arxiv.org/abs/2501.14249">Humanity's Last Exam</a>, <a href="https://arxiv.org/abs/2311.08370">SimpleSafetyTests</a> and Lynx. Our team comes from Meta AI, Amazon AGI and Google. Our customers include foundation model labs and Fortune 500 companies, and we are backed by Lightspeed Venture Partners, Notable Capital and others.</p> <h3><strong>The role</strong></h3> <p>You'll design realistic finance tasks that a qualified professional could solve with the right knowledge and tools, and that today's AI models get wrong. Each task is built around a scenario we provide. You create the working documents someone in your role would actually handle, write the request, solve it yourself and define how the answer gets graded. Your work becomes evaluation and training data for frontier models.</p> <p>You don't need an AI background. You do need to be the kind of finance professional who catches the number that ties out but shouldn't.</p> <h3><strong>Areas we're hiring for</strong></h3> <ul> <li><strong>Treasury operations:</strong> cash positioning and liquidity management, daily cash operations and bank reconciliation, treasury analysis of accruals, exposures and discrepancies, and matching booked deals to counterparty confirmations and settlement records</li> <li><strong>Audit and assurance:</strong> external, internal or government audit, technology assurance, and SOX and ITGC controls testing, from evidence and walkthroughs through workpapers, exceptions, findings and remediation</li> <li><strong>Trading and portfolio operations:</strong> pre-trade compliance and clearance, execution trading from rebalance instructions, tickets and blotters, and reconciling positions, cash and holdings against instructions and constraints</li> <li><strong>Equity administration:</strong> stock plan administration (grants, vesting, approvals and plan availability), equity plan analysis (share reserves, outstanding awards and fair-market-value inputs), and corporate paralegal work on board consents and equity transaction documents</li> </ul> <h3><strong>What you'll do</strong></h3> <ul> <li>Build realistic evidence files from a provided scenario: bank statements and cash positions, deal confirmations and settlement records, trial balances and GL extracts, audit workpapers and control evidence, trade blotters and rebalance instructions, position and cash reconciliations, cap tables, grant records and board consents</li> <li>Write clear task requests that state what the deliverable is and how uncertainty and justified assumptions should be handled</li> <li>Solve each task end to end and document a reference solution with the reasoning behind every step</li> <li>Write explicit scoring criteria that let two independent graders reach the same verdict, including acceptable alternative answers</li> <li>Run tasks against current models, find where and why they fail, and adjust difficulty</li> <li>Check your own and peers' tasks for ambiguity, errors, answers exposed in the materials and shortcuts that skip the intended reasoning</li> <li>Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases you run into</li> </ul> <h3><strong>Who we're looking for</strong></h3> <p><strong>Required</strong></p> <ul> <li>3+ years of hands-on experience in one or more of the four areas above: treasury operations, audit and assurance, trading and portfolio operations, or equity administration</li> <li>Working command of the standards, controls and rules in your area (for example US GAAP or IFRS, PCAOB/AICPA auditing standards and SOX, treasury policies and bank controls, trade compliance and restricted-list rules, equity plan documents and fair-market-value requirements)</li> <li>Strong spreadsheet skills, and the habit of tying every figure back to its source</li> <li>Clear, precise writing in professional English</li> <li>Ability to work independently and asynchronously against deadlines</li> </ul> <p><strong>Nice to have</strong></p> <ul> <li>CPA, CA, ACCA, CISA, CTP, CFA or CEP</li> <li>Big Four, public company, bank, asset manager or fund experience</li> <li>Experience with the systems used in your area, such as SAP Treasury or another treasury management system, Bloomberg, AIM or EMSX, or Carta or Shareworks</li> <li>Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material</li> <li>Familiarity with how AI models fail (hallucinated figures, confident arithmetic errors, misread documents)</li> </ul> <h3><strong>Our standards</strong></h3> <ul> <li>All tasks, documents and solutions are human-authored. LLM-generated content is not permitted.</li> <li>Tasks and solutions must be original. Nothing may be copied from published or easily searchable sources.</li> <li>Never use real client, employer or personal data. All scenarios are fictional.</li> <li>Quality is judged on accuracy, rubric validity, difficulty and reviewer agreement, not volume.</li> </ul> <h3><strong>How hiring works</strong></h3> <ol> <li>Short AI interview and resume review</li> <li>One paid trial task, scored against a fixed quality checklist</li> <li>Onboarding and your first project</li> </ol> <p> </p> <p>We aim to make a decision within two weeks of your application.</p> <p> </p> <p><em>Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.</em></p><div class="content-conclusion"><p> </p> <p><span style="font-family: arial, helvetica, sans-serif;"><em>Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected</em></span><span style="font-family: arial, helvetica, sans-serif;"><em> characteristics.</em></span></p> <p> </p> <p><span style="font-family: arial, helvetica, sans-serif;">By clicking ‘Apply’, you agree to Greenhouse's <a href="https://www.greenhouse.com/legal">Terms of Service </a>and <a class="css-1d2k4kf e10ya71h0" href="https://www.greenhouse.com/privacy-policy" target="_blank">Privacy Policy</a><a class="css-1d2k4kf e10ya71h0" href="https://app.rippling.com/legal/privacy" target="_blank">.</a></span></p> <p><span style="font-family: arial, helvetica, sans-serif;">By clicking 'Apply', you agree to Patronus AI, Inc. <a href="https://www.patronus.ai/privacy-policy">Privacy Policy</a>.</span></p></div>

Apply Now

Remote Opportunity

Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote)

Join Patronus AI, Inc. as a mid professional working remotely from United States. Explore the role, benefits, and apply in one place.

Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote)

Patronus AI, Inc.

Contract

$0.05k - $0.15k

16 hours ago

About Patronus AI Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.

United States

Mid

Treasury operations

Equity administration

US GAAP

+5 more

Job Description

About Patronus AI

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.

We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.

At a glance

Engagement: Independent contractor, fully remote, asynchronous
Pay: $50-150/hr for task authoring, paid when the full task is submitted, plus a potential bonus for each accepted task. Strong performers move up within that range or onto productivity-based pay. The trial task is paid.
Commitment: 10+ hours per week
Start: Rolling, as soon as you pass the trial task
Location: Remote

About Patronus AI

Patronus AI is a frontier lab building simulation research and infrastructure to accelerate progress toward human-aligned AGI. We built some of the earliest research in AI evaluation, including FinanceBench, the first large-scale benchmark of how language models handle financial analysis, along with Humanity's Last Exam, SimpleSafetyTests and Lynx. Our team comes from Meta AI, Amazon AGI and Google. Our customers include foundation model labs and Fortune 500 companies, and we are backed by Lightspeed Venture Partners, Notable Capital and others.

The role

You'll design realistic finance tasks that a qualified professional could solve with the right knowledge and tools, and that today's AI models get wrong. Each task is built around a scenario we provide. You create the working documents someone in your role would actually handle, write the request, solve it yourself and define how the answer gets graded. Your work becomes evaluation and training data for frontier models.

You don't need an AI background. You do need to be the kind of finance professional who catches the number that ties out but shouldn't.

Areas we're hiring for

Treasury operations: cash positioning and liquidity management, daily cash operations and bank reconciliation, treasury analysis of accruals, exposures and discrepancies, and matching booked deals to counterparty confirmations and settlement records
Audit and assurance: external, internal or government audit, technology assurance, and SOX and ITGC controls testing, from evidence and walkthroughs through workpapers, exceptions, findings and remediation
Trading and portfolio operations: pre-trade compliance and clearance, execution trading from rebalance instructions, tickets and blotters, and reconciling positions, cash and holdings against instructions and constraints
Equity administration: stock plan administration (grants, vesting, approvals and plan availability), equity plan analysis (share reserves, outstanding awards and fair-market-value inputs), and corporate paralegal work on board consents and equity transaction documents

What you'll do

Build realistic evidence files from a provided scenario: bank statements and cash positions, deal confirmations and settlement records, trial balances and GL extracts, audit workpapers and control evidence, trade blotters and rebalance instructions, position and cash reconciliations, cap tables, grant records and board consents
Write clear task requests that state what the deliverable is and how uncertainty and justified assumptions should be handled
Solve each task end to end and document a reference solution with the reasoning behind every step
Write explicit scoring criteria that let two independent graders reach the same verdict, including acceptable alternative answers
Run tasks against current models, find where and why they fail, and adjust difficulty
Check your own and peers' tasks for ambiguity, errors, answers exposed in the materials and shortcuts that skip the intended reasoning
Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases you run into

Who we're looking for

Required

3+ years of hands-on experience in one or more of the four areas above: treasury operations, audit and assurance, trading and portfolio operations, or equity administration
Working command of the standards, controls and rules in your area (for example US GAAP or IFRS, PCAOB/AICPA auditing standards and SOX, treasury policies and bank controls, trade compliance and restricted-list rules, equity plan documents and fair-market-value requirements)
Strong spreadsheet skills, and the habit of tying every figure back to its source
Clear, precise writing in professional English
Ability to work independently and asynchronously against deadlines

Nice to have

CPA, CA, ACCA, CISA, CTP, CFA or CEP
Big Four, public company, bank, asset manager or fund experience
Experience with the systems used in your area, such as SAP Treasury or another treasury management system, Bloomberg, AIM or EMSX, or Carta or Shareworks
Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material
Familiarity with how AI models fail (hallucinated figures, confident arithmetic errors, misread documents)

Our standards

All tasks, documents and solutions are human-authored. LLM-generated content is not permitted.
Tasks and solutions must be original. Nothing may be copied from published or easily searchable sources.
Never use real client, employer or personal data. All scenarios are fictional.
Quality is judged on accuracy, rubric validity, difficulty and reviewer agreement, not volume.

How hiring works

Short AI interview and resume review
One paid trial task, scored against a fixed quality checklist
Onboarding and your first project

We aim to make a decision within two weeks of your application.

Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

By clicking ‘Apply’, you agree to Greenhouse's Terms of Service and Privacy Policy .

By clicking 'Apply', you agree to Patronus AI, Inc. Privacy Policy.

Requirements

3+ years of hands-on experience in one or more of the four areas above: treasury operations, audit and assurance, trading and portfolio operations, or equity administration
strong spreadsheet skills, and the habit of tying every figure back to its source
clear, precise writing in professional english
ability to work independently and asynchronously against deadlines

Skills

Treasury operations

Equity administration

US GAAP

IFRS

Audit and assurance

Trading and portfolio operations

PCAOB auditing standards

AICPA auditing standards

Ready to Apply?

Join Patronus AI, Inc. today

Salary Range

$0.05k - $0.15k

Posted 16 hours ago

More AI roles you might like

Discover similar opportunities from companies that are also hiring remotely.

Staff Product Manager, Search and AI Visibility - CANADA (Remote)

Luxury Presence

Full Time

CAD 150k - CAD 180k

16 hours ago

Luxury Presence is building the AI growth platform for real estate. Backed by Bessemer Venture Partners and other top investors, we're a Series C company that has hit $100M in annual recurring revenue.

Canada

Machine Learning

Senior

Product Management

SEO

AI Visibility

+5 more

Staff Product Manager, Search and AI Visibility - US (Remote)

Luxury Presence

Full Time

$170k - $200k

16 hours ago

United States

Machine Learning

Senior

Product Management

SEO

AI Visibility

+5 more

AI Security Sales Executive

Abnormal

Full Time

16 hours ago

ABOUT THE ROLE AI is rewriting how every company works, and everyone is racing to figure out how to secure it. We have, and we need someone to take it to market.

Australia

Machine Learning

Senior

Sales

AI Security

Cloud Security

+5 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Ministry Service Representative

Our Daily Bread Ministries

Full Time

15 hours ago

Ministry Services Representative Full-Time | Hourly | Remote Call Center Team Serve Our Global Community Through Meaningful Customer Care Our Daily Bread Ministries is seeking a Ministry Services Representative to serve as a key point of connection between our ministry and the people we serve.

United States

Engineering

Backend Engineering

Entry

Customer Service

Interpersonal skills

Verbal communication

+5 more

Ministry Service Representative

Our Daily Bread Ministries

Full Time

15 hours ago

United States

Engineering

Backend Engineering

Entry

Customer Service

Interpersonal skills

Verbal communication

+5 more

Account Manager II

Honeywell

Full Time

$116k - $144k

15 hours ago

In this role, you will impact the company significantly by driving revenue growth through effective account management. Your ability to identify new business opportunities and provide exceptional service will enhance customer satisfaction and strengthen Honeywell's position in the market.

United States

Engineering

Backend Engineering

Senior

Account Management

Sales

Strategic Planning

+5 more

United States

Engineering

Backend Engineering

Senior

Computer Science Fundamentals

Data Structures

Algorithms

+5 more

Inside Sales/Lead Generation (Real Estate) - 100% Remote

frontdoor, Inc.

Full Time

$0.018k - $0.025k

15 hours ago

United States

Sales

Account Executive

Entry

Sales

Lead Generation

Relationship Management

+5 more

Supervisor, Inside Sales - 100% Remote

frontdoor, Inc.

Full Time

$60k - $70k

15 hours ago

United States

Sales

Account Executive

Mid

Inside Sales

Team Leadership

Performance management

+5 more

Infrastructure Solution Consultant - New England Territory (Higher Education & K-12)

Lenovo

Full Time

$123.06k - $188.646k

15 hours ago

Why Work at Lenovo We are Lenovo. We do what we say. We own what we do. We WOW our customers. Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets.

United States

Engineering

DevOps / SRE

Staff

Data Center Solutions

Consultative Selling

Storage solutions

+5 more