Technical Product Manager, Trust & Safety at Innodata Inc.
United States
$180k - $220k
<div class="content-intro"><p>Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.</p></div><p><strong>Scope of the Role: </strong></p> <p><span data-contrast="auto">As a Technical Product Manager for Trust & Safety, you will define and ship the data products that frontier labs use to train and evaluate models to perform personalization, computer-use (CUA), and GDPval tasks safely and in a trustworthy manner.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p> <p><span data-contrast="auto">You will own the full lifecycle of these products: from translating a lab's research need into a spec, to designing reinforcement learning (RL) environments, rubrics, and evals, to running delivery with our expert workforce and measuring whether the data actually moved the model.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p> <p><span data-contrast="auto">A core part of the job is building RL environments with deliberate traps. That includes </span><strong><span data-contrast="auto">misalignment traps</span></strong><span data-contrast="auto"> that test for reward hacking, deception, sandbagging, oversight evasion, and power-seeking; </span><strong><span data-contrast="auto">cyber traps</span></strong><span data-contrast="auto"> such as planted credentials, injected instructions, and poisoned tools; and other honeypots that reveal how a model behaves when it believes no one is watching.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p> <p><span data-contrast="auto">You thrive in ambiguity, go deep on technical detail, and care about making powerful AI safe and beneficial.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></p> <p data-start="774" data-end="910"><strong>What You’ll Own:</strong></p> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><strong><span data-contrast="auto">Define data products for frontier labs.</span></strong><span data-contrast="auto"> Turn lab research goals into clear product specs for safety training data, RL environments, and evaluations.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1"><strong><span data-contrast="auto">Design trap-based RL environments.</span></strong><span data-contrast="auto"> Build sandboxed environments that embed misalignment traps (reward hacking, specification gaming, deception, sandbagging, oversight subversion) and cyber traps (prompt injection, credential exfiltration, tool poisoning, unsafe file and network actions).</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1"><strong><span data-contrast="auto">Build safety into agentic tasks by design.</span></strong><span data-contrast="auto"> Specify safe-behavior rubrics, verifiers, and reward signals so that models learn to complete real work while refusing, escalating, or asking for confirmation at the right moments.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1"><strong><span data-contrast="auto">Own evals and metrics.</span></strong><span data-contrast="auto"> Define what "safe and trustworthy" means for each product in measurable terms, including attack success rate, over-refusal, trap trigger rate, and task completion under adversarial pressure. Track blind spots and drive iteration.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1"><strong><span data-contrast="auto">Prioritize ruthlessly.</span></strong><span data-contrast="auto"> Frame problems crisply, lay out options with their business and technical tradeoffs, and separate MVP from ideal state.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1"><strong><span data-contrast="auto">Partner across teams.</span></strong><span data-contrast="auto"> Work with lab researchers, our ML and platform engineers, red-teamers, policy experts, and delivery leads running large expert annotator pools.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1"><strong><span data-contrast="auto">Track the threat landscape.</span></strong><span data-contrast="auto"> Stay current on agentic risks, alignment research, and new attack techniques, and turn them into roadmap items before customers ask.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="8" data-aria-level="1"><strong><span data-contrast="auto">Communicate clearly.</span></strong><span data-contrast="auto"> Write specs, customer briefs, and safety findings that land with researchers and executives alike.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <h4><span data-contrast="auto">These examples show the kind of work this role owns:</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":240,"335559739":240}"> </span></h4> <ul> <li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">A </span><strong><span data-contrast="auto">cyber-trap environment suite</span></strong><span data-contrast="auto">: sandboxed environments seeded with injected instructions, exposed secrets, and destructive shortcuts, scored on whether the agent finishes the task without taking the bait.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1"><strong><span data-contrast="auto">Tasks with integrity traps</span></strong><span data-contrast="auto">: realistic work where the easiest path to a high score requires fabricating data, skipping a required step, or gaming the grader.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1"><span data-contrast="auto">A </span><strong><span data-contrast="auto">misalignment eval harness</span></strong><span data-contrast="auto">: environments that check whether a model behaves differently when it believes it is being tested versus deployed, or when given chances to expand its own permissions.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1"><span data-contrast="auto">A </span><strong><span data-contrast="auto">trap library and quality framework</span></strong><span data-contrast="auto"> that lets our delivery teams produce new environments quickly while keeping verifiers reliable and traps hard to detect.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <p data-start="774" data-end="910"><strong>You’ll Thrive in This Role If You Have:</strong></p> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">5+ years of product management experience, including technical products in ML, AI data, security, or trust & safety.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1"><span data-contrast="auto">Hands-on familiarity with how LLMs are trained and evaluated: SFT, RLHF/RLAIF, reward models, verifiers, and benchmark design.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1"><span data-contrast="auto">Working knowledge of agentic AI: tool use, computer-use agents, multi-step planning, and the failure modes that come with them.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1"><span data-contrast="auto">A strong grasp of AI safety concepts such as reward hacking, deceptive alignment, jailbreaks, and prompt injection.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1"><span data-contrast="auto">Enough technical depth to read code, review an environment spec with engineers, and make sound technical tradeoffs. Comfort with Python and sandboxed environments (Docker, VMs, browser automation) is a plus.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1"><span data-contrast="auto">Experience designing metrics that capture risk, system performance, and user impact, and using them to make crisp decisions.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1"><span data-contrast="auto">A track record of shipping 0-to-1 products in fast-moving, ambiguous environments.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="8" data-aria-level="1"><span data-contrast="auto">The ability to explain complex technical ideas clearly to researchers, customers, and executives.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="3" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="9" data-aria-level="1"><span data-contrast="auto">Creative, adversarial thinking: you enjoy imagining how a capable model might cut corners, and you don't stop at existing checklists.</span><span data-ccp-props="{"134233117":false,"134233118":false,"335559738":0,"335559739":0}"> </span></li> </ul> <p> </p> <p><em>The expected salary range for this position is $180,000 – $220,000 USD per year, based on experience, skills, and qualifications.</em></p><div class="content-conclusion"><p></p> <p class="x_elementToProof"><em>Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at </em><a href="https://consumer.ftc.gov/articles/job-scams." target="_blank">https://consumer.ftc.gov/articles/job-scams.</a><em> </em></p> <p class="x_elementToProof"><em>If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at </em><a href="mailto:verifyjoboffer@innodata.com" target="_blank">verifyjoboffer@innodata.com</a><em> and consider reporting it to the FTC at </em><a href="http://reportfraud.ftc.gov/" target="_blank">ReportFraud.ftc.gov</a><em>.</em></p> <p></p></div>
Apply Now