Is the AI Operations Specialist position at Health Note fully remote?

Yes, this AI Operations Specialist position at Health Note is a remote position. The role is available for candidates in United States.

Is this a full-time or part-time AI Operations Specialist role?

This is a full-time AI Operations Specialist position at Health Note.

What benefits does Health Note offer for this position?

Health Note offers the following benefits: Health Insurance, Dental Insurance, Vision Insurance, Remote Work.

How do I apply for the AI Operations Specialist position at Health Note?

You can apply for this AI Operations Specialist position by clicking the "Apply Now" button on this page, which will take you to Health Note's application portal.

AI Operations Specialist at Health Note

United States

<h1>AI Operations Specialist</h1>Remote, U.S.<h2>What This Role Is</h2>We are looking for a hands-on AI Operations Specialist to own customer AI implementations from discovery through launch and ongoing optimization.You will configure and improve LLM-powered workflows, evaluate production behavior, troubleshoot issues, and work directly with customers and internal teams to make sure implementations work reliably in the real world.This is a customer-facing technical IC role. You should be comfortable moving between AI behavior, implementation details, customer workflows, and production troubleshooting.<h2>What You’ll Do</h2><ul><li>Own customer AI implementations from discovery through launch and ongoing optimization.</li><li>Translate customer workflows and requirements into clear AI behavior, implementation plans, and testing criteria.</li><li>Design and improve prompts and workflow logic for customer-facing AI agents.</li><li>Build and run evaluations, test plans, and regression checks to improve reliability and consistency.</li><li>Investigate production issues across prompts, workflows, integrations, data, APIs, and application behavior.</li><li>Determine whether problems can be resolved directly or require product or engineering support, and escalate with clear evidence and reproduction steps.</li><li>Facilitate customer testing and troubleshooting, and communicate status, risks, blockers, and required decisions clearly.</li><li>Drive open issues to resolution across customers and internal teams, including when ownership or next steps are ambiguous.</li><li>Use recurring customer and production issues to improve implementation practices and product behavior.</li></ul><h2>What You Bring</h2><ul><li>Hands-on experience working with LLM-powered products or workflows in production.</li><li>Experience building evaluations and improving unreliable or nondeterministic AI behavior.</li><li>Strong technical troubleshooting skills and the ability to investigate complex systems without immediately handing problems to engineering.</li><li>Experience owning customer implementations from discovery through launch and optimization, including working directly with customers throughout the process.</li><li>Experience with healthcare technology and/or conversational or voice AI is helpful but not required.</li></ul><h2>Benefits</h2><ul><li>Health, dental, and vision insurance</li><li>401(k) with company match</li><li>Flexible PTO and company-paid holidays</li><li>Fully remote work within US hours</li><li>Company-provided laptop</li></ul>

Apply Now

Remote Opportunity

AI Operations Specialist

Join Health Note as a mid professional working remotely from United States. Explore the role, benefits, and apply in one place.

AI Operations Specialist

Health Note

Full Time

5 days ago

AI Operations Specialist Remote, U.S. What This Role Is We are looking for a hands-on AI Operations Specialist to own customer AI implementations from discovery through launch and ongoing optimization.

United States

Mid

AI operations

LLM Workflows

Prompt Engineering

+5 more

Job Description

AI Operations Specialist

Remote, U.S.

What This Role Is

We are looking for a hands-on AI Operations Specialist to own customer AI implementations from discovery through launch and ongoing optimization.

You will configure and improve LLM-powered workflows, evaluate production behavior, troubleshoot issues, and work directly with customers and internal teams to make sure implementations work reliably in the real world.

This is a customer-facing technical IC role. You should be comfortable moving between AI behavior, implementation details, customer workflows, and production troubleshooting.

What You’ll Do

Own customer AI implementations from discovery through launch and ongoing optimization.
Translate customer workflows and requirements into clear AI behavior, implementation plans, and testing criteria.
Design and improve prompts and workflow logic for customer-facing AI agents.
Build and run evaluations, test plans, and regression checks to improve reliability and consistency.
Investigate production issues across prompts, workflows, integrations, data, APIs, and application behavior.
Determine whether problems can be resolved directly or require product or engineering support, and escalate with clear evidence and reproduction steps.
Facilitate customer testing and troubleshooting, and communicate status, risks, blockers, and required decisions clearly.
Drive open issues to resolution across customers and internal teams, including when ownership or next steps are ambiguous.
Use recurring customer and production issues to improve implementation practices and product behavior.

What You Bring

Hands-on experience working with LLM-powered products or workflows in production.
Experience building evaluations and improving unreliable or nondeterministic AI behavior.
Strong technical troubleshooting skills and the ability to investigate complex systems without immediately handing problems to engineering.
Experience owning customer implementations from discovery through launch and optimization, including working directly with customers throughout the process.
Experience with healthcare technology and/or conversational or voice AI is helpful but not required.

Benefits

Health, dental, and vision insurance
401(k) with company match
Flexible PTO and company-paid holidays
Fully remote work within US hours
Company-provided laptop

Requirements

design and improve prompts and workflow logic for customer-facing ai agents.
build and run evaluations, test plans, and regression checks to improve reliability and consistency.
investigate production issues across prompts, workflows, integrations, data, apis, and application behavior.
determine whether problems can be resolved directly or require product or engineering support, and escalate with clear evidence and reproduction steps.
drive open issues to resolution across customers and internal teams, including when ownership or next steps are ambiguous.
use recurring customer and production issues to improve implementation practices and product behavior.
hands-on experience working with llm-powered products or workflows in production.
experience building evaluations and improving unreliable or nondeterministic ai behavior.

Benefits

Health Insurance
Dental Insurance
Vision Insurance
Remote Work

Skills

AI operations

LLM Workflows

Prompt Engineering

Technical Troubleshooting

Customer Implementation

Data Analysis

API integration

Regression Testing

Ready to Apply?

Join Health Note today

Posted 5 days ago

More AI roles you might like

Discover similar opportunities from companies that are also hiring remotely.

AI Product Lead, AI Experience & Quality

Flodesk

Full Time

$150k - $200k

1 day ago

Flodesk is recognized in the Inc 5000 as one of the world's fastest-growing email marketing companies, built to help entrepreneurs sell online and design emails that people love to get.

Worldwide

Machine Learning

Senior

AI product management

Prompt Engineering

LLM Evaluation

+5 more

Senior Applied AI Engineer, Agent Quality & Evaluations

Flodesk

Full Time

$150k - $250k

1 day ago

Flodesk is recognized in the Inc 5000 as one of the world's fastest-growing email marketing companies, built to help entrepreneurs sell online and design emails that people love to get.

Worldwide

Machine Learning

Senior

Python

TypeScript

LLM

+5 more

Senior Developer Relations Manager - Gen AI

NVIDIA

Full Time

1 day ago

We are seeking a highly technical and strategic Senior Developer Relations Manager to join our team, with a focus on engaging developer ecosystems across emerging technology domains.

Germany

Machine Learning

Staff

Agentic AI

Generative AI

LLMs

+5 more

Explore more remote openings

Browse fresh listings from our global community of remote-friendly teams.

Mortgage Processor

American National Bank & Trust

Full Time

20 hours ago

GENERAL DESCRIPTION : The Mortgage Processor is responsible for processing residential real estate loans from application through closing while ensuring compliance with Bank policies, investor guidelines, and applicable federal and state regulations.

United States

Engineering

Backend Engineering

Mid

Mortgage processing

Loan Origination Systems

Regulatory Compliance

+5 more

Senior Communications Specialist

Vistra Communications

Full Time

22 hours ago

Vistra is seeking a Senior Communications Specialist to analyze, develop, and execute written/visual communication content related to suicide prevention, intervention, and postvention.

United States

Engineering

Backend Engineering

Staff

Strategic Communications

Public affairs

Marketing

+5 more

Area Sales Manager - Pacific Northwest

Bidadoo Inc

Full Time

$60k - $80k

23 hours ago

The Area Sales Manager for Pacific Northwest, ideally based in Washington or Oregon will play a key role in managing existing accounts, acquiring new customers, and serving as a trusted consultant.

United States

Sales

Account Executive

Mid

Sales

Outside Sales

Lead Generation

+5 more

Account Executive

Leading Edge Administrators LLC

Full Time

$80k - $100k

23 hours ago

This position offers the flexibility to work remotely. However, candidates located near our offices in Wall Street, Brooklyn or Tampa are preferred, as proximity to these locations may be beneficial for occasional in-person collaboration.

United States

Sales

Account Executive

Senior

Account Management

Sales

Healthcare Insurance

+5 more

Senior Site Reliability Engineer Lead

Akamai

Full Time

$121.4k - $218.6k

1 day ago

Do you have a passion for cutting edge technologies and tackling system problems? Are you a self-starting professional who thrives in a dynamic environment? Join our highly skilled Site Reliability team!

United States

Engineering

DevOps / SRE

Senior

Site reliability engineering

Linux

Hardware architecture

+5 more

Channel Account Manager

CoreView

Full Time

1 day ago

About CoreView CoreView is the global leader in Microsoft 365 (M365) tenant resilience, serving over 23 million users worldwide. We empower the world’s leading organizations to master the complexity of Microsoft M365.

United States

Engineering

Backend Engineering

Mid

Channel Management

SaaS

Microsoft 365

+5 more

Staff Data Scientist

Boulevard

Full Time

$164k - $205k

1 day ago

Who is Boulevard? Boulevard provides the first and only client experience platform for appointment-based, self-care businesses. We empower our customers to give their clients more of the magical moments that matter most.

United States

Data

Data Science

Senior

Data Science

Product Analytics

SQL

+5 more

Staff Data Scientist

Boulevard

Full Time

$164k - $205k

1 day ago

United States

Data

Data Science

Senior

Data Science

Product Analytics

SQL

+5 more

Remote Phone Fundraiser – Use Your Voice to Make a Difference

Public Outreach Consultancy Inc

Full Time

$0.019k - $0.024k

1 day ago

Remote Phone Fundraiser – Use Your Voice to Make a Difference | $19–$24/hr Work remotely. Build real connections. Fundraise for causes that matter. Are you someone who can talk to almost anyone, tell a great story, and get genuinely excited about something you care about?

United States

Engineering

Backend Engineering

Entry

Communication

Storytelling

fundraising

+5 more

Solutions Engineer

Yuno

Full Time

1 day ago

Remote, Latam, Full Time, Individual Contributor, +4 years of experience Who We Are At Yuno, we are building the payment infrastructure that allows all companies to participate in the global market.

Mexico

France

Engineering

Backend Engineering

Mid

Solutions engineering

Technical implementation

REST APIs

+5 more

Technical Program Manager – SAP Signavio

Tech Mahindra (America's) Inc

Full Time

$120k - $160k

1 day ago

Technical Program Manager – SAP Signavio Location: Remote US Employment: Full Time We are looking for an experienced Technical Program Manager (TPM) – SAP Signavio to lead enterprise process transformation initiatives within our clients’ ecosystem.

United States

Operations

Senior

Technical Program Management

BPMN 2.0

Process Mining

+5 more

Senior Editor, Conferences & Events

Bionews, Inc.

Full Time

1 day ago

<h1>About the Role</h1>Bionews is looking for a Senior Editor to build and lead the editorial strategy and content programming across live and virtual rare disease conferences and events.

United States

Engineering

Backend Engineering

Senior

Editorial strategy

Journalism

Project Management

+5 more