Senior Data Engineer ID88015 at AgileEngine
Brazil
<div>AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.<br></div><div><br></div><div><b>WHY JOIN US</b><br></div><div>If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!<br></div><div><br></div><div><b>ABOUT THE ROLE</b><br></div><div>We are looking for a <b>Senior Data Engineer</b> to replace a third-party data ingestion tool with an owned ETL pipeline.<br></div><div><br></div><div><b>MUST HAVES</b><br></div><div>- <b>4+ years of strong SQL and large-scale data ingestion/pipeline experience (batch ETL, orchestration, schema design).</b><br></div><div>- Working knowledge of <b>AWS data services (RDS/Postgres, S3, ECS)</b> sufficient to build within an existing cloud environment.<br></div><div>- Practical experience with <b>Claude Code or similar tools, and agents or MCP in real work.</b><br></div><div>- Ability to contribute to application and backend work beyond pure ETL to support broader platform needs.<br></div><div>- Familiarity with, or ability to quickly evaluate, managed ELT tools (such as Fivetran) against custom builds.<br></div><div>- Ability to ramp into existing attribution and scoring logic so ingestion output aligns with downstream dashboard needs.<br></div><div>- Upper-intermediate English level.<br></div><div><br></div><div><b>NICE TO HAVES</b><br></div><div>- Direct or adjacent experience with digital advertising / DSP data (e.g., Amazon DSP, Amazon Advertising API, or comparable programmatic platforms).<br></div><div>- Experience replacing legacy third-party data pipelines with owned, custom infrastructure.<br></div><div>- Familiarity with MLOps pipelines and how data feeds predictive models.<br></div><div>- Experience working alongside part-time technical advisory leads to validate architecture decisions.<br></div><div><br></div><div><b>WHAT YOU WILL DO</b><br></div><div>- Document current ingestion logic inside the legacy tool, including sources, endpoints, schemas, and transformation logic.<br></div><div>- Build the ETL pipeline to replace the legacy system, handling ingestion from the Amazon API, other DSP platforms, and related digital data sources.<br></div><div>- Evaluate and decide between off-the-shelf solutions (e.g., Fivetran) and owned ETL systems alongside the Infrastructure Lead.<br></div><div>- Design the pipeline as a standalone, owned system to power client-facing dashboards.<br></div><div>- Provide flexible engineering support for application and backend work within the AWS environment when directed.<br></div><div>- Coordinate with data science teams to ensure ingestion output aligns with the attribution and scoring logic of downstream models.<br></div><div>- Work seamlessly within the existing AWS environment (ECS, S3, RDS) rather than standing up parallel infrastructure.<br></div><div><br></div><div><b>PERKS AND BENEFITS</b><br></div><div>- <b>Professional growth</b>: Mentorship, TechTalks, and personalized growth roadmaps.<br></div><div>- <b>Competitive compensation</b>: USD-based pay with education, fitness, and team activity budgets.<br></div><div>- <b>Exciting projects</b>: Modern solutions with Fortune 500 and top product companies.<br></div><div>- <b>Flextime</b>: Flexible schedule with remote and office options.<br></div><br>
Apply Now
