DataOps Engineer at Sphere
Worldwide
<p><strong>Type:</strong> Long-term contract</p> <p>We are building a core data platform for a high-growth e-commerce company. The team needs to move from fragmented scripts and dashboards to a unified, automated, and trusted data foundation to support personalization and real-time analytics.</p> <p><strong>Responsibilities:</strong></p> <ul> <li> <p>Design and build automated CI/CD pipelines for data transformations, ETL/ELT, and ML model training.</p> </li> <li> <p>Implement a robust framework for data quality testing, validation, and proactive monitoring.</p> </li> <li> <p>Develop and maintain infrastructure-as-code templates for data pipeline orchestration and environment management.</p> </li> <li> <p>Establish and automate metadata collection, data lineage tracking, and pipeline observability.</p> </li> <li> <p>Create standards and tools to enable self-service data pipeline deployment for analytics and data science teams.</p> </li> </ul> <p><strong>Requirements:</strong></p> <ul> <li> <p>Experience in building, automating, and maintaining data pipelines <strong>(5+ years).</strong></p> </li> <li> <p>Experience with <strong>Python</strong> and <strong>SQL </strong>for engineering tasks.</p> </li> <li> <p>Experience with <strong>orchestration tools</strong> (Airflow, Dagster, Prefect) and modern data stack components.</p> </li> <li> <p>Proven track record of implementing data quality checks and testing in a CI/CD context.</p> </li> <li> <p>Experience with infrastructure-as-code (Terraform, CloudFormation) and CI/CD platforms (GitLab CI, GitHub Actions).</p> </li> </ul> <p><strong>Differentiator:</strong></p> <ul> <li> <p>Practical experience implementing a DataOps methodology or internal data platform.</p> </li> <li> <p>Knowledge of data discovery and lineage tools (DataHub, Amundsen).</p> </li> </ul> <p><strong>Nice to have:</strong></p> <ul> <li> <p>Experience with <strong>Snowflake</strong> or <strong>BigQuery</strong>.</p> </li> <li> <p>Familiarity with <strong>Streamlit</strong> for building simple data apps.</p> </li> </ul>
Apply Now