Infrastructure Design Engineer at Together AI

United States

$210k - $250k

About The Role Together AI is building its infrastructure footprint at scale, and this role is central to making that happen. As an Infrastructure Design Engineer, you will own the design, planning, and technical execution of whitespace environments (where servers, storage, and network equipment are deployed) across our AI data center portfolio. You are the in-house expert who ensures that rack layouts, power distribution, cooling strategy, structured cabling, and physical infrastructure design are all built to support the density, redundancy, network and reliability requirements of large-scale AI GPU clusters. You will serve as the lead engineer across our DC portfolio, creating white space designs, reviewing partner and contractor designs, and ensuring plans are executed to spec. You will work closely with the Infrastructure Strategy, Infrastructure Engineering, and Operations teams, as well as external MEP consultants, general contractors, and data center partners. This is a technical role on a small, high-accountability team where your judgment directly shapes our ability to bring capacity online on time and to spec. Responsibilities Architect HPC clusters by designing whitespace layouts, including rack placement, aisle configuration, hot/cold aisle containment, equipment density, and airflow strategy for high-density GPU deployments Collaborate with electrical and mechanical engineers to integrate power and cooling infrastructure into whitespace environments Collaborate with Network Engineering to define and validate physical layer requirements (structured cabling, pathway planning, port density) for high-speed AI cluster interconnects, ensuring design compatibility with both physical and logical network architectures. Advise Data Center build teams/ contractors to ensure data center build out matches design and architecture specifications. Provide direction to optimize performance, scalability and cost-effectiveness Develop and maintain CAD/BIM drawings, schematics, capacity planning models, and technical documentation to support site design, construction, operations, and audits of data center white space Own capacity planning within the white space through modeling that incorporates growth, utilization, and infrastructure scaling Validate electrical and mechanical load distribution across whitespace fit-outs, including review of striping plans and upstream load balancing under normal and failover conditions. Partner with Infrastructure Strategy and Operations by providing design review and technical guidance during the white space fit-out phase. Drive continuous improvement in design standards, build processes, and quality assurance, including identifying opportunities to improve infrastructure reliability, reduce time-to-rack, and apply new technologies such as liquid cooling and high-density power architectures. Ensure all designs comply with applicable standards including TIA-942, Uptime Institute Tier guidelines, ASHRAE thermal recommendations, and relevant local codes and safety regulations. Requirements 7+ years of experience in data center design, critical facilities engineering, or infrastructure delivery, with deep technical knowledge across the full stack (power, cooling, network) as it pertains to white space design and implementation Demonstrated experience serving as an owner's engineer or resident engineer, including reviewing consultant drawings, managing contractor compliance, and interpreting construction specifications and submittal documents Strong working knowledge of how facility electrical (UPS, switchgear) and cooling (CRAC/CRAH) infrastructures interface with, and support, high-density white space systems (PDUs, in-row cooling, CDUs, RPPs) Proficiency with CAD/BIM tools such as AutoCAD, Revit, or equivalent; ability to produce and review technical drawings, schematics, and capacity models Working knowledge of industry standards including TIA-942, Uptime Institute Tier classifications, ASHRAE thermal guidelines, and ANSI/BICSI; familiarity with local building codes and safety regulations Proven ability to manage multiple concurrent projects across different sites and work effectively with MEP engineers, general contractors, and equipment vendors in fast-moving environments. Willingness to travel to data center sites as required for technical due diligence, design inspections, and final white space deployment sign-off Nice to Have Experience with liquid cooling systems for high-density GPU clusters, including direct liquid cooling (DLC), immersion cooling, or rear-door heat exchangers, and familiarity with associated power and plumbing infrastructure Background in hyperscale or AI-native infrastructure deployments, including reference architecture validation, and the development of final design acceptance criteria at scale. Familiarity with DCIM platforms, telemetry and monitoring systems, and infrastructure-as-code tooling for capacity and utilization tracking About Together AI Together AI is an AI-native cloud company building the infrastructure to make AI faster, cheaper, and more accessible. We’re rapidly scaling our GPU footprint: signing our own data center leases, building large-scale clusters, and expanding toward a global owned-infrastructure presence. Our research team has contributed to breakthroughs like FlashAttention, Hyena, and RedPajama, and we co-design across software, hardware, and algorithms to push the frontier of AI efficiency. Compensation We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $210-250K + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. Equal Opportunity Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our Privacy Policy at https://www.together.ai/privacy