Principal Machine Learning Scientist (US Remote) at Turnitin, LLC

United States

$147.3k - $245k

<h3>Company Description</h3><p>When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For more than 25 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Turnitin products are used by educational institutions and certification and licensing programs to uphold integrity and increase learning performance, and by students and professionals to do their best, original work.</p><p>Experience a remote-first culture that empowers you to work with purpose and accountability in a way that best suits you, supported by a comprehensive package that prioritizes your overall well-being. Our diverse community of colleagues are all unified by a shared desire to make a difference in education.</p><p>Turnitin is a global organization with team members in over 35 countries including the United States, Mexico, United Kingdom, Australia, Japan, India, and the Philippines.</p><h3>Job Description</h3><p>Machine Learning is integral to the continued success of our company. Our product roadmap is exciting and ambitious. You will join a global team of curious, helpful, and independent scientists and engineers, united by a commitment to deliver cutting-edge, well-engineered Machine Learning systems. You will work closely with product and engineering teams across Turnitin to integrate Machine Learning into a broad suite of learning, teaching and integrity products.</p><p>We are in a unique position to deliver Machine Learning used by hundreds of thousands of instructors teaching millions of students around the world. Your contributions will have global reach and scale. Billions of papers have been submitted to the Turnitin platform, and hundreds of millions of answers have been graded on the Gradescope and Examsoft platforms. Machine Learning powers our AI Writing detection system, gives automated feedback on student writing, investigates authorship of student writing, revolutionizes the creation and grading of assessments, and plays a critical role in many back-end processes.</p><p><strong>Responsibilities and Requirements</strong></p><p>We’re an applied science group leaning towards modern Deep Learning. We expect our Senior Machine Learning Scientists to have a well-balanced set of skills, both in the Science as well as Software Engineering aspects of (Deep) Machine Learning. You will focus on developing novel and deployable ML models and solutions where no ready-made solution may be available. Therefore you need to be conversant enough with the mathematics of machine learning and deep neural networks such that you can construct novel model architectures, loss functions, training methods, training loops etc. You are also expected to keep abreast of the latest research advancements in AI and Deep Learning across modalities and apply those to your work. While we leverage ready-made training platforms, we also write our own training loops. Additionally, the models need to be directly deployable in our products, therefore, production level coding and software engineering proficiency is required. You may train large models (up to 100s of billions of parameters) therefore, ability to train on multiple GPUs and nodes and knowledge of the latest model training and inferencing advancements is necessary. Next, the models must perform well in production not only in terms of accuracy but also compute-cost. Delivering such software requires a sufficiently deep Computer Science background. Dataset exploration, generation (synthetic), design, construction and analysis, are a routine part of the job and may occupy a significant fraction of your time. Also, datasets can be large (billions of samples), therefore the ability to write parallel and efficient pipelines is a necessary skill. You will also be involved in developing and staging demos and presenting your work within the company as well as via publications in peer reviewed venues (preferably A/A+ rated).</p><p><strong>Day-to-day, your responsibilities are to:</strong></p><ul><li>Research and develop Machine Learning models as described above. Optimize models for scaled production usage.</li><li>Work with colleagues in the AI team, other Engineering teams, subject matter experts, Product Management, Marketing, Sales and Customer support to explore ongoing product issues, challenges and opportunities and then recommend innovative ML/AI based solutions.</li><li>Help out with ad-hoc one-off tasks as a team player within the AI team. </li><li>Work with subject matter experts to curate and generate optimal datasets following responsible data collection and model maintenance practices. Explore and access local datastores as well as web data and write efficient parallel pipelines. Review and design datasets to ensure data quality.</li><li>Investigate weaknesses of models in production and work on pragmatic solutions.</li><li>Modify and fine-tune off the shelf models or develop novel models. Use LLMs via API (through prompt engineering and agents) and locally hosted LLMs and other foundation models.</li><li>Stay current in the field - read research papers, experiment with new architectures and methods, and share your findings.</li><li>Write clean, efficient, and modular code with automated tests and appropriate documentation.</li><li>Stay up to date with technology and platforms, make good technological choices, and be able to explain them to the organization.</li><li>Work with downstream teams to productionize your work and ensure that it makes into a product release.</li><li>Communicate insights, as well as the behavior and limitations of models, to peers, subject matter experts, and product owners.</li><li>Present and publish your work.</li></ul><h3>Qualifications</h3><ul><li>Master's degree or PhD in Computer Science, Electrical Engineering, AI, Machine Learning, applied math or related field or outstanding previous achievements demonstrating excellence in Deep Machine Learning, Computer Science and Software Engineering.</li><li>At least 10 years of industry experience in Machine / Deep Learning (we use the python ecosystem for ML), Computer Science and Software Engineering.</li><li>A strong understanding of the math and theory behind machine learning and deep learning is a prerequisite.</li><li>Academic publications in peer reviewed conferences or journals related to Machine Learning - preferably A/A+ rated such as NeurIPS, ICML, ICLR, AAAI, TMLR, JMLR, IJCAI, ICANN, KDD, ACL, EMNLP, NAACL, COLING, CVPR, ICCV, ECCV, IEEE etc.</li><li>Machine / Deep Learning development skills, including popular platforms (we use AWS SageMaker, Hugging Face, Transformers, PyTorch, PyTorch Lightning, Ray, scikit-learn, Jupyter, Weights &amp; Biases etc.).</li><li>An understanding of Language Models, using and training / fine-tuning and a familiarity with industry-standard LM families.</li><li>Excellent communication and teamwork skills.</li><li>Fluent in written and spoken English.</li></ul><p><strong>Would be a plus</strong></p><ul><li>We’re an applied science group (vs fundamental research), therefore Software development proficiency is a requirement. </li><li>Experience working with text data to build Deep Learning and ML models, both supervised and unsupervised. Experience with deep learning in other modalities such as vision and speech would be a strong bonus.</li><li>A Computer Science educational background is preferred as opposed to statistics or pure mathematics.</li><li>Reinforcement learning.</li><li>Interpretability of deep neural networks.</li><li>Experience with advanced prompting / agentic-systems and fine-tuning or training an LLM, using industry accepted platforms.</li><li>Showcase previous work (e.g. via a website, presentation, open source code).</li><li>Familiarity in building front-ends (Gradio, Streamlit, Dash or more standard React, Javascript, Flask) for simple demos, POCs and prototypes.  </li><li>Essential dev-ops skills (we use Docker, AWS EC2/Batch/Lambda).</li><li>Familiarity in coding for at-scale production.</li></ul><h3>Additional Information</h3><p>The <strong>expected annual base salary range</strong> for this position is: <strong>$147,300/year</strong> to <strong>$245,000/year</strong>. This position is bonus eligible / commission-based.</p><p>Actual compensation will be provided in writing at the time of offer, if extended, and is determined by work location and a range of other relevant factors, including but not limited to: experience, skills, degrees, licensures, certifications, and other job-related factors. Internal equity, market and organizational factors are also considered.</p><p><strong>Total Rewards @ Turnitin</strong><br/> At Turnitin, we believe Total Rewards go far beyond pay. While salary, bonus, or commission are important, they’re only part of the value you receive in exchange for your work.</p><p>Beyond compensation, you’ll experience the intrinsic rewards of unleashing your potential and making a positive impact on global education. You’ll also thrive in a culture free of politics, surrounded by humble, inclusive, and collaborative teammates.</p><p>In addition, our extrinsic rewards include generous time off and health and wellness programs that provide choice, flexibility, and a safety net for life’s challenges. You’ll also enjoy a remote-first culture that empowers you to work with purpose and accountability in the way that suits you best, all supported by a comprehensive package that prioritizes your overall well-being.</p><p><strong>Our Mission</strong> is to ensure the integrity of global education and meaningfully improve learning outcomes.</p><p><strong>Our Values</strong> underpin everything we do.</p><ul><li><strong>Customer Centric: </strong>Our mission is focused on improving learning outcomes; we do this by putting educators and learners at the center of everything we do.</li><li><strong>Passion for Learning:</strong> We are committed to our own learning and growth internally. And we support education and learning around the globe.</li><li><strong>Integrity:</strong> Integrity is the heartbeat of Turnitin—it is the core of our products, the way we treat each other, and how we work with our customers and vendors.</li><li><strong>Action &amp; Ownership:</strong> We have a bias for action. We act like owners. We are willing to change even when it’s hard.</li><li><strong>One Team: </strong>We strive to break down silos, collaborate effectively, and celebrate each others' successes.</li><li><strong>Global Mindset:</strong> We consider different perspectives and celebrate diversity. We are one team. The work we do has an impact on the world.</li></ul><p><strong>Global Benefits</strong></p><ul><li>Remote First Culture</li><li>Health Care Coverage</li><li>Education Reimbursement*Competitive Paid Time Off </li><li>Self-Care Days</li><li>National Holidays</li><li>2 Founder Days + Juneteenth Observed</li><li>Paid Volunteer Time Off</li><li>Charitable Contribution Match</li><li>Monthly Wellness or Home Office Reimbursement</li><li>Access to Employee Assistance Program (mental health platform)</li><li>Parental Leave</li><li>Retirement Plan with match/contribution</li></ul><p><strong>Seeing Beyond the Job Ad</strong><br/> At Turnitin, we recognize it’s unrealistic for candidates to fulfill 100% of the criteria in a job ad.  We encourage you to apply if you meet the majority of the requirements because we know that skills evolve over time. If you’re willing to learn and unleash your potential alongside us, join our team!</p><p>Turnitin, LLC is an Equal Opportunity Employer- vets/disabled. </p>