Senior Machine Learning Scientist - Applied Research (USA Remote) at Turnitin, LLC

United States

$111k - $185k

<h3>Company Description</h3><p>When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For over 25 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Over 21,000 academic institutions, publishers, and corporations use our services: Feedback Studio, Originality, Gradescope, ExamSoft, Similarity, and iThenticate.</p><p>Experience a remote-centric culture that empowers you to work with purpose and accountability in a way that best suits you, supported by a comprehensive package that prioritizes your overall well-being. Our diverse community of colleagues are all unified by a shared desire to make a difference in education.</p><p>Turnitin is a global organization with team members in over 35 countries including the United States, Mexico, United Kingdom, Australia, Japan, India, and the Philippines.</p><p>Turnitin, LLC is an equal opportunity employer- vets/disabled.</p><h3>Job Description</h3><p>Machine Learning is integral to the continued success of our company. Our product roadmap is exciting and ambitious. You will join a global team of curious, helpful, and independent scientists and engineers, united by a commitment to deliver cutting-edge, well-engineered Machine Learning systems. You will work closely with product and engineering teams across Turnitin to integrate Machine Learning into a broad suite of learning, teaching and integrity products.</p><p>We are in a unique position to deliver Machine Learning used by hundreds of thousands of instructors teaching millions of students around the world. Your contributions will have global reach and scale. Billions of papers have been submitted to the Turnitin platform, and hundreds of millions of answers have been graded on the Gradescope and Examsoft platforms. Machine Learning powers our AI Writing detection system, gives automated feedback on student writing, investigates authorship of student writing, revolutionizes the creation and grading of assessments, and plays a critical role in many back-end processes.</p><p><strong>Responsibilities and Requirements</strong></p><p>We’re an applied science group leaning towards modern Deep Learning. We expect our Senior Machine Learning Scientists to have a well-balanced set of skills, both in the Science as well as Software Engineering aspects of (Deep) Machine Learning. You will focus on developing novel and deployable ML models and solutions where no ready-made solution may be available. Therefore you need to be conversant enough with the mathematics of machine learning and deep neural networks such that you can construct novel model architectures, loss functions, training methods, training loops etc. You are also expected to keep abreast of the latest research advancements in AI and Deep Learning across modalities and apply those to your work. While we leverage ready-made training platforms, we also write our own training loops. Additionally, the models need to be directly deployable in our products, therefore, production level coding and software engineering proficiency is required. You may train large models (up to 100s of billions of parameters) therefore, ability to train on multiple GPUs and nodes and knowledge of the latest model training and inferencing advancements is necessary. Next, the models must perform well in production not only in terms of accuracy but also compute-cost. Delivering such software requires a sufficiently deep Computer Science background. Dataset exploration, generation (synthetic), design, construction and analysis, are a routine part of the job and may occupy a significant fraction of your time. Also, datasets can be large (billions of samples), therefore the ability to write parallel and efficient pipelines is a necessary skill. You will also be involved in code &amp; model maintenance, code hardening (preparing the model and code for production pipelines), developing and staging demos and presenting your work within the company as well as via publications in peer reviewed venues (preferably A/A+ rated).</p><p><strong>Day-to-day, your responsibilities are to:</strong></p><ul><li>Research and develop production grade Machine Learning models as described above. Optimize models for scaled production usage.</li><li>Work with colleagues in the AI team, other Engineering teams, subject matter experts, Product Management, Marketing, Sales and Customer support to explore ongoing product issues, challenges and opportunities and then recommend innovative ML/AI based solutions.</li><li>Help out with ad-hoc one-off tasks as a team player within the AI team. </li><li>Work with subject matter experts to curate and generate optimal datasets following responsible data collection and model maintenance practices. Explore and access SQL, no-SQL and web data and write efficient parallel pipelines. Review and design datasets to ensure data quality.</li><li>Investigate weaknesses of models in production and work on pragmatic solutions.</li><li>Utilize, adopt, and fine-tune off the shelf models, including LLMs exposed via API (through prompt engineering and agents) and locally hosting LMs and other foundation models.</li><li>Stay current in the field - read research papers, experiment with new architectures and LLMs, and share your findings.</li><li>Write clean, efficient, and modular code with automated tests and appropriate documentation.</li><li>Stay up to date with technology and platforms, make good technological choices, and be able to explain them to the organization.</li><li>Work with downstream teams to productionize your work and ensure that it makes into a product release.</li><li>Communicate insights, as well as the behavior and limitations of models, to peers, subject matter experts, and product owners.</li><li>Present and publish your work.</li></ul><h3>Qualifications</h3><p><strong>Required Qualifications:</strong></p><ul><li>Master's degree or PhD in Computer Science, Electrical Engineering, AI, Machine Learning, applied math or related field or outstanding previous achievements demonstrating excellence in Deep Machine Learning, Computer Science and Software Engineering.</li><li>At least 5 years of industry experience in Machine / Deep Learning (we use the python ecosystem for ML), Computer Science and Software Engineering.</li><li>A strong understanding of the math and theory behind machine learning and deep learning is a prerequisite.</li><li>Academic publications in peer reviewed conferences or journals related to Machine Learning - preferably A/A+ rated such as NeurIPS, ICML, ICLR, AAAI, TMLR, JMLR, IJCAI, ICANN, KDD, ACL, EMNLP, NAACL, COLING, CVPR, ICCV, ECCV, IEEE etc.</li><li>Machine / Deep Learning development skills, including popular platforms (we use AWS SageMaker, Hugging Face, Transformers, PyTorch, PyTorch Lightning, Ray, scikit-learn, Jupyter, Weights &amp; Biases etc.).</li><li>An understanding of Language Models, using and training / fine-tuning and a familiarity with industry-standard LM families.</li><li>Excellent communication and teamwork skills.</li><li>Fluent in written and spoken English.</li></ul><p><strong>Would be a plus:</strong></p><ul><li>We’re an applied science group, therefore Software development proficiency is a requirement. Experience working with text data to build Deep Learning and ML models, both supervised and unsupervised. Experience with deep learning in other modalities such as vision and speech would be a strong bonus.</li><li>A Computer Science educational background is preferred as opposed to statistics or pure mathematics.</li><li>Familiarity in building front-ends (Gradio, Streamlit, Dash or more standard React, Javascript, Flask) for simple demos, POCs and prototypes.  </li><li>Experience with advanced prompting / agentic-systems and fine-tuning or training an LLM, using industry accepted platforms.</li><li>Showcase previous work (e.g. via a website, presentation, open source code).</li><li>Familiarity in coding for at-scale production, ranging from best practices to building back-end API services or stand-alone libraries.</li><li>Essential dev-ops skills (we use Docker, AWS EC2/Batch/Lambda).</li></ul><h3>Additional Information</h3><p><strong>The expected annual base salary range </strong>for this position is:<strong> $111,000/year to $185,000/year. </strong>This position is bonus eligible / commission-based.</p><p>As a Remote-First company, actual compensation will be provided in writing at the time of offer, if extended, and is determined by work location and a range of other relevant factors, including but not limited to: experience, skills, degrees, licensures, certifications, and other job-related factors. Internal equity, market and organizational factors are also considered.</p><p><strong>Total Rewards @ Turnitin</strong><br/> Turnitin maintains a Total Rewards package that is competitive within the local job market. People tend to think about their Total Rewards monetarily — solely as regular pay plus bonus or commission. This is what they earn in exchange for what they do. However, Turnitin delivers more than just these components. Beyond the intrinsic rewards of unleashing your potential to positively impact global education, and thriving in an organization that is free of politics and full of humble, inclusive and collaborative teammates, the extrinsic rewards at Turnitin include generous time off and health and wellness programs that offer choice and flexibility and provide a safety net for the challenges that life presents from time to time. Experience a remote-centric culture that empowers you to work with purpose and accountability in a way that best suits you, supported by a comprehensive package that prioritizes your overall well-being.</p><p><strong>Our Mission </strong>is to ensure the integrity of global education and meaningfully improve learning outcomes.<br/> <br/> <strong>Our Values </strong>underpin everything we do.</p><ul><li><strong>Customer Centric </strong>- We realize our mission to ensure integrity and improve learning outcomes by  putting educators and learners at the center of everything we do.</li><li><strong>Passion for Learning </strong>- We seek out teammates that are constantly learning and growing and build a workplace which enables them to do so.</li><li><strong>Integrity </strong>- We believe integrity is the heartbeat of Turnitin. It shapes our products, the way we treat each other, and how we work with our customers and vendors.</li><li><strong>Action &amp; Ownership </strong>- We have a bias toward action and empower teammates to make decisions.</li><li><strong>One Team </strong>- We strive to break down silos, collaborate effectively, and celebrate each other’s successes.</li><li><strong>Global Mindset </strong>- We respect local cultures and embrace diversity. We think globally and act locally to maximize our impact on education.</li></ul><p><strong>Global Benefits</strong></p><ul><li>Remote First Culture</li><li>Health Care Coverage*</li><li>Education Reimbursement*</li><li>Competitive Paid Time Off </li><li>4 Self-Care Days per year</li><li>National Holidays*</li><li>2 Founder Days + Juneteenth Observed</li><li>Paid Volunteer Time*</li><li>Charitable contribution match*</li><li>Monthly Wellness or Home Office Reimbursement*</li><li>Access to Modern Health (mental health platform)</li><li>Parental Leave*</li><li>Retirement Plan with match/contribution*</li></ul><p>* varies by country</p><p><strong>Seeing Beyond the Job Ad</strong><br/> At Turnitin, we recognize it’s unrealistic for candidates to fulfill 100% of the criteria in a job ad.  We encourage you to apply if you meet the majority of the requirements because we know that skills evolve over time. If you’re willing to learn and evolve alongside us, join our team!<br/> <br/> Turnitin, LLC is committed to the policy that all persons have equal access to its programs, facilities and employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.</p>