Research Engineer, Language - Generative AI at Meta

United States

Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. We conduct focused research and engineering to build state-of-the-art LLMs, which we often open-source, like our team’s recent Llama 2. We are looking for strong engineers who have a background in generative AI and NLP, with experience in areas like language model evaluation; data processing for pre-training and fine-tuning; responsible LLMs; LLM alignment; reinforcement learning for language model tuning; efficient training and inference; and/or multilingual and multimodal modeling.<br/><br/><strong>Responsibilities</strong><br/>Design methods, tools, and infrastructure to push forward the state of the art in large language models<br/>* Define research goals informed by practical engineering concerns<br/>* Contribute to experiments, including designing experimental details, writing reusable code, running evaluations, and organizing results<br/>* Adapt standard machine learning methods to best exploit modern parallel environments (e.g. distributed clusters, multicore SMP, and GPU)<br/>* Work with a large and globally distributed team<br/>* Contribute to publications and open-sourcing efforts<br/><br/><strong>Qualifications</strong><br/>Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience<br/>* Research experience in machine learning, deep learning, and/or natural language processing<br/>* Experience with developing machine learning models at scale from inception to business impact<br/>* Programming experience in Python and hands-on experience with frameworks such as PyTorch<br/>* Exposure to architectural patterns of large scale software applications A PhD in AI, computer science, data science, or related technical fields.<br/>* Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.<br/>* First author publications at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).<br/>* Direct experience in generative AI and LLM research.