Staff Research Engineer (LLM Pre-Training)

JetBrains is a company founded in 2000 focused on creating robust and effective developer tools. They are developing an ambitious new AI platform that provides AI capabilities to all JetBrains products, based on in-house developed models for writing and coding assistance and integration with strategic partners.

• Experience in design, deployment, and support of production ML systems.
• Strong theoretical background in NLP and transformer-based approaches.
• Proficiency with modern deep learning frameworks such as PyTorch and common libraries for NLP.
• Experience in distributed training of multi-billion parameter models.
• Attention to detail and great communication skills.

Nice to have:

• Experience with LLM inference frameworks such as vLLM, DeepSpeed, TensorRT.
• Experience with LLM alignment techniques such as RLHF/RLAIF.
• Experience with MLOps tools and practices, including CI/CD for ML.
• Experience with Kubernetes (K8s) and Kubeflow.
• Scientific publications in the NLP field.

• Work with stakeholders to convert business requirements into technical specifications.
• Train Large Language Models (LLMs) from scratch on a large GPU cluster.
• Collect and process pre-training and fine-tuning datasets.
• Support and improve existing subsystems.

We are an equal opportunity employer welcoming everyone regardless of background, identity, religion, age, accessibility needs, or orientation.