Prompt Engineer in JetBrains AI

At JetBrains, code is our passion. Ever since we started back in 2000, we have been striving to make the world’s most robust and effective developer tools. By automating routine checks and corrections, our tools speed up production, freeing developers to grow, discover, and create. We are working on an ambitious new platform that provides AI capabilities to all JetBrains products. Our platform is based on models for writing and coding assistance that we developed in-house, as well as integration with modern LLMs such as those from OpenAI and Google. We are looking for a passionate Prompt Engineer with a diverse set of skills who can contribute to AI feature development across products. You’ll be designing better prompts, finding ways to improve existing ones, coming up with creative ways to measure prompt quality, and ensuring quality does not degrade over time.

We value engineers who:

• Are highly enthusiastic about AI and Large Language Models and proactively follow advancements in this field.
• Plan their work and make decisions independently, consulting with others if needed.
• Identify customer needs and prioritize their tasks accordingly.
• Take sole responsibility for the entire subsystem.

In this role, you will:

• Craft prompts and use the latest techniques to find the best solution for each particular use case.
• Contribute to the creation of infrastructure and processes for Prompt Engineering.
• Develop tools and systems to support prompt engineering workflows, including setting up automated evaluations to ensure continuous development.
• Come up with creative solutions to prompt improvements and evaluations.

We’ll be happy to have you on our team if you have:

• Previous experience in either Evaluation or Quality Assurance.
• Practical Python language skills.
• Advanced English language skills.
• A detail-oriented mindset in everything you do.

We’d be especially thrilled if you have:

• Experience designing ML/AI features and integrating them into products.
• Knowledge of evaluation techniques and frameworks.
• Experience with CI or automation and orchestration systems.

To develop JetBrains AI, we use:

• Git for source code management.
• Python for prompt crafting and evaluation.
• Kotlin backend as a serving platform for AI features.
• TeamCity for orchestration.