Data Scientist (Honey Team)

Tasks in the role

• Using internal datasets and Semrush products, create a dataset to test the criteria, select the criteria, and conduct experiments to assess their impact on Semrush tools

• Evaluating the quality of the generated text: for various tasks, it is necessary to assess how well the generated text will meet the user's needs

Who we are looking for

• 5+ years of experience as a DS / MLE

• Strong understanding of the principles of machine learning algorithms, probability theory, statistics, and linear algebra

• High proficiency in Python and ML stack

• Strong practical experience building LLM-based systems

• Knowledge of SQL

Not required, but a plus

• Practical knowledge of RAG and building AI agents

• Experience deploying and maintaining LLM-based solutions in production

• Experience with GitLab CI

• Experience with GCP and Vertex AI

• Experience in deploying ML systems with batch/real-time processing and monitoring (Grafana, Prometheus, Alertmanager)

• Reproducible research

About the team

We are a Data Science team primarily focused on LLM- and NLP-related tasks applied to Content Marketing and AI Search optimization. Our team includes one Data Science Manager and three Senior Data Scientists. We work closely with product and engineering teams to implement our solutions.

Our stack:

• Language: Python

• Google Cloud Platform

• Data Storage: ClickHouse, PostgreSQL

• Tools: ClearML, Docker, LangFuse

• LLM APIs: OpenAI, Google, Anthropic

Examples of our projects:

• Content Generation Quality Measurement – a system of metrics and algorithms designed to evaluate the quality of generated content, both in terms of linguistic quality and optimization for SEO and AI Search.

• Brand Extraction – a model that extracts brand names and other relevant entities from LLM-generated responses.

We will try to create all the right conditions for you to work and rest comfortably

• Flexible working hours

• Unlimited PTO

• Flexi Benefit for your hobby

• Employee Support Program

• Loss of family member financial aid

• Employee Resource Groups 

• Meals, snacks, and drinks at the office

• Corporate events

• Teambuilding

• Training, courses, conferences