Senior Data Scientist (Prompt Engineering)

We are seeking a Senior Data Scientist to join our dynamic AI platform team, driving innovation in generative AI and prompt engineering for document understanding and data extraction use cases.

As a fast-growing team, we aim to create cutting-edge solutions leveraging both classic machine learning techniques and cutting-edge generative models.

This role offers a hybrid model, with 3 days per week working from the client's office in Krakow (with a flexible number of hours in the office and possibility to cluster remote workdays, provided the required number of days in the office per month is fulfilled).

Responsibilities

• Design advanced prompts optimized for document understanding and data extraction
• Collaborate with business stakeholders to interpret document structures, semantics, and key-value relationships
• Create PoCs (Proofs of Concept) in Python to validate and refine prompt strategies
• Maintain a centralized prompt library with a focus on reusability and security compliance
• Validate and stress-test prompts across multiple LLMs, ensuring fail-safe designs
• Analyze and fine-tune prompts using LLM output quality measures, proposing model-specific solutions
• Partner with ML engineers for fine-tuning initiatives aimed at improving domain-specific accuracy
• Document strategies, testing outcomes, and best practices in a clear, scalable way
• Mitigate risks related to hallucinations, prompt injection, and LLM-specific vulnerabilities

Requirements

• 3+ years of experience in data science, with at least 2 in designing or deploying LLM prompts
• Expertise in Python with hands-on experience with LLM APIs, prompt engineering frameworks, and data tools like Pandas
• Background in fine-tuning techniques or RAG (retrieval-augmented generation) pipeline implementations
• Knowledge of evaluation tools and metrics such as BLEU, ROUGE, or semantic similarity for prompt assessment
• Familiarity with security concerns including prompt injection, API limitations, and LLM output structuring
• Strong problem-solving mindset and ability to deliver actionable solutions for high-impact use cases
• Proficiency in translating technical challenges into prompt architectures aligned with business needs

Nice to have

• Experience working with vector databases and retrieval-augmented generation workflows
• Familiarity with frameworks like LangChain, LlamaIndex, or similar tools
• Background in OCR, NLP, or intelligent document processing (IDP) applications

We offer

• We gather like-minded people:
  • Engineering community of industry professionals
  • Friendly team and enjoyable working environment
  • Flexible schedule and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities
• We provide growth opportunities:
  • Outstanding career roadmap
  • Leadership development, career advising, soft skills, and well-being programs
  • Certification (GCP, Azure, AWS)
  • Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
  • English classes
• We cover it all:
  • Stable income (Employment Contract or B2B)
  • Participation in the Employee Stock Purchase Plan
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
  • Referral bonuses
  • Corporate, social and well-being events
• Please, note:
  • The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.
  • We will reach out to selected candidates exclusively.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.