Prompt Engineer (Healthcare)

About us

Talkie builds AI Agents for healthcare. Our agents handle patient-clinic communication end-to-end - voice calls, web chat, and SMS - so patients get 24/7 access to care and busy practices never miss a conversation. Every month, our AI Agents handle close to a million real patient conversations across the US and Poland. Trusted by primary care, specialty practices, and hospitals.

The Role

We're looking for a Prompt Engineer to own the quality and intelligence of our AI Agents - from prompt design to production. This is a high-impact role at the intersection of language, technology, and healthcare. Your work will directly shape how hundreds of thousands of patients experience care.

This is not a research role. You'll be writing, testing, and iterating prompts that run live with real patients - so rigour, empathy, and a zero-error mindset matter as much as technical skill.

What You'll Do

• Work closely with the Product Manager (US market), engineering, and client teams to ensure agent quality across all deployments.
• Design, write, and continuously optimise prompts that power our AI Agents - making them natural, accurate, and reliable.
• Analyse real patient-agent conversations end-to-end, identifying failure patterns, edge cases, and opportunities to improve agent behaviour.
• Propose and implement technical solutions around function calling, tool use, context caching, and other LLM capabilities that make our agents smarter.
• Build and run evaluation frameworks to test agent performance before and after changes - because every conversation is with a real patient and there is zero margin for error.
• Create clear, structured documentation and customisation instructions so that agents can be tailored to each client’s specific workflows and needs.
• Stay on top of the rapidly evolving LLM landscape - new models, techniques, and conventions - and bring the best ideas back to the team.

What will you achieve with us?

• Shape the experience that hundreds of thousands of patients have when they reach out to their doctor - across every channel - and make it better every single day.
• Push the boundaries of what LLM-powered AI agents can do in a highly regulated, real-world, multi-channel environment.
• Build evaluation and quality systems for conversational AI that don’t exist yet - you’ll be creating the playbook.
• Have a direct, measurable impact on patient access to healthcare in both the US.

Job requirements

This is a young and fast-moving field. We care less about years of experience and more about how you think, learn, and work.

Must have

• LLM Experience - Hands-on experience writing and iterating on prompts for production systems. More importantly, you learn fast - this field changes weekly and you keep up.
• Analytical Rigour - Ability to review conversations, extract failure patterns, and turn findings into concrete, measurable improvements.
• Communication & Collaboration - Comfort on client calls and working across technical and non-technical teams; you translate clearly in both directions. This is not a “sit in a cave and prompt all day” role ;).
• Proactivity - You spot problems before being asked, flag them, and come with a proposed fix.
• Zero-Error Mindset - Our agents talk to real patients. You understand the responsibility and bring the precision and care it demands.
• English - C1+ English, strong written communication. Our agents talk to US patients.
• Shifted Hours - You are available to work 12:00-20:00 CET at least 3 days per week (optimally 5) to overlap with US Eastern Time business hours.

Nice to have

• Function Calling & Tool Use - Experience with LLM tool-use patterns, structured outputs, and API integrations.
• Evaluation Frameworks- Familiarity with eval tools - Braintrust, DeepEval, LangSmith, or custom pipelines.
• Multi-Channel Experience - Understanding of voice AI nuances: latency, turn-taking, TTS/ASR - and how they differ from chat or SMS.
• Healthcare Background - Prior work in healthcare, health-tech, or regulated industries where accuracy and compliance are non-negotiable.
• Genuine Curiosity - You read release notes. You experiment with new models. You show up on Monday with fresh ideas.

Your goals as a Conversational AI Specialist

Short term - first 3 months

• Develop a deep understanding of our AI Agent architecture, prompt patterns, client configurations, for our US market product.
• Audit existing agent conversations, identify the top quality issues, and implement prompt improvements with measurable impact.
• Take ownership of the agent testing and evaluation process - establish baselines and a repeatable QA workflow.
• Get up to speed on our tooling (Langfuse, ClickUp, internal platforms) and the team’s ways of working.

Longer term - first 12 months

• Own the end-to-end prompt and agent quality lifecycle across our US deployments.
• Build and maintain a structured evaluation framework that catches regressions before they reach patients.
• Develop comprehensive customisation documentation that enables scalable client onboarding.
• Become the team’s go-to expert on LLM capabilities, staying ahead of model releases and new techniques.
• Contribute to shaping our product roadmap with insights from conversation analysis and agent performance data.

What we offer

• Competitive pay with benefits: employment contract or B2B contract.
• A role with real purpose - we’re changing how patients access healthcare in the US.
• Flexible working arrangements - remote, office, or hybrid.
• Work equipment - Mac laptop, monitors, keyboard, mouse, and a setup for both office and home (including a comfy chair).
• Benefits: private medical care, Multisport card, annual offsite, training budget.
• Unique company culture based on mutual trust, honest feedback, and autonomy.
• Working with cutting-edge AI technology on a product that’s genuinely useful to real people.
• A structured onboarding process to help you find your feet.

What are we like as a company?

We are friendly, direct, and driven by curiosity and ambition. We value a growth mindset and see failure as a learning opportunity. Our culture is built on inquiry and critical thinking - asking questions is encouraged and thorough investigation is standard. We’re proactive problem-solvers who don’t shy away from challenges. When something’s broken, we acknowledge it, propose solutions, and fix it. And yes - we love to have fun too. Dancing till early hours, karaoke nights... we’ve got a long tradition of good times at Talkie!

Our recruitment process

Reflecting our culture, our recruitment process is respectful and collaborative. We aim to create a welcoming environment where you can be yourself and get to know us better. The entire process typically takes 2-3 weeks.

What to expect

• Initial Contact - we'll reach out by email or phone if your application is a fit.
• First Interview (1h online) - mutual fit and getting to know each other.
• Second Interview (1.5h online) - practical, hands-on case study/task
• Reference Check - We’ll ask for references and verify them.
• Offer - We’ll make an offer or share detailed feedback.