QA Engineer (Python / UiPath / API testing / GenAI)

O projekcie We are seeking an experienced Quality Assurance & Test Engineer with expertise in Python test automation, enterprise automation tools (UiPath), and Generative AI application testing.

In this role, you will be responsible for defining test strategies and executing automated testing across traditional software layers (UI, REST APIs, SQL databases) as well as cutting-edge AI ecosystems. You will validate LLM-powered applications, Retrieval-Augmented Generation (RAG) architectures, multi-agent workflows, and enterprise process automation solutions to ensure high performance, accuracy, and reliability.

Zakres obowiązków

• 1. AI & LLM System Validation
• Design and execute comprehensive test strategies specifically tailored for Generative AI applications, RAG frameworks, and AI-driven chatbots.
• Evaluate AI-generated outputs for factual accuracy, response consistency, grounding, and hallucination detection.
• Conduct prompt validation, toxicity/bias assessments, and decision-path testing for multi-agent workflows and human-in-the-loop systems.
• 2. Test Automation & Framework Development
• Build, enhance, and maintain scalable test automation frameworks and utility scripts using Python.
• Develop automated API test suites to validate REST endpoints, payload structures (JSON/XML), and backend data flows.
• Design and execute end-to-end automation scripts for RPA workflows using UiPath Studio and UiPath Test Suite.
• 3. API, Database & Integration Testing
• Perform rigorous API testing using Postman, Swagger, and automated Python scripts.
• Conduct backend data reconciliation and database verification using complex SQL queries to ensure data integrity across connected systems.
• Execute UI, regression, and integration testing across web and enterprise application platforms.
• 4. Defect Management & Agile Collaboration
• Partner closely with Solution Architects, Software Engineers, Data Scientists, and Product Owners within an Agile/Scrum environment.
• Log, track, and perform root-cause analysis on software defects using Jira.
• Contribute to sprint planning, test estimation, and continuous improvement of quality gates in CI/CD pipelines.

Wymagania

Core Technical Skills

• 4-8 years of hands-on experience in software quality engineering and test automation.
• Strong proficiency in Python for test automation, data validation scripting, and API testing.
• Practical experience with UiPath (UiPath Studio, UiPath Test Suite, and Orchestrator).
• Solid background in REST API testing (Postman, Swagger, JSON/XML parsing).
• Strong SQL skills for database validation, data reconciliation, and backend integrity checks.
• Proficiency with Jira for defect management and Agile workflow tools.

Desirable / GenAI Experience

• Hands-on experience testing Generative AI, LLMs, document Q&A systems, or virtual assistants.
• Familiarity with AI evaluation concepts such as prompt testing, hallucination detection, grounding verification, and agentic workflow validation.

Soft Skills

• Strong analytical mindset with a process-first approach to quality assurance.
• Excellent written and verbal communication skills in English.
• Ability to work effectively in cross-functional teams with both technical and business stakeholders.