Senior QA Engineer - AI-Native Platform
Город:
Тбилиси
Занятость:
Полная занятость
Компания "SL KG"
We are a global OSINT company headquartered in the US, empowering investigators and security professionals with cutting-edge AI-powered products. Our technology collects and analyzes massive volumes of data from open sources, including social media, messengers, and the dark web, to create a comprehensive picture for data-driven investigations and decision-making.
Our customers include S&P 500 companies and law enforcement agencies in 80+ countries worldwide. Social Links is scaling rapidly, growing 2x annually, with the ambition of becoming a unicorn valued at $1B+.
We are looking for a hands-on Senior QA Engineer building test infrastructure and evaluation frameworks from scratch for a distributed AI platform. Primary focus: testing non-deterministic AI agent outputs, RAG pipeline quality, multi-tenant data isolation, and cross-service integration.
Your Tasks Will Be:
- Build and maintain AI evaluation framework
- Test RAG pipeline quality and retrieval relevance
- Design testing approaches for non-deterministic LLM outputs
- Build multi-tenant isolation test suite, including AI layer isolation
- Write cross-service integration and contract tests
- Test Temporal workflows, event-driven flows, and YAML DSL validation
- Build and maintain automated regression suites
Our Ideal Candidate Has:
- 3+ years in QA automation / SDET
- Hands-on experience testing AI/ML systems
- Strong Python (pytest, async testing)
- Experience building test infrastructure from scratch
- Experience testing distributed or event-driven systems
- Experience testing multi-tenant applications
- Autonomous work style
- English – B1 level or higher
Nice To Haves:
- RAG / vector search quality evaluation
- LangGraph, LangChain, or similar agent frameworks
- Go test automation
- BentoML / MLflow or equivalent MLOps tooling
- Security testing: prompt injection, context leakage
- Performance / load testing for ML inference endpoints
- Data pipeline testing (Delta Lake, Great Expectations, Dagster)
- Russian – advanced level or higher
What We Offer:
- Remote-first setup: work from anywhere in the world
- Work on a greenfield, technically challenging product (distributed system at scale)
- Direct collaboration with senior technical stakeholders (engineering leadership, product)
- Ownership and impact: influence QA strategy, tooling, and quality gates from the early stage of the product
- Fast iteration environment: work closely with engineering to improve reliability and release confidence
We are an equal-opportunity employer and are committed to fostering a diverse and inclusive environment for all candidates.
02 Июля
Системный аналитик (Middle/Senior)( STARTRIBE LTD )
Тбилиси
Компания "STARTRIBE LTD" Международная компания, которая разрабатывает надёжные и актуальные IT-решения для b2c и b2b сегмента в индустрии...
02 Июля
Тбилиси
Компания "Andersen" Andersen is hiring an AI Engineer / LLM Engineer for a project developing AI-powered digital banking solutions and...
02 Июля
Батуми
Компания "Andersen" Andersen is an international IT company and one of the leaders in outsourcing software development. We create digital...
02 Июля
Тбилиси
Компания "Andersen" International company Andersen, one of the leaders in the outsource production market, is recruiting for Test Engineer...
02 Июля
QA Automation Trainee( Andersen )
Тбилиси
Компания "Andersen" Andersen is an international IT company and one of the leaders in outsourcing software development. We create digital...
Вакансия размещена в отрасли