Skip to content
TransPerfect

QA Engineer | Barcelona

Barcelona, Catalunya [Cataluña], SpainHybrid · Spain
fulltime_permanent · QA Testing
POSTED 16 NOVVERIFIED 36M AGO
Apply Ask
Role
0 days opentrue age
Closes in ~126d at the median (126d)
Posted 16 Nov · n=24
Pay
€52k–€54kno pay posted
Market p25–p75
€52k–€54k
Barcelona · n=3 · 365d to 10 Nov
CompanyTransPerfect →
728open roles
Opened · 30d
+49
Closed · 30d
−19
11d of snapshots · 30d window
Market
3,001open · QA / Test
Opened · 7d
+30610% of open
All qa / test
5,584open
All tracked boards · live 16 Nov · n=3,001
JavaC#/.NETAzureSQLLLMsTesting

TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.

The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.

As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.

This position offers

A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions

Ownership of test automation and opportunities to influence product quality and release readiness

Collaboration with distributed product, development, and release teams

Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows

Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices

Requirements

Your responsibilities will include

Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications

Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks

Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality

Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria

Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed

Validate data integrity, access control, error handling, usability, and compatibility across supported environments

Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings

Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions

Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements

Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed

Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs

Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats

Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone

Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts

Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies

Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency

Communication

Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders

Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups

Required skills and experience

Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience

Professional experience in software quality engineering with both manual and automated testing

Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks

Programming proficiency in C#, Java, or a comparable language used for test automation

Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior

Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira

Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results

Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results

Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation

Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively

Desired skills and experience

Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features

Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs

Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling

Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization

Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation

Professional working knowledge of an additional language, especially for multilingual product testing

Ability to work across time zones and understand complex business workflows

By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting

Source · TransPerfectFirst seen 16 NovOriginal ↗