Sr Engineer – GenAI Quality Assurance
About this opportunity
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com .
As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.
Job Function:
R&D Product Development
Job Sub Function:
R&D Machine Learning
Job Category:
Scientific/Technology
All Job Posting Locations:
Cornellà de Llobregat, Barcelona, Spain, Madrid, Spain
Job Description:
Johnson & Johnson Innovative Medicine R&D Data Science and Digital Health is recruiting for a Senior Engineer – GenAI Quality Assurance. This role can be based in Madrid or Barcelona. Hybrid working.
J&J Innovative Medicine develops treatments that improve the health of people worldwide. Research and development areas encompass oncology, immunology, neuroscience, cardiopulmonary and specialty ophthalmology. Our goal is to help people live longer, healthier lives. We have produced and marketed many first-in-class prescription medications and are poised to serve the broad needs of the healthcare market – from patients to practitioners and from clinics to hospitals. To learn more about Johnson & Johnson Innovative Medicine visit https://innovativemedicine.jnj.com/
Description: We’re hiring a professional who specializes in designing, testing, and refining complex GenAI applications, primarily in scientific or ML-driven environments. You'll be responsible for validating, stress-testing, and improving Gen-AI powered products (pipelines and AI-assisted workflows) across the product lifecycle – from pre-deployment validation to post-release monitoring.
Key Responsibilities:
Design and implement automated and manual QA strategies for GenAI systems
Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy, grounding, robustness, safety
Validate prompt logic, model behavior and evaluation metrics
Execute tests and debug pipelines
Support deployment of GenAI products
Lead system design reviews, advocating best practices for architecture and reliability of GenAI applications
Collaborate closely with data scientists and developers to embed testing and quality checkpoints
Establish testing standards and workflows for continuous integration and deployment
Conduct code reviews with a focus on design, testability, and maintainability
Document system design decisions, test cases, and best practices
Close collaboration with domain experts and stakeholders to validate developed solutions
Technical Skills & Experience Needed:
Strong software engineering background with QA ownership
Familiarity with RAG & Graph frameworks
3+ years of experience as a software engineer (preferably 5), or QA engineer in production systems, preferably including at least 1 year experience in GenAI systems
Advanced Python skills
Experience working with LLM-based systems in real environments
Hands-on experience with:
LLM APIs AWS Bedrock (Anthropic & OSS)
Azure Foundry (OpenAI)
GCP (Gemini)
Cloud platforms (AWS, Azure, GCP)
Proven ability to implement test frameworks for GenAI applications
Knowledge of API testing, data validation, and data pipeline testing
Experience with version control (Git)
Experience with building and deploying AI/ML products through the full product lifecycle
Good understanding of scientific computing and ML frameworks
Solid understanding of safety, bias, and failure modes of GenAI systems
Comfortable working in a relatively fast-moving environment where priorities may shift and initiative is valued
Proactive problem-solver who can anticipate needs and find solutions
Comfortable working independently, but also a strong team player
Nice-to-Have:
Experience with Jenkins, Sonarqube
Monitoring and observability tools (Prometheus, Grafana etc)
Devops experience (docker, jenkins)
Experience deploying GenAI services to production at scale
Exposure to ML Ops or production ML systems
#LI-GR
#LI-Hybrid
#JRDDS
#JNJDataScience
#JRD
Required Skills:
Large Language Models (LLMs), Microsoft Foundry, OpenAI, Python (Programming Language), Software Quality Assurance (SQA)
Preferred Skills:
Artificial Intelligence (AI), Coaching, Cognitive Computing, Critical Thinking, Cross-Functional Collaboration, Curious Mindset, Data Structures, Distributed Computing, Emerging Technologies, Human-Computer Relationships, Machine Learning (ML), Persistence and Tenacity, Program Management, Research and Development, SAP Product Lifecycle Management, Scripting Languages, Technologically Savvy
Job details
How this role compares
Computed from every other active Quality role in our database, not just this employer's listings.
We currently track 195 comparable Senior Quality roles across 49 biopharma companies.
Salary context
59 of 195 peers report a salary range (USD, annualized)
Peers share this role's job function and a matching or adjacent seniority level -- not necessarily the same therapeutic area or country.
Where these roles are based
Top locations among the 195 comparable roles
+ 21 more countries
Seniority mix
195 of 195 peers have a known seniority level
Therapeutic area mix
0 of 195 peers have a known therapeutic area; the rest are genuinely unlabeled, not hidden
No peers with a known therapeutic area yet.
Similar opportunities
The closest matches from our peer group, ranked by how similar they are, not how well you'd qualify for them -- treat this as market context, not a guaranteed shortlist; a weak match is labeled as one below.
Notify me about similar jobs
Get an email when we spot other openings like this one – same job function, comparable seniority, roles you'd actually want to see.
How we calculate "similar"
No black box, no LLM guesswork: a deterministic score built from four normalized attributes. Here's this role's own peer group at different match levels, so you can see the mechanism, not just the result.
Every comparison starts from the same 100-point budget: 25 for working in the same function, 40 for the same therapeutic area, 20 for the same or adjacent seniority, 15 for the same country. A dimension we can't confirm on both sides contributes nothing, never a guess, never a free pass.
0 points, never a partial guess. A role we know almost nothing about beyond its function bottoms out at 25%; it never inflates to 100% just because there's little to compare against. Seniority uses a defined ladder (Associate → Manager → Associate Director → Senior → Principal → Director → Senior Director → Executive/VP) so "Director" and "Senior Director" count as adjacent, but "Director" and "Executive/VP" do not.