About this opportunity
Career Category
Manufacturing
Job Description
Role Description:
Let’s do this. Let’s change the world. We are looking for a highly motivated expert Data Engineer to design and develop advanced data pipelines and solutions for our Manufacturing Applications Product Team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics for Manufacturing and Operations use cases. This role requires deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.
Roles & Responsibilities
Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets.
Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains.
Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments.
Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms.
Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring.
Innovate, explore, and implement new tools and technologies to enhance efficient data processing.
Proactively identify and implement opportunities to automate tasks and develop reusable frameworks.
Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value.
Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories.
Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle.
Collaborate and communicate effectively with product teams and cross-functional teams to understand business requirements and translate them into technical solutions.
Must-Have Skills
Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies.
Proficiency in workflow orchestration and performance tuning on big data processing.
Strong understanding of AWS services.
Ability to quickly learn, adapt, and apply new technologies.
Strong problem-solving and analytical skills.
Excellent communication and teamwork skills.
Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices.
Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration.
Good-to-Have Skills
Experience with AI assisted code development using tools like GitHub Copilot, Cursor, Claude Code.
Data engineering experience in biotechnology or pharma industry.
Experience in writing APIs to make data available to consumers.
Experience with SQL/NoSQL databases, vector databases for large language models.
Experience with data modeling and performance tuning for both OLAP and OLTP databases.
Experience with software engineering best practices, including version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven, etc.), automated unit testing, and DevOps.
Experience with manufacturing related data sources like SCADA, Data Historians is a plus
Education and Professional Certifications
• Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience
• AWS Certified Data Engineer preferred
• Databricks Certificate preferred
• Scaled Agile SAFe certification preferred
Soft Skills
Excellent analytical and troubleshooting skills.
Strong verbal and written communication skills.
Ability to work effectively with global, virtual teams.
High degree of initiative and self-motivation.
Ability to manage multiple priorities successfully.
Team-oriented, with a focus on achieving team goals.
Ability to learn quickly, be organized, and detail-oriented.
Strong presentation and public speaking skills.
.
Job details
How this role compares
Computed from every other active Data & Digital role in our database, not just this employer's listings.
We currently track 894 comparable Data & Digital roles across 82 biopharma companies.
Salary context
280 of 894 peers report a salary range (USD, annualized)
Peers share this role's job function. This posting doesn't list a seniority level, so peers aren't narrowed by seniority either -- the range below may span more levels than usual.
Where these roles are based
Top locations among the 894 comparable roles
+ 36 more countries
Seniority mix
580 of 894 peers have a known seniority level
Therapeutic area mix
31 of 894 peers have a known therapeutic area; the rest are genuinely unlabeled, not hidden
Similar opportunities
The closest matches from our peer group, ranked by how similar they are, not how well you'd qualify for them -- treat this as market context, not a guaranteed shortlist; a weak match is labeled as one below.
Notify me about similar jobs
Get an email when we spot other openings like this one – same job function, comparable seniority, roles you'd actually want to see.
Or follow a whole field: get every new Data & Digital job in India, and choose locations and companies.
How we calculate "similar"
No black box, no LLM guesswork: a deterministic score built from four normalized attributes. Here's this role's own peer group at different match levels, so you can see the mechanism, not just the result.
Every comparison starts from the same 100-point budget: 25 for working in the same function, 40 for the same therapeutic area, 20 for the same or adjacent seniority, 15 for the same country. A dimension we can't confirm on both sides contributes nothing, never a guess, never a free pass.
0 points, never a partial guess. A role we know almost nothing about beyond its function bottoms out at 25%; it never inflates to 100% just because there's little to compare against. Seniority uses a defined ladder (Associate → Manager → Associate Director → Senior → Principal → Director → Senior Director → Executive/VP) so "Director" and "Senior Director" count as adjacent, but "Director" and "Executive/VP" do not.