Data engineer job description
Updated March 14, 2024
9 min read
Data engineers create data pipelines and plans that allow them to use and collate data from different sources. This allows for the operational, tactical, or analytical use of the data.
Find better candidates in less time
Post a job on Zippia and take the best from over 7 million monthly job seekers.
Example data engineer requirements on a job description
Data engineer requirements can be divided into technical requirements and required soft skills. The lists below show the most common requirements included in data engineer job postings.
Sample data engineer requirements
- Expertise in at least one programming language
- Experience in designing and implementing data pipelines
- Proficiency in SQL and database management systems
- Strong understanding of distributed systems and cloud computing
- Ability to work with big data technologies such as Hadoop, Spark, and Kafka
Sample required data engineer soft skills
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work independently and as part of a team
- Flexibility and adaptability to changing requirements and priorities
- Passion for learning and staying up-to-date with the latest technologies and trends
Data engineer job description example 1
Teleperformance USA data engineer job description
Teleperformance is a strategic partner to the world's leading companies, bringing solutions and enhancing customer experience during each interaction. We are the largest interaction expert team in the market: multicultural, highly skilled, and deeply knowledgeable, with a wide range of integrated omnichannel solutions, technology, and the highest security standards. For us, each interaction needs to be treated as unique.
Responsibilities:
- Build high quality reliable, accurate, consistent, and architecturally sounds systems that are aligned and scale with our data business needs. They may be called upon to fulfill functions related to software development, such as requirements gathering,
producing documentation, quality assurance testing and leading projects.
- Participate in design, prototype and implementation of cloud data platforms including ETL, data processing, orchestration, and related applications.
- Build and test production data pipelines from ingestion to consumption.
- Identify ways to improve data reliability, efficiency, and quality in data pipeline.
- Mentor and provide technical guidance to other engineers and analysts as needed to support and grow the team.
- Collaborate with data analysts, operational partners, and software engineers to resolve data defects, and improve data governance within the operational data store.
Qualifications:
- Azure Synapse Analytics, Azure Data Delta Lakes, Azure Data Factory, Azure Databricks, Azure Key Vault, Apache Spark 3.0, Azure SQL Database, and Power BI
- Should be proficient in writing advanced / complex SQL statements; experience with performance tuning and optimization of SQL queries.
- Ability to create functioning ETL/ELT prototypes to address quickly changing business needs.
- Previous projects should display technical leadership with an emphasis on data warehouse solutions and/or business intelligence solutions.
- Display excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
- Bachelor's degree from an accredited four-year college or university with major coursework in computer information systems, computer science, data management, information technology, information science, informatics, or work experience of equal value to formal education and 12+ years of experience.
- Must be US citizen and pass a background check
Responsibilities:
- Build high quality reliable, accurate, consistent, and architecturally sounds systems that are aligned and scale with our data business needs. They may be called upon to fulfill functions related to software development, such as requirements gathering,
producing documentation, quality assurance testing and leading projects.
- Participate in design, prototype and implementation of cloud data platforms including ETL, data processing, orchestration, and related applications.
- Build and test production data pipelines from ingestion to consumption.
- Identify ways to improve data reliability, efficiency, and quality in data pipeline.
- Mentor and provide technical guidance to other engineers and analysts as needed to support and grow the team.
- Collaborate with data analysts, operational partners, and software engineers to resolve data defects, and improve data governance within the operational data store.
Qualifications:
- Azure Synapse Analytics, Azure Data Delta Lakes, Azure Data Factory, Azure Databricks, Azure Key Vault, Apache Spark 3.0, Azure SQL Database, and Power BI
- Should be proficient in writing advanced / complex SQL statements; experience with performance tuning and optimization of SQL queries.
- Ability to create functioning ETL/ELT prototypes to address quickly changing business needs.
- Previous projects should display technical leadership with an emphasis on data warehouse solutions and/or business intelligence solutions.
- Display excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
- Bachelor's degree from an accredited four-year college or university with major coursework in computer information systems, computer science, data management, information technology, information science, informatics, or work experience of equal value to formal education and 12+ years of experience.
- Must be US citizen and pass a background check
Post a job for free, promote it for a fee
Data engineer job description example 2
CVS Health data engineer job description
Participates in the design, build and management of large scale data structures and pipelines and efficient Extract/Load/Transform (ETL) workflows.
Pay Range
The typical pay range for this role is:
Minimum: 75,000
Maximum: 167,000
Please keep in mind that this range represents the pay range for all positions in the job grade within which this position falls. The actual salary offer will take into account a wide range of factors, including location.
Required Qualifications
3+ years of ETL experience
COVID Requirements
COVID-19 Vaccination Requirement
CVS Health requires certain colleagues to be fully vaccinated against COVID-19 (including any booster shots if required), where allowable under the law, unless they are approved for a reasonable accommodation based on disability, medical condition, religious belief, or other legally recognized reasons that prevents them from being vaccinated.
You are required to have received at least one COVID-19 shot prior to your first day of employment and to provide proof of your vaccination status or apply for a reasonable accommodation within the first 10 days of your employment. Please note that in some states and roles, you may be required to provide proof of full vaccination or an approved reasonable accommodation before you can begin to actively work.
Preferred Qualifications
Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources.Ability to understand complex systems and solve challenging analytical problems.Experience with bash shell scripts, UNIX utilities & UNIX Commands.Knowledge in Java, Python, Hive, Cassandra, Pig, MySQL or NoSQL or similar.Bachelor's degree in Computer Science, Engineering, Machine Learning, or related discipline.
Education
Bachelor's degree or equivalent work experience
Business Overview
Bring your heart to CVS Health Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced human-centric health care for a rapidly changing world. Anchored in our brand - with heart at its center - our purpose sends a personal message that how we deliver our services is just as important as what we deliver. Our Heart At Work Behaviors™ support this purpose. We want everyone who works at CVS Health to feel empowered by the role they play in transforming our culture and accelerating our ability to innovate and deliver solutions to make health care more personal, convenient and affordable. We strive to promote and sustain a culture of diversity, inclusion and belonging every day. CVS Health is an affirmative action employer, and is an equal opportunity employer, as are the physician-owned businesses for which CVS Health provides management services. We do not discriminate in recruiting, hiring, promotion, or any other personnel action based on race, ethnicity, color, national origin, sex/gender, sexual orientation, gender identity or expression, religion, age, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law. We proudly support and encourage people with military experience (active, veterans, reservists and National Guard) as well as military spouses to apply for CVS Health job opportunities.
Pay Range
The typical pay range for this role is:
Minimum: 75,000
Maximum: 167,000
Please keep in mind that this range represents the pay range for all positions in the job grade within which this position falls. The actual salary offer will take into account a wide range of factors, including location.
Required Qualifications
3+ years of ETL experience
COVID Requirements
COVID-19 Vaccination Requirement
CVS Health requires certain colleagues to be fully vaccinated against COVID-19 (including any booster shots if required), where allowable under the law, unless they are approved for a reasonable accommodation based on disability, medical condition, religious belief, or other legally recognized reasons that prevents them from being vaccinated.
You are required to have received at least one COVID-19 shot prior to your first day of employment and to provide proof of your vaccination status or apply for a reasonable accommodation within the first 10 days of your employment. Please note that in some states and roles, you may be required to provide proof of full vaccination or an approved reasonable accommodation before you can begin to actively work.
Preferred Qualifications
Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources.Ability to understand complex systems and solve challenging analytical problems.Experience with bash shell scripts, UNIX utilities & UNIX Commands.Knowledge in Java, Python, Hive, Cassandra, Pig, MySQL or NoSQL or similar.Bachelor's degree in Computer Science, Engineering, Machine Learning, or related discipline.
Education
Bachelor's degree or equivalent work experience
Business Overview
Bring your heart to CVS Health Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced human-centric health care for a rapidly changing world. Anchored in our brand - with heart at its center - our purpose sends a personal message that how we deliver our services is just as important as what we deliver. Our Heart At Work Behaviors™ support this purpose. We want everyone who works at CVS Health to feel empowered by the role they play in transforming our culture and accelerating our ability to innovate and deliver solutions to make health care more personal, convenient and affordable. We strive to promote and sustain a culture of diversity, inclusion and belonging every day. CVS Health is an affirmative action employer, and is an equal opportunity employer, as are the physician-owned businesses for which CVS Health provides management services. We do not discriminate in recruiting, hiring, promotion, or any other personnel action based on race, ethnicity, color, national origin, sex/gender, sexual orientation, gender identity or expression, religion, age, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law. We proudly support and encourage people with military experience (active, veterans, reservists and National Guard) as well as military spouses to apply for CVS Health job opportunities.
Dealing with hard-to-fill positions? Let us help.
Data engineer job description example 3
General Motors data engineer job description
General Motors' Software Defined Vehicle (SDV) group unlocks a new level of potential by further integrating our vehicles with their digital world. SDV has created Ultifi, a new vehicle intelligence platform, designed to unlock new vehicle experiences. With Ultifi, we will connect with customers through software-defined features, apps and services via Over-the-Air (OTA). The new platform works by separating key software from the hardware to simplify the OTA process, enabling us to provide more robust updates and cloud-services to our customers.
Think this could be a good fit for you? Are you interested to be a part of a collaborative, driven, and bold organization that embraces innovation and challenges? If you have experience in electrical engineering, software engineering, or computer science/programming and you're ready to go all-in to deliver vehicles that evolve digitally with our customers' lives, let's connect.
GM's Canadian Technical Centre
There's never been a more exciting time to work in automotive software development and engineering. That's because our people are the driving force behind GM's vision of a world with Zero Crashes, Zero Emissions and Zero Congestion.
We're looking for new team members to help bring this vision to life through cutting-edge research and software development, innovation, testing, and engineering at GM's Canadian Technical Centre, Kapuskasing Proving Ground and McLaughlin Advanced Technology Track.
We want those who are bold, innovative, and ready to redefine the way the world moves.
Join our team today!
Core Responsibilities
Build data pipelines Manage datasets on data infrastructure platforms Develop, execute, and manage data validation tests Responsible for getting data to the platform Ensures data appears in the right format and the right systems for analysts and scientists to use
Additional Job Description
Required Skills and Experience
5+ years of experience with big data technologies (such as Azure) Experience with data pipelines (streaming and distributed storage) Programming skills (python)
Compensation and Benefits:
GM's Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs.GM's comprehensive compensation and benefits plan is carefully designed and thoroughly benchmarked against the companies that we compete for talent in the local market.
The goal of the General Motors of Canada total rewards program is to support the health and well-being of you and your family. Our comprehensive compensation plan currently includes the following benefits, in addition to many others:
Paid time off including vacation days, holidays, and supplemental benefits for pregnancy, parental and adoption leave.Healthcare, dental and vision benefits including health care spending account and wellness incentive.Life insurance plans to cover you and your family.Company and matching contributions to a Defined Contribution Pension plan to help you save for retirement.Global recognition program for peers and leaders to recognize and be recognized for results and behaviors that reflect our company values.Tuition Assistance and Employee Assistance Program. GM Vehicle Purchase Plan for you, your family and friends.
About GM
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
Why Join Us
We aspire to be the most inclusive company in the world. We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.
Diversity Information
General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities.
We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.
Equal Employment Opportunity Statement
Accommodation is available for applicants with disabilities. Should you be contacted by General Motors of Canada, please advise if you require accommodation. General Motors of Canada values diversity and is an equal opportunity employer.
Think this could be a good fit for you? Are you interested to be a part of a collaborative, driven, and bold organization that embraces innovation and challenges? If you have experience in electrical engineering, software engineering, or computer science/programming and you're ready to go all-in to deliver vehicles that evolve digitally with our customers' lives, let's connect.
GM's Canadian Technical Centre
There's never been a more exciting time to work in automotive software development and engineering. That's because our people are the driving force behind GM's vision of a world with Zero Crashes, Zero Emissions and Zero Congestion.
We're looking for new team members to help bring this vision to life through cutting-edge research and software development, innovation, testing, and engineering at GM's Canadian Technical Centre, Kapuskasing Proving Ground and McLaughlin Advanced Technology Track.
We want those who are bold, innovative, and ready to redefine the way the world moves.
Join our team today!
Core Responsibilities
Build data pipelines Manage datasets on data infrastructure platforms Develop, execute, and manage data validation tests Responsible for getting data to the platform Ensures data appears in the right format and the right systems for analysts and scientists to use
Additional Job Description
Required Skills and Experience
5+ years of experience with big data technologies (such as Azure) Experience with data pipelines (streaming and distributed storage) Programming skills (python)
Compensation and Benefits:
GM's Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs.GM's comprehensive compensation and benefits plan is carefully designed and thoroughly benchmarked against the companies that we compete for talent in the local market.
The goal of the General Motors of Canada total rewards program is to support the health and well-being of you and your family. Our comprehensive compensation plan currently includes the following benefits, in addition to many others:
Paid time off including vacation days, holidays, and supplemental benefits for pregnancy, parental and adoption leave.Healthcare, dental and vision benefits including health care spending account and wellness incentive.Life insurance plans to cover you and your family.Company and matching contributions to a Defined Contribution Pension plan to help you save for retirement.Global recognition program for peers and leaders to recognize and be recognized for results and behaviors that reflect our company values.Tuition Assistance and Employee Assistance Program. GM Vehicle Purchase Plan for you, your family and friends.
About GM
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
Why Join Us
We aspire to be the most inclusive company in the world. We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.
Diversity Information
General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities.
We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.
Equal Employment Opportunity Statement
Accommodation is available for applicants with disabilities. Should you be contacted by General Motors of Canada, please advise if you require accommodation. General Motors of Canada values diversity and is an equal opportunity employer.
Start connecting with qualified job seekers
Resources for employers posting data engineer jobs
Data engineer job description FAQs
Ready to start hiring?
Updated March 14, 2024