Post job

Data engineer jobs in Amherst, NY - 111 jobs

All
Data Engineer
Data Architect
Data Scientist
Requirements Engineer
Data Warehouse Developer
  • Learning Engineer

    Golisano Institute for Business & Entrepreneurship

    Data engineer job in Buffalo, NY

    Must be available to travel to the Rochester Campus until the Buffalo Campus becomes operational. The Learning Engineer plays a critical role in advancing the mission of Golisano Institute for Business & Entrepreneurship by supporting faculty in the design and implementation of innovative, data-driven learning experiences and integrated technology solutions that enhance teaching outcomes and operational effectiveness. This role requires strong collaboration across academic and technology teams and the ability to thrive in a fast-paced, learner-centered environment. Golisano Institute is deeply committed to fostering a culture of diversity, equity, inclusion, and belonging. We value individuals who bring varied lived experiences, perspectives, and identities, and who contribute to an inclusive environment where all members of our community feel respected, supported, and empowered to succeed. The Learning Engineer is expected to uphold these values in daily work, interactions, and decision-making. MAJOR RESPONSIBILITIES Technology design, development, and support Assist faculty in the development of their course materials with initial template course design and build support. Participate in thought leadership with respect to the current tech landscape at the Golisano Institute. Recommend new technologies that would optimize the learning experience in the future. Provide expertise in the administration of the various tools in use at the institute. Provide technical expertise with respect to the administration of learning technology including, but not limited to the LMS and educational technologies deployed in the classroom. Appropriately document common use cases for technology at the institute. Course Design, Development, and Instruction Development of innovative course content Design, document, and implement technical course content according to course outlines Responsible for the primary instruction of 1 course per quarter, as determined by the needs of Academic Affairs. Periodic instruction is a vital experience for this role. Administrative Partnerships Work in collaboration with the academic affairs leadership and the information technology leadership teams to understand the vision for instruction within the Golisano Institute and create recommendations for faculty to carry out that vision. Provide occasional data analysis and support to the institutional decision-making process. Community and Professional Development Attend and participate in required meetings, and other duties as determined. Represent the College with matters related to learning and teaching, in collaboration with Academic Affairs and other departments. Demonstrate active professional development for the advancement of the above duties. EXPERIENCE The ideal candidate will have a minimum 5 years of experience providing t echnology suppor t and development. Experience administering or providing recommendations on the administration of various learning technologies; familiarity with Canvas LMS is desired, as is willingness to learn T1V/ThinkHub collaborative software. Facility with Office 365 and Teams is desirable, or the ability to quickly learn it well enough to instruct others. Experience creating technical documentation Experience as an instructor (including K-12 education, postsecondary education, and/or innovative corporate training) Experience developing information technology solutions for educational institutions EXCEPTIONAL SKILLS / BEHAVIORAL COMPETENCIES Believes in the Institute's student-centered mission and practices of providing exceptional education Demonstrated knowledge of the current scholarship of teaching and learning, including experiential, integrative, and inclusive learning principles and strategies Effective collaborator Serve as a role model for how we teach and what we value Demonstrate emotional intelligence, contributing to a culture of belonging and trust Supportive and self-motivated team player Effective communicator Innovative and Goal-oriented; willingness to take risks and support others in doing so Creative problem solving and willingness to be a continuous learner to keep what is working and improve what is not Ability to approach “problems” as opportunities; leverage current strengths to overcome challenges Willingness to work within a fluid, emerging start-up organizational environment
    $72k-96k yearly est. 4d ago
  • Job icon imageJob icon image 2

    Looking for a job?

    Let Zippia find it for you.

  • Data Scientist

    Northrop Grumman 4.7company rating

    Data engineer job in Buffalo, NY

    At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our pioneering and inventive spirit has enabled us to be at the forefront of many technological advancements in our nation's history - from the first flight across the Atlantic Ocean, to stealth bombers, to landing on the moon. We look for people who have bold new ideas, courage and a pioneering spirit to join forces to invent the future, and have fun along the way. Our culture thrives on intellectual curiosity, cognitive diversity and bringing your whole self to work - and we have an insatiable drive to do what others think is impossible. Our employees are not only part of history, they're making history. Northrop Grumman Mission Systems is looking for you to join our team as a Data Scientist based out of Buffalo, NY. We are looking for a self-starter who can work with minimal direction, has strong oral and written communication, a strong sense of accountability and interpersonal skills, and who is able to successfully collaborate across organizations and functions to meet common objectives. The Manufacturing organization located in Buffalo, NY, tests a variety of electronic components and systems used in the development, test, validation, and training of Electronic Warfare hardware, software, and personnel to ensure the safety and success of the warfighter. What You'll get to Do: * Turn data into insight with appealing, interactive, and responsive dashboards. * Assess the effectiveness and accuracy of data sources and data gathering techniques. * Create and maintain data pipelines to operationalize data. * Forecast planning to evaluate manufacturing schedules, equipment capacities, and staffing levels. * Utilize process metrics to evaluate and improve performance, quality, and cost. * Generate metrics and capacity reports. * Translating business questions and identifying and implementing appropriate modeling or analysis techniques * Taking projects from initial concept through deployment * Creating data visualizations using common tools (Python or R libraries, Power BI, Tableau, etc.) * Utilizing interpersonal and communication skills to present complex models or analyses to business partners * Collaborating with stakeholders, teammates, and business leaders * Experience with the Microsoft Office suite. Basic Qualifications Data Scientist: * Bachelor's in a STEM-related field with 2 years of experience; Master's with 0 years of experience. * Experience with Tableau development or similar data application development. * Experience with merging large datasets from multiple sources * Experience with building/presenting different metrics and reports. * Experience with SQL (structured query language) and relational databases. * The ability to obtain/maintain an active DoD Secret Clearance. * US Citizenship Preferred Qualifications Data Scientist: * Experience with SAP and generating dashboards from reports. * Background utilizing MRP or ERP systems. * Tableau Certifications (Data Analyst, Desktop or Server) and extensive experience * Experience with software development and deployment * Experience with developing and deploying applications. * Experience managing databases, data structures, and data governance. * Experience with a graphic design background, creating user interfaces, and user-focused dashboards. * Experience with time series analysis and sequence modeling. What We Can Offer You: Northrop Grumman provides a comprehensive benefits package and a work environment that encourages your growth and supports the mutual success of our people and our company. Northrop Grumman benefits give you the flexibility and control to choose the benefits that make the most sense for you and your family. Your benefits will include the following: Health Plan, Savings Plan, Paid Time Off, and Additional Benefits, including Education Assistance, Training and Development, 9/80 Work Schedule (where available), and much more! Primary Level Salary Range: $91,800.00 - $137,600.00 The above salary range represents a general guideline; however, Northrop Grumman considers a number of factors when determining base salary offers such as the scope and responsibilities of the position and the candidate's experience, education, skills and current market conditions. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay. Annual bonuses are designed to reward individual contributions as well as allow employees to share in company results. Employees in Vice President or Director positions may be eligible for Long Term Incentives. In addition, Northrop Grumman provides a variety of benefits including health insurance coverage, life and disability insurance, savings plan, Company paid holidays and paid time off (PTO) for vacation and/or personal business. The application period for the job is estimated to be 20 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. Northrop Grumman is an Equal Opportunity Employer, making decisions without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other protected class. For our complete EEO and pay transparency statement, please visit *********************************** U.S. Citizenship is required for all positions with a government clearance and certain other restricted positions.
    $91.8k-137.6k yearly 1d ago
  • Databricks Data Engineer - Manager - Consulting - Miami

    EY 4.7company rating

    Data engineer job in Buffalo, NY

    At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. **Technology - Data and Decision Science - Data Engineering - Manager** We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills. **The opportunity:** In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Key responsibilities include: + Understanding and analyzing business requirements to translate them into technical requirements. + Designing, building, and operating scalable data architecture and modeling solutions. + Staying up to date with the latest trends and emerging technologies to maintain a competitive edge. **Key Responsibilities:** As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Your time will be spent across various responsibilities, including: + Leading workstream delivery and ensuring quality in all processes. + Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services. + Implementing resource plans and budgets while managing engagement economics. This role offers the opportunity to work in a dynamic environment where you will face challenges that require innovative solutions. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs. **Skills and attributes for success:** To thrive in this role, you should possess a blend of technical and interpersonal skills. The following attributes will make a significant impact: + Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). + Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices. + Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. + Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value. + Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance. + Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services. + Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress. + Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. + Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics. + Strong analytical and problem-solving abilities. + Excellent communication skills, with the ability to convey complex information clearly. + Proven experience in managing and delivering projects effectively. + Ability to build and manage relationships with clients and stakeholders. **To qualify for the role, you must have:** + Bachelor's degree in computer science, Engineering, or a related field required; Master's degree preferred. + Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics. + Proven expertise in Databricks and experience with Spark for big data processing. + Strong background in data architecture and design, with experience in building complex cloud analytics solutions. + Experience in leading and managing teams, with a focus on mentoring and developing talent. + Strong programming skills in languages such as Python, Scala, or SQL. + Excellent problem-solving skills and the ability to work independently and as part of a team. + Strong communication and interpersonal skills, with a focus on client management. **Required Expertise for Managerial Role:** + **Strategic Leadership:** Ability to align data engineering initiatives with organizational goals and drive strategic vision. + **Project Management:** Experience in managing multiple projects and teams, ensuring timely delivery and adherence to project scope. + **Stakeholder Engagement:** Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively. + **Change Management:** Skills in guiding clients through change processes related to data transformation and technology adoption. + **Risk Management:** Ability to identify potential risks in data projects and develop mitigation strategies. + **Technical Leadership:** Experience in leading technical discussions and making architectural decisions that impact project outcomes. + **Documentation and Reporting:** Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients. **Large-Scale Implementation Programs:** 1. **Enterprise Data Lake Implementation:** Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources (e.g., ERPs, POS systems, e-commerce platforms) to enable advanced analytics and reporting capabilities. 2. **Real-Time Analytics Platform:** Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing. 3. **Data Warehouse Modernization:** Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting. **Ideally, you'll also have:** + Experience with advanced data analytics tools and techniques. + Familiarity with machine learning concepts and applications. + Knowledge of industry trends and best practices in data engineering. + Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. + Knowledge of data governance and compliance standards. + Experience with machine learning frameworks and tools. **What we look for:** We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. If you are driven by results and have a desire to make a meaningful impact, we want to hear from you. FY26NATAID **What we offer you** At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more . + We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. + Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. + Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. **Are you ready to shape your future with confidence? Apply today.** EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. **EY | Building a better working world** EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at ************************** .
    $150.7k-261.6k yearly 53d ago
  • Data Scientist, Vegetation Ecology, Remote Sensing & Utility Management - REMOTE

    E Source 4.0company rating

    Data engineer job in Buffalo, NY

    Are you an experienced data scientist looking to join an industry-leading team? E Source develops groundbreaking data science applications that change the way utilities understand and manage their networks. We tackle challenging projects like optimizing vegetation management strategies and forecasting the impact of severe weather on utility networks. To conduct these projects, we use a combination of machine learning models, inference-based statistics, and remote-sensing applications. Each project or product is collaboratively developed in-house by a data science team of diverse professional backgrounds and domain expertise. Ultimately, our work helps utilities enhance their electric reliability and prepare to adopt and deploy cutting-edge green energy technology. A little about E Source E Source combines industry-leading research, data science, and consulting to help utilities make and implement better data-driven decisions that positively impact their customers, their bottom line, and our planet. Headquartered in Boulder, CO, we have teams across the US and Canada. Learn more at **************** How you'll help: Fit and assess predictive models leveraging geospatial data sources in R and/or Python. Explore and analyze client-provided assets and reliability data sets. Collaborate with a broader data science and engineering team to take projects and products from inception to client delivery. You'll be a full-time member of the E Source Data Science team. Our data science positions appeal to self-starters who welcome and excel in team-based, collaborative projects from conception to end-user handoff, providing an excellent customer experience throughout. The ability to simplify complex analyses into understandable concepts that are applicable to management and operations is highly desired. What will make you a great fit: Master's or PhD and multiple years with applied experience in forestry, ecology, vegetation-related remote sensing, statistics, or a similar field. Minimum three years conducting data science projects using spatial or time-series data sets in industry or applied research-analytical design, managing schedules, and communicating results to stakeholders. Extensive experience fitting and assessing predictive models using regression techniques in R and/or Python. Experience conducting all phases of analysis, including data compilation, exploratory data analysis, feature engineering, and deliverable generation (visualizations, reports, output files). Experience working as part of a larger data science team, collaborating with technical or nontechnical peers and stakeholders. Preferred qualifications: Domain expertise using regression techniques (e.g., generalized linear models, generalized linear mixed models, zero-inflated models, regression trees). Domain expertise using remotely sensed and satellite data sets. Experience using cloud computing infrastructure (e.g., Amazon Web Services) and collaboration version control (e.g., Git). Domain expertise in the utilities sector (electric, gas, water). What you can expect Excellent insurance options, including medical, dental, and vision plans; company-paid life insurance; company-paid long- and short-term disability insurance; and medical and dependent-care flexible spending plans. A flexible time off (FTO) program where you can take as many paid days off per year as they need, with manager approval, while fulfilling their work obligations and ensuring proper coverage of their responsibilities. Flexible schedules, flexible work locations, and a paid parental leave benefit. A 401(k)/RRSP plan with a 3% employer match. The budgeted salary for this position is: $95,000 to $145,000 USD + annual bonus. Actual pay will be adjusted based on experience. This role will be 100% remote, with infrequent travel (generally 1-2 times per year). Applicants must be authorized to work for any employer in the US or Canada. We're unable to sponsor or take over sponsorship of employment visas or Labour Market Impact Assessments (Cdn) at this time. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Employees of E Source are encouraged to apply. To foster a positive work environment and company culture, we support our employees in their career growth at E Source. If you are interested in similar job opportunities in the future, visit the E Source careers page for a listing of all open positions and contact Human Resources. We contact applicants directly via email using only our designated company email addresses with the domain ***************. Please do not provide personal information to anyone over email and be wary of other accounts impersonating businesses. #LI-Remote #Li-SC1
    $95k-145k yearly Easy Apply 5d ago
  • Sr. Data Engineer

    CVS Health 4.6company rating

    Data engineer job in Alabama, NY

    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care. As the nation's leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues - caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all with heart, each and every day. Position SummaryWe're seeking a Sr. Data Engineer to design and implement data pipelines that power analytical capabilities. This hands-on role requires an understanding of data engineering best practices and the ability to translate business requirements into technical solutions. You will be part of a dedicated team creating datasets for financial and analytic workloads. Key Responsibilities:Data Pipeline Development: Design and build ETL/ELT data pipelines to ingest, process, and transform large datasets from multiple sources. Performance Optimization: Implement best practices for performance tuning, partitioning, and clustering to optimize data queries and reduce costs. Data Quality & Governance: Establish and enforce data quality standards, data governance frameworks, and security policies for data storage and access. Data Modeling & Architecture: Develop and optimize data models and schemas to support analytics, reporting, and machine learning requirements. Data Integration & Transformation: Collaborate with data scientists and analysts to design data solutions that integrate with BI tools and machine learning models. Documentation & Knowledge Sharing: Create comprehensive documentation for data pipelines, workflows, and processes. Share best practices and mentor junior data engineers. Design and architect data infrastructure analytical workloads. Required Qualifications5+ years of applicable work experience Proficiency in Python, specifically with ETL pipelines. Strong proficiency in SQL and experience in developing complex queries. Familiarity with py Spark, DBT, or other similar frameworks. Experience deploying data pipelines in a cloud environment (Azure, AWS, GCP). Understanding of data warehousing concepts, dimensional modeling, and building data marts. Excellent communication and interpersonal skills, with the ability to collaborate effectively with data scientists, analysts, and product owners. Preferred QualificationsKnowledge of data governance best practices in a cloud environment. Experience with data design in BigQueryExperience working with the Epic data model. Experience working with healthcare data (Claims and Admissions) Education and ExperienceCollege degree or certification in related fields Anticipated Weekly Hours40Time TypeFull time Pay RangeThe typical pay range for this role is:$83,430. 00 - $222,480. 00This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong. Great benefits for great people We take pride in our comprehensive and competitive mix of pay and benefits - investing in the physical, emotional and financial wellness of our colleagues and their families to help them be the healthiest they can be. In addition to our competitive wages, our great benefits include:Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan. No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching. Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility. For more information, visit ************* cvshealth. com/us/en/benefits We anticipate the application window for this opening will close on: 01/27/2026Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.
    $83.4k-222.5k yearly 14d ago
  • Principal Data Scientist

    Maximus 4.3company rating

    Data engineer job in Buffalo, NY

    Description & Requirements We now have an exciting opportunity for a Principal Data Scientist to join the Maximus AI Accelerator supporting both the enterprise and our clients. We are looking for an accomplished hands-on individual contributor and team player to be a part of the AI Accelerator team. You will be responsible for architecting and optimizing scalable, secure AI systems and integrating AI models in production using MLOps best practices, ensuring systems are resilient, compliant, and efficient. This role requires strong systems thinking, problem-solving abilities, and the capacity to manage risk and change in complex environments. Success depends on cross-functional collaboration, strategic communication, and adaptability in fast-paced, evolving technology landscapes. This position will be focused on strategic company-wide initiatives but will also play a role in project delivery and capture solutioning (i.e., leaning in on existing or future projects and providing solutioning to capture new work.) This position requires occasional travel to the DC area for client meetings. U.S. citizenship is required for this position due to government contract requirements. Essential Duties and Responsibilities: - Make deep dives into the data, pulling out objective insights for business leaders. - Initiate, craft, and lead advanced analyses of operational data. - Provide a strong voice for the importance of data-driven decision making. - Provide expertise to others in data wrangling and analysis. - Convert complex data into visually appealing presentations. - Develop and deploy advanced methods to analyze operational data and derive meaningful, actionable insights for stakeholders and business development partners. - Understand the importance of automation and look to implement and initiate automated solutions where appropriate. - Initiate and take the lead on AI/ML initiatives as well as develop AI/ML code for projects. - Utilize various languages for scripting and write SQL queries. Serve as the primary point of contact for data and analytical usage across multiple projects. - Guide operational partners on product performance and solution improvement/maturity options. - Participate in intra-company data-related initiatives as well as help foster and develop relationships throughout the organization. - Learn new skills in advanced analytics/AI/ML tools, techniques, and languages. - Mentor more junior data analysts/data scientists as needed. - Apply strategic approach to lead projects from start to finish; Job-Specific Minimum Requirements: - Develop, collaborate, and advance the applied and responsible use of AI, ML and data science solutions throughout the enterprise and for our clients by finding the right fit of tools, technologies, processes, and automation to enable effective and efficient solutions for each unique situation. - Contribute and lead the creation, curation, and promotion of playbooks, best practices, lessons learned and firm intellectual capital. - Contribute to efforts across the enterprise to support the creation of solutions and real mission outcomes leveraging AI capabilities from Computer Vision, Natural Language Processing, LLMs and classical machine learning. - Contribute to the development of mathematically rigorous process improvement procedures. - Maintain current knowledge and evaluation of the AI technology landscape and emerging. developments and their applicability for use in production/operational environments. Minimum Requirements - Bachelor's degree in related field required. - 10-12 years of relevant professional experience required. Job-Specific Minimum Requirements: - 10+ years of relevant Software Development + AI / ML / DS experience. - Professional Programming experience (e.g. Python, R, etc.). - Experience in two of the following: Computer Vision, Natural Language Processing, Deep Learning, and/or Classical ML. - Experience with API programming. - Experience with Linux. - Experience with Statistics. - Experience with Classical Machine Learning. - Experience working as a contributor on a team. Preferred Skills and Qualifications: - Masters or BS in quantitative discipline (e.g. Math, Physics, Engineering, Economics, Computer Science, etc.). - Experience developing machine learning or signal processing algorithms: - Ability to leverage mathematical principles to model new and novel behaviors. - Ability to leverage statistics to identify true signals from noise or clutter. - Experience working as an individual contributor in AI. - Use of state-of-the-art technology to solve operational problems in AI and Machine Learning. - Strong knowledge of data structures, common computing infrastructures/paradigms (stand alone and cloud), and software engineering principles. - Ability to design custom solutions in the AI and Advanced Analytics sphere for customers. This includes the ability to scope customer needs, identify currently existing technologies, and develop custom software solutions to fill any gaps in available off the shelf solutions. - Ability to build reference implementations of operational AI & Advanced Analytics processing solutions. Background Investigations: - IRS MBI - Eligibility #techjobs #VeteransPage #LI-Remote EEO Statement Maximus is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, age, national origin, disability, veteran status, genetic information and other legally protected characteristics. Pay Transparency Maximus compensation is based on various factors including but not limited to job location, a candidate's education, training, experience, expected quality and quantity of work, required travel (if any), external market and internal value analysis including seniority and merit systems, as well as internal pay alignment. Annual salary is just one component of Maximus's total compensation package. Other rewards may include short- and long-term incentives as well as program-specific awards. Additionally, Maximus provides a variety of benefits to employees, including health insurance coverage, life and disability insurance, a retirement savings plan, paid holidays and paid time off. Compensation ranges may differ based on contract value but will be commensurate with job duties and relevant work experience. An applicant's salary history will not be used in determining compensation. Maximus will comply with regulatory minimum wage rates and exempt salary thresholds in all instances. Accommodations Maximus provides reasonable accommodations to individuals requiring assistance during any phase of the employment process due to a disability, medical condition, or physical or mental impairment. If you require assistance at any stage of the employment process-including accessing job postings, completing assessments, or participating in interviews,-please contact People Operations at **************************. Minimum Salary $ 156,740.00 Maximum Salary $ 234,960.00
    $85k-122k yearly est. Easy Apply 7d ago
  • Databricks Data Engineer - Senior - Consulting - Location Open

    About EY-Parthenon

    Data engineer job in Akron, NY

    At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Technology - Data and Decision Science - Data Engineering - Senior We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and communication skills, along with a proven track record of successful end-to-end implementations in data engineering projects. The opportunity In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle. Your key responsibilities As a Senior Data Engineer, you will play a pivotal role in transforming data into actionable insights. Your time will be spent on various responsibilities, including: Designing, building, and operating scalable on-premises or cloud data architecture. Analyzing business requirements and translating them into technical specifications. Optimizing data flows for target data platform designs. Design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives. Lead end-to-end data pipeline development, including data ingestion, transformation, and storage. Ensure data quality, integrity, and security throughout the data lifecycle. Provide technical guidance and mentorship to junior data engineers and team members. Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts. Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. Stay updated with the latest trends and technologies in data engineering and cloud computing. This role offers the opportunity to work with cutting-edge technologies and stay ahead of industry trends, ensuring you gain a competitive advantage in the market. The position may require regular travel to meet with external clients. Skills and attributes for success To thrive in this role, you will need a blend of technical and interpersonal skills. Your ability to communicate effectively and build relationships will be crucial. Here are some key attributes we look for: Strong analytical and decision-making skills. Proficiency in cloud computing and data architecture design. Experience in data integration and security. Ability to manage complex problem-solving scenarios. To qualify for the role, you must have A Bachelor's degree in Computer Science, Engineering, or a related field required (4-year degree). Master's degree preferred Typically, no less than 2 - 4 years relevant experience in data engineering, with a focus on cloud data solutions. 5+ years of experience in data engineering, with a focus on cloud data solutions. Expertise in Databricks and experience with Spark for big data processing. Proven experience in at least two end-to-end data engineering implementations, including: Implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence. Development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making. Strong programming skills in languages such as Python, Scala, or SQL. Experience with data modeling, ETL processes, and data warehousing concepts. Excellent problem-solving skills and the ability to work independently and as part of a team. Strong communication and interpersonal skills, with a focus on client management. Required Expertise for Senior Consulting Projects: Strategic Thinking: Ability to align data engineering solutions with business strategies and objectives. Project Management: Experience in managing multiple projects simultaneously, ensuring timely delivery and adherence to project scope. Stakeholder Engagement: Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively. Change Management: Skills in guiding clients through change processes related to data transformation and technology adoption. Risk Management: Ability to identify potential risks in data projects and develop mitigation strategies. Technical Leadership: Experience in leading technical discussions and making architectural decisions that impact project outcomes. Documentation and Reporting: Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients. Ideally, you'll also have Experience with data quality management. Familiarity with semantic layers in data architecture. Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. Knowledge of data governance and compliance standards. Experience with machine learning frameworks and tools. What we look for We seek individuals who are not only technically proficient but also possess the qualities of top performers. You should be adaptable, collaborative, and driven by a desire to achieve excellence in every project you undertake. FY26NATAID What we offer you At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more. We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $106,900 to $176,500. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $128,400 to $200,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at **************************.
    $128.4k-200.6k yearly 60d+ ago
  • Engineer, Enterprise Data Management

    Delaware North Companies 4.3company rating

    Data engineer job in Buffalo, NY

    The opportunity Delaware North is searching for a Data Engineer to join our team at our Global Headquarters in Buffalo, New York. The Data Engineering team is tasked with collecting raw data from our various systems, transforming that data into canonical models, harmonizing, and enhancing the data to provide trusted datasets to our consumers. The work this team does is the foundation of company initiatives meant to automate business processes, gather insights, and make more informed decisions. The Data Engineer will work closely with the Business to identify and specify opportunities for integration with existing systems in a highly resilient manner using Delaware North's Data Platform. Our technology stack includes Databricks (py Spark), Amazon Web Services, SQL, Python, Terraform, Django, Apache Airflow, MongoDB and Mulesoft. Pay Minimum - Anticipated Maximum Base Salary: $68,800 - $92,900 / year In addition to base salary, we offer an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. The advertised pay range represents what we believe at the time of this job posting, that we would be willing to pay for this position. Only in special circumstances, where a candidate has education, training, or experience that far exceeds the requirements for the position, would we consider paying higher than the stated range. Information on our comprehensive benefits package can be found at ******************************************** What we offer At Delaware North, we care about our team members' personal and professional journeys. These are just some of the benefits we offer: * Medical, dental, and vision insurance * 401(k) with up to 4% company match * Annual performance bonus based on level, as well as individual, company, and location performance * Paid vacation days and holidays * Paid parental bonding leave * Tuition and/or professional certification reimbursement * Generous friends-and-family discounts at many of our hotels and resorts What will you do? * Design and implement project-based solutions. * Implement data platform improvements and new features. * Assist the support team with the resolution of data platform bug fixes. * Interface with clients, vendors, and internal users of the data platform on understanding the data. * Participate in group design and architecture sessions. * Author documentation for standard operating procedures, knowledge base articles, etc. * Develop integration tests to validate solutions. * Analyze data and make recommendations to optimize current business operations. More about you * Bachelor's degree or equivalent from an accredited college or university in Computer Science, Information Systems, or similar STEM field preferred. * 2+ years' of experience developing data pipeline (ETL) processes * Extensive experience in SQL, query writing, and schema design * Experience designing and developing solutions with a modern programming language such as Python and Spark * Experience with Spark & columnar data formats (Delta/Iceberg) * Experience with data orchestration tools such as Airflow * Experience with data analytics platforms such as Databricks * Experience with data integration methodologies such as RESTful Web Services, web hooks, and data streams * Experience with Data Persistence Methods such as NoSQL and RDBMS (MSSQL, Oracle, MySQL, MongoDB) * Cloud computing experience, AWS preferred * Extensive experience with handling large data sets, high performance computing, building high performance solutions and data integration projects * Proficiency with Unix/Linux * Familiarity with data modeling and transformation techniques * Ability to effectively triage and track issues through to resolution Shift details Days Who we are Our business is all about people, and that includes you. At Delaware North, you're not just part of a team - you're part of a global legacy: a family-owned company with 100+ years of history behind it. Our operations span the world, offering you unique paths to growth and success. Who says you can't love where you work? With jobs in iconic sports arenas, stunning national parks, exciting casinos, and more, we pride ourselves on giving the world great times in great places. And whether you're interested in restaurants, hotels, sports, gaming, operations, or retail, part-time or full-time, we're invested in helping you achieve your career goals. Together, we're shaping the future of hospitality - come grow with us! Delaware North, along with its subsidiaries, is an equal opportunity employer, showcasing job opportunities and considering applicants for all positions without regard to race, color, religion, sex, gender identity, national origin, age, disability, protected veteran status, sexual orientation, or any other legally protected status.
    $68.8k-92.9k yearly 4d ago
  • Consultant, Data Engineer

    IBM Corporation 4.7company rating

    Data engineer job in Alabama, NY

    Introduction At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk. Your role and responsibilities We are in search of a skilled Consultant Data Engineer to join our expanding team of experts. This role will be pivotal in the design and development of Snowflake Data Cloud solutions, encompassing responsibilities such as constructing data ingestion pipelines, establishing sound data architecture, and implementing stringent data governance and security protocols. The ideal candidate brings experience as a proficient data pipeline builder and adept data wrangler, deriving satisfaction from optimizing data systems from their foundational stages. Collaborating closely with database architects, data analysts, and data scientists, the Data Engineer will play a crucial role in ensuring a consistent and optimal data delivery architecture across ongoing customer projects. This position demands a self-directed individual comfortable navigating the diverse data needs of multiple teams, systems, and products. If you are enthusiastic about the prospect of contributing to a startup environment and supporting our customers in their next generation of data initiatives, we invite you to explore this opportunity. As of April 2025, Hakkoda has been acquired by IBM and will be integrated in the IBM organization. Your recruitment process will be managed by IBM. IBM will be the hiring entity This role can be performed from anywhere in the US. Required education Bachelor's Degree Preferred education Bachelor's Degree Required technical and professional expertise * Bachelor's degree in engineering, computer science or equivalent area * 3+yrs in related technical roles with experience in data management, database development, ETL, and/or data prep domains. * Experience developing data warehouses. * Experience building ETL / ELT ingestion pipelines. * Proficiency in using cloud platform services for data engineering tasks, including managed database services (Snowflake and its pros and cons vs Redshift, BigQuery etc) and data processing services (AWS Glue, Azure Data Factory, Google Dataflow). * Skills in designing and implementing scalable and cost-effective solutions using cloud services, with an understanding of best practices for security and compliance. * Knowledge of how to manipulate, process and extract value from large disconnected datasets. * SQL and Python scripting experience require, Scala and Javascript is a plus. * Cloud experience (AWS, Azure or GCP) is a plus. * Knowledge of any of the following tools is also a plus: Snowflake, Matillion/Fivetran or DBT. * Strong interpersonal skills including assertiveness and ability to build strong client relationships. * Strong project management and organizational skills. * Ability to support and work with cross-functional and agile teams in a dynamic environment. * Advanced English required. ABOUT BUSINESS UNIT IBM Consulting is IBM's consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients' businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet. YOUR LIFE @ IBM In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better. Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background. Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do. Are you ready to be an IBMer? ABOUT IBM IBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world. Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business. At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world. IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status. OTHER RELEVANT JOB DETAILS IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to: * Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being * Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs * Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law * Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals * Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences We consider qualified applicants with criminal histories, consistent with applicable law. This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role. IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship. The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job-related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro-rated for those who start working during the calendar year.
    $80k-105k yearly est. 4d ago
  • Sr. Data Warehouse Developer

    Thus Far of Intensive Review

    Data engineer job in York, NY

    As a community, the University of Rochester is defined by a deep commitment to Meliora - Ever Better. Embedded in that ideal are the values we share: equity, leadership, integrity, openness, respect, and accountability. Together, we will set the highest standards for how we treat each other to ensure our community is welcoming to all and is a place where all can thrive. Job Location (Full Address): Remote Work - New York, Albany, New York, United States of America, 12224 Opening: Worker Subtype: Regular Time Type: Full time Scheduled Weekly Hours: 40 Department: 100089 University IT / C&DS Work Shift: UR - Day (United States of America) Range: UR URG 114 Compensation Range: $86,482.00 - $129,723.00 The referenced pay range represents the minimum and maximum compensation for this job. Individual annual salaries/hourly rates will be set within the job's compensation range, and will be determined by considering factors including, but not limited to, market data, education, experience, qualifications, expertise of the individual, and internal equity considerations. Responsibilities: Architects, designs, develops, implements and supports various components for the enterprise data warehouse and associated data sources. Provides support for reporting projects, as well as process and architectural recommendations. Mentors staff, demonstrates best practices, plans for business continuity and sustainability and works on projects that support Business Intelligence and Data Warehousing functions. ESSENTIAL FUNCTIONS Develops data integration and transformation processes across on premise and cloud data sources using tools, including Oracle Data Integrator, Boomi Atomsphere, Informatica, as determined by the environment. Works with the user community and reporting team to understand business data and data transformation requirements. Converts requirements to functional and technical specifications for database and integration design. Manages requests and/or components of larger projects with appropriate documentation and status reports. Develops data models and database designs that leverage knowledge of data warehouse modeling best practices. Architects data integration and transformation processes across on premise and cloud data sources. Provides leadership and serves as a subject matter expert. Collaborates with other team members using scrum processes or other project management disciplines. Follows best practices for change and code management. Provides supporting technical documentation that is well written, organized and maintained. Participates in ongoing stabilization, support and maintenance. Provides on call support as needed for business continuity and operations. Attends webinars, reads case studies and white papers, and participates in opportunities to further refine skills and stay apprised on functional area topics. Maintains current knowledge of technology, equipment, and/or systems and advises on newer technologies. Other duties as assigned. MINIMUM EDUCATION & EXPERIENCE Bachelor's degree and 5 years of relevant experience required Master's degree preferred Or equivalent combination of education and experience Multiple project experience with Data Warehousing ETL technologies and overall knowledge of Data Warehousing/Business Intelligence lifecycles required Experience with dimensional data models required Experience with integrating data warehouses with business intelligence metadata tools preferred Experience with service oriented architecture and enterprise information integration preferred Experience with the development of web services preferred Experience with Dell Boomi Atomsphere preferred Experience with Oracle Data Integrator preferred KNOWLEDGE, SKILLS AND ABILITIES Strong analytical and problem solving abilities required Ability to actively participate and collaborate on a team required Excellent written communication skills. Ability to translate functional business requirements into documented system requirements and designs required Understanding of data warehouse and agile software development processes required In depth understanding and development experience using SQL, Pl/SQL and UNIX scripting languages with SQL based databases (Oracle, DB2 or SQL Server) required Proficiency in developing data transformation packages/stored procedures required LICENSES AND CERTIFICATIONS EPIC - EPIC Certification upon hire preferred The University of Rochester is committed to fostering, cultivating, and preserving an inclusive and welcoming culture to advance the University's Mission to Learn, Discover, Heal, Create - and Make the World Ever Better. In support of our values and those of our society, the University is committed to not discriminating on the basis of age, color, disability, ethnicity, gender identity or expression, genetic information, marital status, military/veteran status, national origin, race, religion, creed, sex, sexual orientation, citizenship status, or any other characteristic protected by federal, state, or local law (Protected Characteristics). This commitment extends to non-discrimination in the administration of our policies, admissions, employment, access, and recruitment of candidates, for all persons consistent with our values and based on applicable law.
    $86.5k-129.7k yearly Auto-Apply 43d ago
  • Data Engineer

    Linde Plc 4.1company rating

    Data engineer job in Tonawanda, NY

    The Data Engineer will join the Americas IT software and architecture team. This business centric IT team allows for business-focused development of new, cutting edge, solutions as well as integrating overall global/regional IT initiatives into the business. In this role, we are seeking a talented and motivated Data Engineer with hands-on experience in Apache Spark and Microsoft Fabric to join our dynamic data engineering team. In this role, you will be at the heart of our data initiatives, designing robust data pipelines, optimizing data architectures, and enabling data-driven decision-making across the organization. The Data Engineer would be expected to work independently and/or in conjunction with appropriate business unit/IT leaders or cross-functional teams during any engagement. They would be tasked with understanding technological and business problems and focused on delivering cutting-edge solutions. The Data Engineer must possess the ability to architect or integrate the appropriate solution from the ground up based on a set of business requirements. Key Responsibilities: * Design and Develop Data Pipelines: Architect, build, and maintain scalable data pipelines leveraging Apache Spark and Microsoft Fabric to process large volumes of structured and unstructured data from diverse sources. * Data Integration: Integrate data from internal and external sources, ensuring accuracy, consistency, and reliability throughout the data lifecycle. * Performance Optimization: Monitor and optimize ETL/ELT processes for performance, scalability, and cost-efficiency, proactively identifying bottlenecks and implementing improvements. * Data Quality and Governance: Implement best practices for data quality, data cataloging, and lineage, and support governance policies to ensure compliance and high standards. * Collaboration: Work closely with data scientists, analysts, business stakeholders, and cross-functional IT teams to gather requirements, deliver insights, and support analytical models. * Documentation: Prepare and maintain detailed documentation for data workflows, pipeline architectures, data schemas, and processes. * Continuous Improvement: Stay current with emerging trends and technologies in data engineering, suggesting and implementing innovative solutions to enhance the data platform. * Troubleshooting: Diagnose, debug, and resolve data pipeline and infrastructure issues to ensure robustness and reliability of the data ecosystem. * Security: Adhere to and enforce data security and privacy guidelines, ensuring sensitive data is handled appropriately. Qualifications: Basic: * Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field. * 2 years of professional experience in data engineering, data architecture, or a related domain. * Proven experience working with Apache Spark for large-scale data processing (batch and streaming). * Hands-on expertise with Microsoft Fabric (formerly Power BI Dataflows, Data Factory within Fabric, or similar cloud-based data integration platforms). * Strong proficiency in SQL, Python, and/or Scala for data manipulation and ETL development. * Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud, with a preference for Azure. * Solid understanding of distributed systems, data warehousing, and data modeling concepts. * Demonstrated ability to design, implement, and optimize ETL/ELT workflows. * Knowledge of data governance principles and data quality management. * Excellent problem-solving skills and meticulous attention to detail. * Strong communication and teamwork abilities, with a collaborative approach to project delivery. Preferred: * Professional certifications in Apache Spark, Azure Data Engineering, or Microsoft Fabric/Power Platform. * Experience with real-time data processing and streaming frameworks (e.g., Kafka, Azure Event Hubs). * Knowledge of DevOps practices for data pipelines, including CI/CD, automated testing, and infrastructure as code. * Experience with data visualization and reporting tools (e.g., Power BI, Tableau). About Linde: Linde is a leading global industrial gases and engineering company with 2024 sales of $33 billion. We live our mission of making our world more productive every day by providing high-quality solutions, technologies and services which are making our customers more successful and helping to sustain and protect our planet. Culture: At Linde, we strive to create a work environment that treats all employees with respect, supports new thoughts and ideas, encourages growth and development, celebrates our differences, and embraces inclusion. Linde is committed to remaining an employer of choice for the diverse, ever-increasing pool of global talent. For more information about the company and its products and services, please visit ************** Salary: Pay commensurate with experience. Open to salary range $88,875 - $130,350. Benefits: Linde Gases US offers competitive compensation and an outstanding benefits package. Enjoy access to health, dental, disability, and life insurance, paid holidays and vacation, 401(k) matching, pension benefits, an employee discount program, and opportunities for educational and professional growth. Additional compensation may vary depending on the position and organizational level. Build your future with us while making an impact every day! All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, protected veteran status, pregnancy, sexual orientation, gender identity or expression, or any other reason prohibited by applicable law. #LL-PL1
    $88.9k-130.4k yearly 8d ago
  • Data Architect

    Atria Group 4.2company rating

    Data engineer job in Buffalo, NY

    We specialize in Staffing, Consulting, Software Development, and Training along with IT services to small to medium size companies. AG's primary objective is to help companies maximize their IT resources and meet the ever-changing IT needs and challenges. In addition, AG offers enterprise resource planning and enterprise application integration, supply-chain management, e-commerce solutions, and B2B public exchanges and B2B process integration solutions. Our company provides application analysis, design, development and programming, software engineering, systems development, testing, integration, and implementation, and management consulting services to various clients - including governmental agencies and private companies - throughout the United States and India. We provide these services in multiple computing environments and use technologies such as client/server architecture, object-oriented programming languages and tools, distributed database management systems, state-of-the-art networking, and communications infrastructures. Our honest and realistic approach to recruiting dictates that AG does not entice or lure engineers from their employers. We represent only high caliber technical professionals who have committed to making a change required by career. Job Description JD: Exp: 10+ Years • Requirement analysis skill • Discussion with solution architects and business SME and onsite coordinator and other stake holders • Preparing conceptual, logical, Physical data model • OLTP and OLAP data modeling skills • Hands on experience in ER Studio / Erwin • Reviewing with enterprise architects • knowledge on Data analysis, Data profiling using SQL's • Hands on experience in Teradata Additional Information GOOD COMMUNICATION SKILLS DURATION: 6 Months INTERVIEW: PHONE
    $100k-135k yearly est. 1d ago
  • Data Engineer - Cloud

    Virtusa 4.3company rating

    Data engineer job in York, NY

    Data Engineer - Google Cloud Do you want to be part of the excitement in helping companies achieve their digital transformation? At Virtusa we help organizations digitally transform at the pace and passion of a start-up with expert execution at global scale. Data Engineer - Google Cloud Job Responsibilities\: Architecting, implementing and/or maintaining technical solutions around backups, recovery, high availability and DR on Cloud (GCP preferred) Analyzing, re-architecting and re-platforming on-premises data warehouses to data platforms on GCP cloud using GCP/3rd party services. Performing detail assessments of current state data platforms and creating an appropriate transition path to GCP cloud Customer facing migration, including service discovery, assessment, planning, execution, and operations. Work Hours and Benefits\: This is a full-time role based in New York and comes with great benefits: Data Engineer - Google Cloud Qualifications and Skills\: Excellent communication, presentation, and problem-solving skills in Enterprise Customer Management Designing and deploying large scale distributed data processing systems with few technologies such as Oracle, MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra, Redis. GCP Professional Data Engineer certification Education and Experience Requirements: 6+ years direct experience working in Enterprise Data Warehouse technologies 3+ years in a customer facing role working with enterprise clients and as Solution Engineer or Architect
    $85k-115k yearly est. Auto-Apply 60d+ ago
  • Slalom Flex (Project Based)- Microsoft Power Platform Data Architect

    Slalom 4.6company rating

    Data engineer job in Buffalo, NY

    Data Architect / Microsoft Power Platform Architect (6‑Month Project) Duration: 6 months (with potential extension) Start: Immediate Employment Type: W2 About Us Slalom is a purpose-led, global business and technology consulting company. From strategy to implementation, our approach is fiercely human. In six+ countries and 43+ markets, we deeply understand our customers-and their customers-to deliver practical, end-to-end solutions that drive meaningful impact. Backed by close partnerships with over 400 leading technology providers, our 10,000+ strong team helps people and organizations dream bigger, move faster, and build better tomorrows for all. We're honored to be consistently recognized as a great place to work, including being one of Fortune's 100 Best Companies to Work For seven years running. Learn more at slalom.com. Overview We are seeking a Microsoft Power Platform Architect with strong Data Architecture expertise to support an in‑flight initiative focused on building a pricing application. This role will provide immediate capacity to an existing team of six platform developers, performing a full architectural review of the current solution and optimizing an established design spanning Power Platform (front end) and Databricks/Snowflake (backend). The ideal candidate brings hands-on experience across Power Apps, Power Automate, and modern data engineering and is comfortable stepping into a partially built solution to strengthen quality, stability, and performance. Key Responsibilities Architectural & Technical Leadership * Perform a full end‑to‑end architectural review of the existing pricing application across Power Platform, Databricks, and Snowflake. * Optimize the already-defined architecture, identifying gaps, constraints, and opportunities for improvement. * Provide expert guidance on best practices for Power Platform, data modeling, integration design, and automation patterns. Development & Optimization * Enhance and optimize Power Apps, Power Automate flows, and integrations with Databricks and Snowflake. * Implement improvements to ensure scalability, reliability, and performance of the pricing solution. * Review and refine backend data pipelines, SQL logic, and data transformations as needed. Quality Engineering & Delivery Support * Build and execute end‑to‑end testing strategies, including functional, integration, and regression testing. * Perform bug resolution and troubleshoot issues across both front-end and back-end layers. * Collaborate with the existing team of six developers to ensure smooth delivery and alignment with solution architecture. Cross‑Functional Collaboration * Work closely with product owners, developers, and data engineers to validate technical decisions. * Communicate architectural recommendations clearly to both technical and business stakeholders. * Support Agile ceremonies and sprint planning as needed. Required Skills & Experience * Power Automate (expert level) * Hands-on experience building and optimizing Power Apps * Experience managing and troubleshooting Power Platform flows * Strong understanding of Databricks and Snowflake data architecture * Ability to conduct thorough architectural reviews and produce actionable recommendations * Strong SQL skills for debugging, optimization, and backend analysis * Experience working on mid‑to‑large scale applications within the Power Platform ecosystem Preferred / Nice‑to‑Have Skills * Experience building custom connectors or plug-ins in C# * Agile delivery experience * Power BI (report development or model optimization) * Background in pricing, financial modeling, or workflow-driven applications Compensation and Benefits Slalom prides itself on helping team members thrive in their work and life. As a result, Slalom is proud to invest in benefits that include meaningful time off and paid holidays, 401(k) with a match, a range of choices for highly subsidized health, dental, & vision coverage, adoption and fertility assistance, and short/long-term disability. We also offer yearly $350 reimbursement account for any well-being-related expenses. Slalom is committed to fair and equitable compensation practices. For this position, the base salary pay range is $80/hr to $100/hr. Actual compensation will depend upon an individual's skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time. EEO and Accommodations Slalom is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans' status, or any other characteristic protected by federal, state, or local laws. Slalom will also consider qualified applications with criminal histories, consistent with legal requirements. Slalom welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process. #DMVHOT
    $80 hourly 11d ago
  • Data Architect

    Zone It Solutions

    Data engineer job in Alabama, NY

    Job Description Zone IT Solutions is in search of a highly skilled Data Architect. In this pivotal role, you will be responsible for designing, implementing, and managing our data architecture strategies to support our business objectives and enhance our data capabilities. Requirements Bachelor's or Master's degree in Computer Science, Information Systems, or related field. Minimum of 6+ years of experience in data architecture, data modeling, and data management. Strong proficiency in SQL and experience with relational databases (e.g., Oracle, SQL Server, MySQL). Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus. In-depth understanding of data integration, ETL processes, and data warehousing concepts. Proven experience in designing scalable data solutions for large datasets. Strong analytical and problem-solving skills, with the ability to work under pressure. Excellent communication and collaboration skills to work effectively with cross-functional teams. Familiarity with cloud data solutions (e.g., AWS, Azure, GCP) is preferred. Benefits About Us We specialize in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need. If you are looking for new opportunities, send your profile at *******************************. Also follow our LinkedIn page for new job opportunities and more. Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.
    $91k-124k yearly est. Easy Apply 18d ago
  • Databricks Data Engineer - Senior - Consulting - Miami

    EY 4.7company rating

    Data engineer job in Buffalo, NY

    At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. **Technology - Data and Decision Science - Data Engineering - Senior** We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and communication skills, along with a proven track record of successful end-to-end implementations in data engineering projects. **The opportunity** In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle. **Your key responsibilities** As a Senior Data Engineer, you will play a pivotal role in transforming data into actionable insights. Your time will be spent on various responsibilities, including: + Designing, building, and operating scalable on-premises or cloud data architecture. + Analyzing business requirements and translating them into technical specifications. + Optimizing data flows for target data platform designs. + Design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). + Collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives. + Lead end-to-end data pipeline development, including data ingestion, transformation, and storage. + Ensure data quality, integrity, and security throughout the data lifecycle. + Provide technical guidance and mentorship to junior data engineers and team members. + Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts. + Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. + Stay updated with the latest trends and technologies in data engineering and cloud computing. This role offers the opportunity to work with cutting-edge technologies and stay ahead of industry trends, ensuring you gain a competitive advantage in the market. The position may require regular travel to meet with external clients. **Skills and attributes for success** To thrive in this role, you will need a blend of technical and interpersonal skills. Your ability to communicate effectively and build relationships will be crucial. Here are some key attributes we look for: + Strong analytical and decision-making skills. + Proficiency in cloud computing and data architecture design. + Experience in data integration and security. + Ability to manage complex problem-solving scenarios. **To qualify for the role, you must have** + A Bachelor's degree in Computer Science, Engineering, or a related field required (4-year degree). Master's degree preferred + Typically, no less than 2 - 4 years relevant experience in data engineering, with a focus on cloud data solutions. + 5+ years of experience in data engineering, with a focus on cloud data solutions. + Expertise in Databricks and experience with Spark for big data processing. + Proven experience in at least two end-to-end data engineering implementations, including: + Implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence. + Development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making. + Strong programming skills in languages such as Python, Scala, or SQL. + Experience with data modeling, ETL processes, and data warehousing concepts. + Excellent problem-solving skills and the ability to work independently and as part of a team. + Strong communication and interpersonal skills, with a focus on client management. **Required Expertise for Senior Consulting Projects:** + **Strategic Thinking:** Ability to align data engineering solutions with business strategies and objectives. + **Project Management:** Experience in managing multiple projects simultaneously, ensuring timely delivery and adherence to project scope. + **Stakeholder Engagement:** Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively. + **Change Management:** Skills in guiding clients through change processes related to data transformation and technology adoption. + **Risk Management:** Ability to identify potential risks in data projects and develop mitigation strategies. + **Technical Leadership:** Experience in leading technical discussions and making architectural decisions that impact project outcomes. + **Documentation and Reporting:** Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients. **Ideally, you'll also have** + Experience with data quality management. + Familiarity with semantic layers in data architecture. + Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. + Knowledge of data governance and compliance standards. + Experience with machine learning frameworks and tools. **What we look for** We seek individuals who are not only technically proficient but also possess the qualities of top performers. You should be adaptable, collaborative, and driven by a desire to achieve excellence in every project you undertake. FY26NATAID **What we offer you** At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more . + We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $106,900 to $176,500. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $128,400 to $200,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. + Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. + Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. **Are you ready to shape your future with confidence? Apply today.** EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. **EY | Building a better working world** EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at ************************** .
    $128.4k-200.6k yearly 53d ago
  • Analytic Data Engineer

    CVS Health 4.6company rating

    Data engineer job in Alabama, NY

    We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time. Position Summary We're seeking a Data Engineer to design and implement data pipelines that power analytical capabilities. This hands-on role requires an understanding of data engineering best practices and the ability to translate business requirements into technical solutions. You will be part of a dedicated team creating datasets for analytic and data science workloads. You will work with other Data Engineers and Sr. Data Engineers on designing, implementing, and testing data pipelines. Your key responsibilities are:Data Pipeline Development: Design and build ETL/ELT data pipelines to ingest, process, and transform datasets from multiple sources. Performance Optimization: Implement best practices for performance tuning, partitioning, and clustering to optimize data queries. Data Quality & Governance: follow data quality standards, data governance frameworks, and security policies for data storage and access. Data Modeling & Architecture: Develop and optimize data models and schemas to support analytics, reporting, and machine learning requirements. Data Integration & Transformation: Collaborate with data scientists and analysts to design data solutions that integrate with BI tools and machine learning models Documentation & Knowledge Sharing: Create comprehensive documentation for data pipelines, workflows, and processes. Required Qualifications2+ years of applicable work experience Proficiency in Python, specifically with ETL pipelines Strong proficiency in SQL and experience in developing complex queries Experience deploying data pipelines in a cloud environment (any of Azure, AWS, GCP) Excellent communication and interpersonal skills, with the ability to collaborate effectively with data scientists and analysts. Preferred QualificationsExperience working with healthcare data, especially Epic. Experience using GCP's BigQueryKnowledge of data governance best practices in a cloud environment. Experience working with Machine Learning processes. EducationCollege degree or certification in related fields Anticipated Weekly Hours40Time TypeFull time Pay RangeThe typical pay range for this role is:$64,890. 00 - $173,040. 00This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong. Great benefits for great people We take pride in our comprehensive and competitive mix of pay and benefits - investing in the physical, emotional and financial wellness of our colleagues and their families to help them be the healthiest they can be. In addition to our competitive wages, our great benefits include:Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan. No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching. Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility. For more information, visit ************* cvshealth. com/us/en/benefits We anticipate the application window for this opening will close on: 02/06/2026Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.
    $64.9k-173k yearly 18d ago
  • Consultant, Data Engineer

    IBM 4.7company rating

    Data engineer job in Buffalo, NY

    **Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk. **Your role and responsibilities** We are in search of a skilled Consultant Data Engineer to join our expanding team of experts. This role will be pivotal in the design and development of Snowflake Data Cloud solutions, encompassing responsibilities such as constructing data ingestion pipelines, establishing sound data architecture, and implementing stringent data governance and security protocols. The ideal candidate brings experience as a proficient data pipeline builder and adept data wrangler, deriving satisfaction from optimizing data systems from their foundational stages. Collaborating closely with database architects, data analysts, and data scientists, the Data Engineer will play a crucial role in ensuring a consistent and optimal data delivery architecture across ongoing customer projects. This position demands a self-directed individual comfortable navigating the diverse data needs of multiple teams, systems, and products. If you are enthusiastic about the prospect of contributing to a startup environment and supporting our customers in their next generation of data initiatives, we invite you to explore this opportunity. As of April 2025, Hakkoda has been acquired by IBM and will be integrated in the IBM organization. Your recruitment process will be managed by IBM. IBM will be the hiring entity This role can be performed from anywhere in the US. **Required technical and professional expertise** * Bachelor's degree in engineering, computer science or equivalent area * 3+yrs in related technical roles with experience in data management, database development, ETL, and/or data prep domains. * Experience developing data warehouses. * Experience building ETL / ELT ingestion pipelines. * Proficiency in using cloud platform services for data engineering tasks, including managed database services (Snowflake and its pros and cons vs Redshift, BigQuery etc) and data processing services (AWS Glue, Azure Data Factory, Google Dataflow). * Skills in designing and implementing scalable and cost-effective solutions using cloud services, with an understanding of best practices for security and compliance. * Knowledge of how to manipulate, process and extract value from large disconnected datasets. * SQL and Python scripting experience require, Scala and Javascript is a plus. * Cloud experience (AWS, Azure or GCP) is a plus. * Knowledge of any of the following tools is also a plus: Snowflake, Matillion/Fivetran or DBT. * Strong interpersonal skills including assertiveness and ability to build strong client relationships. * Strong project management and organizational skills. * Ability to support and work with cross-functional and agile teams in a dynamic environment. * Advanced English required. IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
    $80k-105k yearly est. 18d ago
  • Data Engineer - Pega

    Virtusa 4.3company rating

    Data engineer job in York, NY

    Do you want to be part of the excitement in helping companies achieve their digital transformation? At Virtusa we help organizations digitally transform at the pace and passion of a start-up with expert execution at global scale. Data Engineer - Pega Job Responsibilities\: Identifying, developing and documenting repeatable design and implementation methodologies based on functional requirements using Pega. Define, develop, document, and maintain governance for use of Pega. Be well versed with Pega concepts and technology roadmap. Critical contributor in Pega roadmap. Collaborate in a cross-functional team environment to ensure corporate-wide settings/configurations are aligned with business requirements. Suggest alternatives to custom solutions to render Pega out of the box solutions. Creating user acceptance testing and performance testing plans to validate and support the customizations, features and functionalities. Work Hours and Benefits\: This is a full-time role based in New York and comes with great benefits: Data Engineer - Pega Qualifications and Skills\: Excellent communication, presentation, and problem-solving skills in Enterprise Customer Management Designing and deploying large scale distributed data processing systems with few technologies such as Oracle, MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra, Redis. GCP Professional Data Engineer certification Education and Experience Requirements: Pega Senior Systems Architect Certification. 6+ years of Pega experience in building and implementing model-driven, enterprise-level business solutions and applications 4+ years of Pega experience in Pega Decisioning and Pega Marketing skills 3+ years in a customer facing role working with enterprise clients and as Solution Engineer or Architect
    $85k-115k yearly est. Auto-Apply 60d+ ago
  • Databricks Data Engineer - Manager - Consulting - Location Open

    About EY-Parthenon

    Data engineer job in Akron, NY

    At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Technology - Data and Decision Science - Data Engineering - Manager We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills. The opportunity: In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Key responsibilities include: Understanding and analyzing business requirements to translate them into technical requirements. Designing, building, and operating scalable data architecture and modeling solutions. Staying up to date with the latest trends and emerging technologies to maintain a competitive edge. Key Responsibilities: As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Your time will be spent across various responsibilities, including: Leading workstream delivery and ensuring quality in all processes. Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services. Implementing resource plans and budgets while managing engagement economics. This role offers the opportunity to work in a dynamic environment where you will face challenges that require innovative solutions. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs. Skills and attributes for success: To thrive in this role, you should possess a blend of technical and interpersonal skills. The following attributes will make a significant impact: Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices. Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value. Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance. Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services. Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress. Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics. Strong analytical and problem-solving abilities. Excellent communication skills, with the ability to convey complex information clearly. Proven experience in managing and delivering projects effectively. Ability to build and manage relationships with clients and stakeholders. To qualify for the role, you must have: Bachelor's degree in computer science, Engineering, or a related field required; Master's degree preferred. Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics. Proven expertise in Databricks and experience with Spark for big data processing. Strong background in data architecture and design, with experience in building complex cloud analytics solutions. Experience in leading and managing teams, with a focus on mentoring and developing talent. Strong programming skills in languages such as Python, Scala, or SQL. Excellent problem-solving skills and the ability to work independently and as part of a team. Strong communication and interpersonal skills, with a focus on client management. Required Expertise for Managerial Role: Strategic Leadership: Ability to align data engineering initiatives with organizational goals and drive strategic vision. Project Management: Experience in managing multiple projects and teams, ensuring timely delivery and adherence to project scope. Stakeholder Engagement: Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively. Change Management: Skills in guiding clients through change processes related to data transformation and technology adoption. Risk Management: Ability to identify potential risks in data projects and develop mitigation strategies. Technical Leadership: Experience in leading technical discussions and making architectural decisions that impact project outcomes. Documentation and Reporting: Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients. Large-Scale Implementation Programs: Enterprise Data Lake Implementation: Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources (e.g., ERPs, POS systems, e-commerce platforms) to enable advanced analytics and reporting capabilities. Real-Time Analytics Platform: Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing. Data Warehouse Modernization: Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting. Ideally, you'll also have: Experience with advanced data analytics tools and techniques. Familiarity with machine learning concepts and applications. Knowledge of industry trends and best practices in data engineering. Familiarity with cloud platforms (AWS, Azure, GCP) and their data services. Knowledge of data governance and compliance standards. Experience with machine learning frameworks and tools. What we look for: We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. If you are driven by results and have a desire to make a meaningful impact, we want to hear from you. FY26NATAID What we offer you At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more. We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at **************************.
    $89k-120k yearly est. 60d+ ago

Learn more about data engineer jobs

How much does a data engineer earn in Amherst, NY?

The average data engineer in Amherst, NY earns between $77,000 and $137,000 annually. This compares to the national average data engineer range of $80,000 to $149,000.

Average data engineer salary in Amherst, NY

$103,000

What are the biggest employers of Data Engineers in Amherst, NY?

The biggest employers of Data Engineers in Amherst, NY are:
  1. Linde
Job type you want
Full Time
Part Time
Internship
Temporary