Post job

Data Engineer jobs at NLB Services - 23086 jobs

  • Machine Learning Engineer - Backend/Data Engineer: Agentic Workflows

    Apple Inc. 4.8company rating

    Sunnyvale, CA jobs

    We design, build and maintain infrastructure to support agentic workflows for Siri. Our team is in charge of data generation, introspection and evaluation frameworks that are key to efficiently developing foundation models and agentic workflows for Siri applications. In this team you will have the opportunity to work at the intersection of with cutting edge foundation models and products. Minimum Qualifications Strong background in computer science: algorithms, data structures and system design 3+ year experience on large scale distributed system design, operation and optimization Experience with SQL/NoSQL database technologies, data warehouse frameworks like BigQuery/Snowflake/RedShift/Iceberg and data pipeline frameworks like GCP Dataflow/Apache Beam/Spark/Kafka Experience processing data for ML applications at scale Excellent interpersonal skills able to work independently as well as cross-functionally Preferred Qualifications Experience fine-tuning and evaluating Large Language Models Experience with Vector Databases Experience deploying and serving of LLMs At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . #J-18808-Ljbffr
    $147.4k-272.1k yearly 1d ago
  • Job icon imageJob icon image 2

    Looking for a job?

    Let Zippia find it for you.

  • Senior Workday Data Consultant & Applications Lead

    Capgemini 4.5company rating

    San Francisco, CA jobs

    A leading consulting firm in San Francisco seeks a Senior Applications Consultant specializing in Workday Data Conversion. The ideal candidate will be certified in Workday HCM and have significant experience with data conversion processes. Responsibilities include translating business needs into technical designs, managing issues, and leading testing efforts. Candidates must possess a Bachelor's degree and a minimum of 6 years of experience, with at least 2 in a relevant role. This position requires valid US work authorization. #J-18808-Ljbffr
    $101k-134k yearly est. 2d ago
  • Senior Applications Consultant - Workday Data Consultant

    Capgemini 4.5company rating

    San Francisco, CA jobs

    Job Description - Senior Applications Consultant - Workday Data Consultant (054374) Senior Applications Consultant - Workday Data Consultant Qualifications & Experience: Certified in Workday HCM Experience in Workday data conversion At least one implementation as a data consultant Ability to work with clients on data conversion requirements and load data into Workday tenants Flexible to work across delivery landscape including Agile Applications Development, Support, and Deployment Valid US work authorization (no visa sponsorship required) 6‑8 years overall experience (minimum 2 years relevant), Bachelor's degree SE Level 1 certification; pursuing Level 2 Experience in package configuration, business analysis, architecture knowledge, technical solution design, vendor management Responsibilities: Translate business cases into detailed technical designs Manage operational and technical issues, translating blueprints into requirements and specifications Lead integration testing and user acceptance testing Act as stream lead guiding team members Participate as an active member within technology communities Capgemini is an Equal Opportunity Employer encouraging diversity and providing accommodations for disabilities. All qualified applicants will receive consideration without regard to race, national origin, gender identity or expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status, or any other characteristic protected by law. Physical, mental, or environmental demands may be referenced. Reasonable accommodations will be considered where possible. #J-18808-Ljbffr
    $101k-134k yearly est. 2d ago
  • Health Data Engineer

    Booz Allen Hamilton Inc. 4.9company rating

    Atlanta, GA jobs

    The Opportunity: As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you to help our clients find answers in their big data to impact important missions. As a Health Data Engineer at Booz Allen, you'll use your skills and experience to implement data engineering activities on some of the most mission-driven projects in the healthcare management, delivery, research, and public health space. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration and data examination while you support the assessment, design, development, and maintenance of scalable platforms for your clients. Join us. The world can't wait. You Have: * 3+ years of experience designing, developing, operationalizing, and maintaining complex data applications at enterprise scale * 3+ years of experience creating software for retrieving, parsing, and processing structured and unstructured data * 2+ years of experience with distributed data and computing tools, including Databricks, PySpark, and Spark * Ability to develop scripts and programs for converting various types of data into usable formats and support project team to scale, monitor, and operate data platforms * Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements * Bachelor's degree Nice If You Have: * Experience with application development using SQL or Scala * Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud * Experience working on real-time data and streaming applications * Experience with NoSQL implementation using MongoDB or Cassandra * Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake * Experience with UNIX and Linux, including basic commands and Shell scripting * Experience with Agile engineering practices Vetting: Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client. Compensation At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date. Identity Statement As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud. Work Model Our people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely. * If this position is listed as remote or hybrid, you'll periodically work from a Booz Allen or client site facility. * If this position is listed as onsite, you'll work with colleagues and clients in person, as needed for the specific role. Commitment to Non-Discrimination All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.
    $77.6k-176k yearly 2d ago
  • Aviation Data Engineer

    Booz Allen Hamilton Inc. 4.9company rating

    Washington, DC jobs

    The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence. As a data engineer at Booz Allen, you'll use your skills and experience to help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration and data examination while you support the assessment, design, developing, and maintenance of scalable platforms for your clients. Work with us to use data for good. Join us. The world can't wait. You Have: * 2+ years of experience in application development using Databricks, PySpark * 2+ years of experience utilizing programming languages, including C++, Java, or Python * 2+ years of experience developing and maintaining scalable data stores that supply big data in forms needed for business analysis * Experience with aviation, geospatial, and weather datasets * Experience creating software for retrieving, parsing, and processing structured and unstructured data * Experience with developing scalable ETL/ELT workflows for reporting and analytics * Experience creating solutions within a collaborative, cross-functional team environment * Ability to develop scripts and programs for converting various types of data into usable formats and support the project team to scale, monitor, and operate data platforms * Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements * Bachelor's degree Nice If You Have: * Experience in application development utilizing SQL or Scala * Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud * Experience working on real-time data and streaming applications * Experience with NoSQL implementation using MongoDB or Cassandra * Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake * Experience with UNIX/Linux, including basic commands and Shell scripting * Experience with Agile engineering practices Vetting: Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client. Compensation At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $62,000.00 to $141,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date. Identity Statement As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud. Work Model Our people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely. * If this position is listed as remote or hybrid, you'll periodically work from a Booz Allen or client site facility. * If this position is listed as onsite, you'll work with colleagues and clients in person, as needed for the specific role. Commitment to Non-Discrimination All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.
    $62k-141k yearly 3d ago
  • Healthcare Data Scientist/Engineer

    CGI Technologies and Solutions, Inc. 4.5company rating

    Houston, TX jobs

    **Category:** Analytics and Emerging Digital Technologies **Alternate Location(s):** United States, Georgia, Atlanta United States, North Carolina, Charlotte United States, Texas, Houston United States, Texas, Dallas United States, Illinois, Chicago **Position ID:** J0126-0520 **Employment Type:** Full Time **Position Description:** CGI is seeking a versatile Healthcare Data Scientist/Engineer to join our team supporting CGI PulseAI for Healthcare delivery. This role is critical in bridging the gap between raw healthcare data and actionable insights. You will be responsible for designing and maintaining robust data pipelines while developing predictive models and analytics that improve health outcomes and operational efficiency. This role will work on a hybrid basis out of any location within the United States local to a CGI office. **Your future duties and responsibilities:** Data Engineering: Design, build, and maintain scalable ETL/ELT pipelines to ingest healthcare data (Claims, EMR/EHR, Pharmacy, and Lab results). Model Development: Develop and deploy machine learning models for risk stratification, disease prediction, and utilization management. Healthcare Interoperability: Work with healthcare data standards, including FHIR, HL7, and ICD-10/CPT coding. Data Quality: Ensure the integrity and security of Protected Health Information (PHI) in compliance with HIPAA regulations. Collaboration: Work closely with clinical staff and business stakeholders to translate complex data into clear, visual stories and strategic recommendations. **Required qualifications to be successful in this role:** Education: Master's or Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. Experience: Minimum of 3 years of experience in a data-centric role, specifically within the healthcare or health insurance industry. Technical Stack: * Languages: Proficiency in Python (Pandas, Scikit-learn, PySpark) and advanced SQL. Cloud: Experience with cloud platforms (AWS, Azure, or GCP) and big data tools (Databricks, Snowflake). Orchestration: Experience with Airflow, Databricks, and version control (Git). Domain Knowledge: Deep understanding of healthcare revenue cycles, payer operations, or clinical informatics. Preferred Skills Experience with Natural Language Processing (NLP) for unstructured clinical notes. Familiarity with Visualization tools like Tableau or PowerBI. Knowledge of Medical Claims lifecycle and Quality Measures (HEDIS/STARS). Pay Transparency & Benefits Anticipated Salary Range (Colorado & Remote): $89,600.00 - $188,100.00 USD Actual compensation will be determined based on factors such as geographical location, skills, experience, and education. Benefits: At CGI, we offer a comprehensive benefits package including: Competitive base salary and profit participation (bonus). Share Purchase Plan with employer match. Health, dental, and vision insurance. 401(k) retirement plan with company match. Flexible paid time off and paid holidays. Application Deadline: Applications for this role are accepted on an ongoing basis. We anticipate the initial application window to close by February 28, 2026. **Skills:** + Cloud Computing + Health Care Payers + Python + SQL **What you can expect from us:** **Together, as owners, let's turn meaningful insights into action.** Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because... You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction. Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team-one of the largest IT and business consulting services firms in the world. Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business. CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_****************** . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. **Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.** We make it easy to translate military experience and skills! Clickhere (*************************** to be directed to our site that is dedicated to veterans and transitioning service members. All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances. CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.
    $89.6k-188.1k yearly 6d ago
  • Healthcare Data Scientist/Engineer

    CGI Technologies and Solutions, Inc. 4.5company rating

    Atlanta, GA jobs

    **Category:** Analytics and Emerging Digital Technologies **Alternate Location(s):** United States, Georgia, Atlanta United States, North Carolina, Charlotte United States, Texas, Houston United States, Texas, Dallas United States, Illinois, Chicago **Position ID:** J0126-0520 **Employment Type:** Full Time **Position Description:** CGI is seeking a versatile Healthcare Data Scientist/Engineer to join our team supporting CGI PulseAI for Healthcare delivery. This role is critical in bridging the gap between raw healthcare data and actionable insights. You will be responsible for designing and maintaining robust data pipelines while developing predictive models and analytics that improve health outcomes and operational efficiency. This role will work on a hybrid basis out of any location within the United States local to a CGI office. **Your future duties and responsibilities:** Data Engineering: Design, build, and maintain scalable ETL/ELT pipelines to ingest healthcare data (Claims, EMR/EHR, Pharmacy, and Lab results). Model Development: Develop and deploy machine learning models for risk stratification, disease prediction, and utilization management. Healthcare Interoperability: Work with healthcare data standards, including FHIR, HL7, and ICD-10/CPT coding. Data Quality: Ensure the integrity and security of Protected Health Information (PHI) in compliance with HIPAA regulations. Collaboration: Work closely with clinical staff and business stakeholders to translate complex data into clear, visual stories and strategic recommendations. **Required qualifications to be successful in this role:** Education: Master's or Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. Experience: Minimum of 3 years of experience in a data-centric role, specifically within the healthcare or health insurance industry. Technical Stack: * Languages: Proficiency in Python (Pandas, Scikit-learn, PySpark) and advanced SQL. Cloud: Experience with cloud platforms (AWS, Azure, or GCP) and big data tools (Databricks, Snowflake). Orchestration: Experience with Airflow, Databricks, and version control (Git). Domain Knowledge: Deep understanding of healthcare revenue cycles, payer operations, or clinical informatics. Preferred Skills Experience with Natural Language Processing (NLP) for unstructured clinical notes. Familiarity with Visualization tools like Tableau or PowerBI. Knowledge of Medical Claims lifecycle and Quality Measures (HEDIS/STARS). Pay Transparency & Benefits Anticipated Salary Range (Colorado & Remote): $89,600.00 - $188,100.00 USD Actual compensation will be determined based on factors such as geographical location, skills, experience, and education. Benefits: At CGI, we offer a comprehensive benefits package including: Competitive base salary and profit participation (bonus). Share Purchase Plan with employer match. Health, dental, and vision insurance. 401(k) retirement plan with company match. Flexible paid time off and paid holidays. Application Deadline: Applications for this role are accepted on an ongoing basis. We anticipate the initial application window to close by February 28, 2026. **Skills:** + Cloud Computing + Health Care Payers + Python + SQL **What you can expect from us:** **Together, as owners, let's turn meaningful insights into action.** Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because... You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction. Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team-one of the largest IT and business consulting services firms in the world. Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business. CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_****************** . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. **Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.** We make it easy to translate military experience and skills! Clickhere (*************************** to be directed to our site that is dedicated to veterans and transitioning service members. All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances. CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.
    $89.6k-188.1k yearly 6d ago
  • Delivery Consultant - Data Engineer, Data and Machine Learning, WWPS US Federal

    Amazon 4.7company rating

    Herndon, VA jobs

    The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business objectives. You'll be a key player in driving customer success through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Delivery Consultant you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather requirements, assess current infrastructure, and propose effective migration strategies to AWS. As trusted advisors to our customers, providing guidance on industry trends, emerging technologies, and innovative solutions, you will be responsible for leading the implementation process, ensuring adherence to best practices, optimizing performance, and managing risks throughout the project. The AWS Professional Services organization is a global team of experts that help customers realize their desired business outcomes when using the AWS Cloud. We work together with customer teams and the AWS Partner Network (APN) to execute enterprise cloud computing initiatives. Our team provides assistance through a collection of offerings which help customers achieve specific outcomes related to enterprise cloud adoption. We also deliver focused guidance through our global specialty practices, which cover a variety of solutions, technologies, and industries. It is expected to work from one of the above locations (or customer sites) Monday through Friday each week. This is not a remote position. You are expected to be in the office or with customers as needed. This position requires that the candidate selected be a US Citizen and must currently possess and maintain an active TS/SCI security clearance with polygraph. The position further requires the candidate to opt into a commensurate clearance for each government agency for which they perform AWS work. 10040 Key job responsibilities As an experienced technology professional, you will be responsible for: - Designing and implementing complex, scalable, and secure AWS solutions tailored to customer needs - Providing technical guidance and troubleshooting support throughout project delivery - Collaborating with stakeholders to gather requirements and propose effective migration strategies - Acting as a trusted advisor to customers on industry trends and emerging technologies - Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts About the team Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Inclusive Team Culture Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud. Mentorship & Career Growth We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Basic Qualifications - Bachelor's degree in Computer Science, Engineering, a related technical field or equivalent - 3+ years of cloud architecture and solution implementation experience - 3+ years of experience with data warehouse architecture, ETL/ELT tools, data engineering, and large-scale data manipulation using technologies like Spark, EMR, Hive, Kafka, and Redshift. - Experience with relational databases, SQL, and performance tuning, as well as software engineering best practices for the development lifecycle, including coding standards, reviews, source control, and testing. - Current, active US Government Security Clearance of TS/SCI with Polygraph. Preferred Qualifications - AWS Professional level certifications (e.g., Solutions Architect Professional, DevOps Engineer Professional) preferred. - Experience with automation and scripting (e.g., Terraform, Python). - Knowledge of security and compliance standards (e.g., HIPAA, GDPR). - Experience leading large-scale data engineering and analytics projects using AWS technologies like Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda. - Experience with non-relational databases and implementing data governance solutions. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit ********************************************************* for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,200/year in our lowest geographic market up to $204,300/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit ******************************************************* . This position will remain posted until filled. Applicants should apply via our internal or external career site.
    $118.2k-204.3k yearly 3d ago
  • Delivery Consultant - Data Engineer, Data and Machine Learning, WWPS US Federal

    Amazon 4.7company rating

    Arlington, VA jobs

    The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business objectives. You'll be a key player in driving customer success through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Delivery Consultant you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather requirements, assess current infrastructure, and propose effective migration strategies to AWS. As trusted advisors to our customers, providing guidance on industry trends, emerging technologies, and innovative solutions, you will be responsible for leading the implementation process, ensuring adherence to best practices, optimizing performance, and managing risks throughout the project. The AWS Professional Services organization is a global team of experts that help customers realize their desired business outcomes when using the AWS Cloud. We work together with customer teams and the AWS Partner Network (APN) to execute enterprise cloud computing initiatives. Our team provides assistance through a collection of offerings which help customers achieve specific outcomes related to enterprise cloud adoption. We also deliver focused guidance through our global specialty practices, which cover a variety of solutions, technologies, and industries. It is expected to work from one of the above locations (or customer sites) Monday through Friday each week. This is not a remote position. You are expected to be in the office or with customers as needed. This position requires that the candidate selected be a US Citizen and must currently possess and maintain an active TS/SCI security clearance with polygraph. The position further requires the candidate to opt into a commensurate clearance for each government agency for which they perform AWS work. 10040 Key job responsibilities As an experienced technology professional, you will be responsible for: - Designing and implementing complex, scalable, and secure AWS solutions tailored to customer needs - Providing technical guidance and troubleshooting support throughout project delivery - Collaborating with stakeholders to gather requirements and propose effective migration strategies - Acting as a trusted advisor to customers on industry trends and emerging technologies - Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts About the team Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Inclusive Team Culture Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud. Mentorship & Career Growth We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Basic Qualifications - Bachelor's degree in Computer Science, Engineering, a related technical field or equivalent - 3+ years of cloud architecture and solution implementation experience - 3+ years of experience with data warehouse architecture, ETL/ELT tools, data engineering, and large-scale data manipulation using technologies like Spark, EMR, Hive, Kafka, and Redshift. - Experience with relational databases, SQL, and performance tuning, as well as software engineering best practices for the development lifecycle, including coding standards, reviews, source control, and testing. - Current, active US Government Security Clearance of TS/SCI with Polygraph. Preferred Qualifications - AWS Professional level certifications (e.g., Solutions Architect Professional, DevOps Engineer Professional) preferred. - Experience with automation and scripting (e.g., Terraform, Python). - Knowledge of security and compliance standards (e.g., HIPAA, GDPR). - Experience leading large-scale data engineering and analytics projects using AWS technologies like Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda. - Experience with non-relational databases and implementing data governance solutions. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit ********************************************************* for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,200/year in our lowest geographic market up to $204,300/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit ******************************************************* . This position will remain posted until filled. Applicants should apply via our internal or external career site.
    $118.2k-204.3k yearly 3d ago
  • Delivery Consultant - Data Engineer, Data and Machine Learning, WWPS US Federal

    Amazon.com, Inc. 4.7company rating

    Arlington, VA jobs

    The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business objectives. You'll be a key player in driving customer success through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Delivery Consultant you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather requirements, assess current infrastructure, and propose effective migration strategies to AWS. As trusted advisors to our customers, providing guidance on industry trends, emerging technologies, and innovative solutions, you will be responsible for leading the implementation process, ensuring adherence to best practices, optimizing performance, and managing risks throughout the project. The AWS Professional Services organization is a global team of experts that help customers realize their desired business outcomes when using the AWS Cloud. We work together with customer teams and the AWS Partner Network (APN) to execute enterprise cloud computing initiatives. Our team provides assistance through a collection of offerings which help customers achieve specific outcomes related to enterprise cloud adoption. We also deliver focused guidance through our global specialty practices, which cover a variety of solutions, technologies, and industries. It is expected to work from one of the above locations (or customer sites) Monday through Friday each week. This is not a remote position. You are expected to be in the office or with customers as needed. This position requires that the candidate selected be a US Citizen and must currently possess and maintain an active TS/SCI security clearance with polygraph. The position further requires the candidate to opt into a commensurate clearance for each government agency for which they perform AWS work. 10040 Key job responsibilities As an experienced technology professional, you will be responsible for: Designing and implementing complex, scalable, and secure AWS solutions tailored to customer needs Providing technical guidance and troubleshooting support throughout project delivery Collaborating with stakeholders to gather requirements and propose effective migration strategies Acting as a trusted advisor to customers on industry trends and emerging technologies Sharing knowledge within the organization through mentoring, training, and creating reusable artifacts About the team Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Inclusive Team Culture Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud. Mentorship & Career Growth We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Basic Qualifications Bachelor's degree in Computer Science, Engineering, a related technical field or equivalent 3+ years of cloud architecture and solution implementation experience 3+ years of experience with data warehouse architecture, ETL/ELT tools, data engineering, and large-scale data manipulation using technologies like Spark, EMR, Hive, Kafka, and Redshift. Experience with relational databases, SQL, and performance tuning, as well as software engineering best practices for the development lifecycle, including coding standards, reviews, source control, and testing. Current, active US Government Security Clearance of TS/SCI with Polygraph. Preferred Qualifications AWS Professional level certifications (e.g., Solutions Architect Professional, DevOps Engineer Professional) preferred. Experience with automation and scripting (e.g., Terraform, Python). Knowledge of security and compliance standards (e.g., HIPAA, GDPR). Experience leading large-scale data engineering and analytics projects using AWS technologies like Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda. Experience with non-relational databases and implementing data governance solutions. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit ********************************************************* for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,200/year in our lowest geographic market up to $204,300/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit ******************************************************** This position will remain posted until filled. Applicants should apply via our internal or external career site.
    $118.2k-204.3k yearly 3d ago
  • Foundry Data Engineer: ETL Automation & Dashboards

    Data Freelance Hub 4.5company rating

    San Francisco, CA jobs

    A data consulting firm based in San Francisco is seeking a Palantir Foundry Consultant for a contract position. The ideal candidate should have strong experience in Palantir Foundry, SQL, and PySpark, with proven skills in data pipeline development and ETL automation. Responsibilities include building data pipelines, implementing interactive dashboards, and leveraging data analysis for actionable insights. This on-site role offers an excellent opportunity for those experienced in the field. #J-18808-Ljbffr
    $114k-160k yearly est. 4d ago
  • Data Gov -Unity Catalog Platform Engineer

    Capgemini 4.5company rating

    Seattle, WA jobs

    Job Title:Data Gov -Unity Catalog Platform Engineer (Optimize distributed workspaces in Databricks leveraging Unity Catalog.) Hiring Urgency: Immediate Requirement Company: Capgemini Employment Type: Full-Time- Hybrid Summary: Capgemini is urgently seeking a Data Governance to enterprise-level metadata and data access initiatives. The ideal candidate will have deep expertise in Collibra, Databricks, Unity Catalog, and Privacera, and will drive strategic alignment across technical and business teams. This role is open to relocation and offers the opportunity to shape scalable, secure data ecosystems. Your Role Metadata Management & Design and implement enterprise metadata models in Collibra aligned with business goals. Integrate metadata workflows with Unity Catalog and Synaptica for enhanced discoverability. Data Access Governance Implement and govern secure data access using Privacera. Optimize distributed workspaces in Databricks leveraging Unity Catalog. Standards & Best Practices Define standards for efficient use of Databricks environments. Champion metadata governance and utilization across teams. Strategic Leadership Develop transition architecture roadmaps with clear milestones and success metrics. Align cross-functional stakeholders around a unified data discovery vision. Foster collaboration and clarity in complex, ambiguous environments. Innovation & Thought Leadership Promote innovative solutions in ontology, data access, and discovery. Serve as both a strategic leader and hands-on contributor. Your skills and experience: Extensive hands-on experience with Databricks, Collibra, Unity Catalog, and Privacera. Proven success in implementing distributed Databricks workspaces. Strong background in metadata modeling, data architecture, and enterprise-scale data discovery. Familiarity with data governance frameworks and compliance standards. Skills & Technologies: Collibra Data Governance Metadata Management Databricks Unity Catalog Privacera Synaptica Information Technology Life at Capgemini Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: Flexible work Healthcare including dental, vision, mental health, and well-being programs Financial well-being programs such as 401(k) and Employee Share Ownership Plan Paid time off and paid holidays Paid parental leave Family building benefits like adoption assistance, surrogacy, and cryopreservation Social well-being benefits like subsidized back-up child/elder care and tutoring Mentoring, coaching and learning programs Employee Resource Groups Disaster Relief
    $94k-127k yearly est. 3d ago
  • Lead Snowflake Data Engineer

    Anblicks 4.5company rating

    Dallas, TX jobs

    Key Responsibilities Lead the end-to-end architecture and implementation of Snowflake(Bronze/Silver/Gold layers). Partner with business and data stakeholders to translate requirements into canonical models, ontologies, and data products. Define and enforce data modeling standards, naming conventions, and domain-driven design principles. Guide teams on data ingestion patterns, transformation frameworks (e.g., dbt), and performance optimization in Snowflake. Integrate data management capabilities including Data Quality using SODA, Data Governance, Metadata Management, and Data Observability. Ensure platform scalability, security, cost optimization, and compliance with enterprise standards. Provide technical leadership and mentorship to data engineers and modelers. Act as a key contributor in roadmap planning, technical decision-making, and stakeholder communication. Required Skills & Experience 10+ years of experience in data engineering and platform architecture, with at least 3+ years in a lead role. Strong hands-on experience with Snowflake (performance tuning, clustering, security, cost optimization). Hands-on experience with cloud platforms (AWS, Azure, or GCP) Understanding with Data Domains (Client, Finance etc.) Deep understanding of data modeling (dimensional, canonical, domain-driven). Experience designing or working with ontology / semantic layers (business vocabularies, relationships, metrics). Strong knowledge of modern data stack tools (dbt, orchestration, CI/CD for data). Experience implementing Data Quality, Data Governance, Metadata, and Data Observability solutions. Experience with orchestration tools such as: Apache Airflow, Prefect, or Luigi. Solid SQL skills and strong understanding of ELT patterns. Ability to lead cross-functional teams and communicate complex concepts to both technical and non-technical stakeholders. Nice to Have Experience with knowledge graphs, semantic models, or graph technologies. Exposure to enterprise data platforms supporting multiple domains and global users. Background in cloud-native architectures and large-scale data modernization programs.
    $75k-102k yearly est. 6d ago
  • Data Scientist II

    Pyramid Consulting, Inc. 4.1company rating

    Cambridge, MA jobs

    Immediate need for a talented Data Scientist II. This is a 11+ Months Contract opportunity with long-term potential and is located in Cambridge, MA (Onsite). Please review the job description below and contact me ASAP if you are interested. Job ID:25-96101 Pay Range: $66 - $72/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Leverage Bioinformatics, System Biology, Statistics and Machine Learning methods to analyze high-throughput omics datasets, with a specific focus on novel target and biomarker discovery in Neuroscience. Lead computational analyses and data integration projects involving genomic, transcriptomic, proteomic, and other multi-omics data. Provide high-quality data analysis and timely support for target and biomarker discovery projects supporting the organization's growing Neuroscience portfolio. Keep up to date with the latest bioinformatics analysis methods, software, and databases, integrating new methodologies into existing frameworks to enhance data analysis capabilities. Work with experimental biologists, functional area experts, and clinical scientists to support drug discovery and development programs at various stages. Provide computational biology /data science input in research strategy and experimental design, provide bioinformatics input, and assist in interpreting results from both in-vitro and in-vivo studies. Communicate study results effectively to the project team and wider scientific community through written and verbal means, including proposals for further experiments, presentations at internal and external meetings, and publications in leading journals. Key Requirements and Technology Experience: Must have skills: - ["bioinformatics / computational biology ", " Multi-omics data analysis", “Machine Learning & Statistical modeling”, " Biological data integration”, “Python and/or R”, “HPC or cloud computing environments”, “Git / GitHub”] Demonstrated expertise in bioinformatics, computational biology, machine learning, multi-omics data analysis, biological data integration and interpretation. Extensive and demonstrated experience in the computational analysis of multi-modal and multi-scale (e.g. single cell, spatial) molecular profiles of patient-derived samples. Proficient in one or more programming languages (e.g., Python, R) and competent with HPC environments and/or cloud-based platforms. Experience with version control systems, such as Git (e.g., Github). Good working knowledge of public and proprietary bioinformatics databases, resources and tools. Familiarity with public repositories of DNA, RNA, protein, single-cell and spatial profiling data. Ability to critically evaluate scientific research and apply novel informatics methods in translational applications. Strong problem-solving skills, self-motivated, attention to detail, and ability to handle multiple projects. Proven ability to conduct research individually and collaboratively. Proven track record of contributions to peer-reviewed publications in the field of bioinformatics or computational biology. Excellent communication skills (written, presentation, and oral). PhD. in Computational Biology, Bioinformatics, Biostatistics, Computer Science, or a related discipline with a minimum of 2 years of academic or industry experience. MSc in Computational Biology, Bioinformatics, Biostatistics, Computer Science, or a related discipline, with a minimum of 5 years of academic or industry experience. Experience in analyzing neuroscience datasets and working knowledge of neuroscience, especially neurodegenerative diseases. In-depth understanding of drug target and biomarker identification in an industry setting Our client is a leading Pharmaceutical Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
    $66-72 hourly 2d ago
  • Data Scientist Gen AI

    EXL 4.5company rating

    Atlanta, GA jobs

    Job Title: Data Scientist - GenAI Work Experience: 5+ Years On-site requirement: 4 days per week at Atlanta office We are looking for a highly capable and innovative Data Scientist with experience in Generative AI to join our Data Science Team. You will lead the development and deployment of GenAI solutions, including LLM-based applications, prompt engineering, fine-tuning, embeddings, and retrieval-augmented generation (RAG) for enterprise use cases. The ideal candidate has a strong foundation in machine learning and NLP, with hands-on experience in modern GenAI tools and frameworks such as OpenAI, LangChain, Hugging Face, Vertex AI, Bedrock, or similar. Key Responsibilities: Design and build Generative AI solutions using Large Language Models (LLMs) for business problems across domains like customer service, document automation, summarization, and knowledge retrieval. Fine-tune or adapt foundation models using domain-specific data. Implement RAG pipelines, embedding models, vector databases (e.g., FAISS, Pinecone, ChromaDB). Collaborate with data engineers, MLOps, and product teams to build end-to-end AI applications and APIs. Develop custom prompts and prompt chains using tools like LangChain, LlamaIndex, PromptFlow, or custom frameworks. Evaluate model performance, mitigate bias, and optimize accuracy, latency, and cost. Stay up to date with the latest trends in LLMs, transformers, and GenAI architecture. Required Skills: 5+ years of experience in Data Science / ML, with 1+ year hands-on in LLMs / GenAI projects. Strong Python programming skills, especially in libraries such as Transformers, LangChain, scikit-learn, PyTorch, or TensorFlow. Experience with OpenAI (GPT-4), Claude, Mistral, LLaMA, or similar models. Knowledge of vector search, embedding models (e.g., BERT, Sentence Transformers), and semantic search techniques. Ability to build scalable AI workflows and deploy them via APIs or web apps (e.g., FastAPI, Streamlit, Flask). Familiarity with cloud platforms (AWS/GCP/Azure) and MLOps best practices. Excellent communication skills with the ability to translate technical solutions into business impact. Preferred Qualifications: Experience with prompt tuning, few-shot learning, or LoRA-based fine-tuning. Knowledge of data privacy and security considerations in GenAI applications. Familiarity with enterprise architecture, SDLC, or building GenAI use cases in regulated domains (e.g., finance, insurance, healthcare). For more information on benefits and what we offer please visit us at **************************************************
    $67k-91k yearly est. 1d ago
  • Sr Data Engineer-ETL

    Infovision Inc. 4.4company rating

    Denver, CO jobs

    Job Title: Sr. Data Engineer-ETL Duration: Long-term Main Skill: Over 10+ years of experience in the Software Development Industry. We need data Engineering exp - building ETLS using spark and sql, real time and batch pipelines using Kafka/firehose, experience with building pipelines with data bricks/snowflake, experience with ingesting multiple data formats like json/parquet/delta etc. Job Description: About You You have a BS or MS in Computer Science or similar relevant field You work well in a collaborative, team-based environment You are an experienced engineering with 3+ years of experience You have a passion for big data structures You possess strong organizational and analytical skills related to working with structured and unstructured data operations You have experience implementing and maintaining high performance / high availability data structures You are most comfortable operating within cloud based eco systems You enjoy leading projects and mentoring other team members Specific Skills: Over 10 years of experience in the Software Development Industry. Experience or knowledge of relational SQL and NoSQL databases High proficiency in Python, Pyspark, SQL and/or Scala Experience in designing and implementing ETL processes Experience in managing data pipelines for analytics and operational use Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.) Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers. Experience or knowledge of data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka. Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD Experience or knowledge in data observability and monitoring Hands-on experience in designing and maintaining data schema life-cycles. Bonus - Experience in tools like Databricks, Snowflake and Thoughtspot
    $71k-94k yearly est. 3d ago
  • Data Engineer

    Pyramid Consulting, Inc. 4.1company rating

    Dallas, TX jobs

    Immediate need for a talented Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Dallas, TX (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID:26-00480 Pay Range: $40 - $45/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Design, develop, and optimize end-to-end data pipelines using Python and PySpark Build and maintain ETL/ELT workflows to process structured and semi-structured data Write complex SQL queries for data transformation, validation, and performance optimization Develop scalable data solutions using Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Databricks Ensure data quality, reliability, and performance across data platforms Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements Implement best practices for data governance, security, and compliance Monitor and troubleshoot data pipeline failures and performance issues Support production deployments and ongoing enhancements Key Requirements and Technology Experience: Must have skills: Data Engineer, Azure, Python, PySpark Strong proficiency in SQL for querying and data modeling Hands-on experience with Python for data processing and automation Solid experience using PySpark for distributed data processing Experience working with Microsoft Azure data services Understanding of data warehousing concepts and big data architectures Experience with batch and/or real-time data processing Ability to work independently and within cross-functional teams Experience with Azure Databricks Knowledge of data modelling techniques (star/snowflake schemas) Familiarity with CI/CD pipelines and version control tools (Git) Exposure to data security, access control, and compliance standards Experience with streaming technologies Knowledge of DevOps or DataOps practices Cloud certifications (Azure preferred) Our client is a leading Pharmaceutical Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
    $40-45 hourly 2d ago
  • Data Scientist

    Talent Software Services 3.6company rating

    Novato, CA jobs

    Are you an experienced Data Scientist with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Scientist to work at their company in Novato, CA. Client's Data Science is responsible for designing, capturing, analyzing, and presenting data that can drive key decisions for Clinical Development, Medical Affairs, and other business areas of Client. With a quality-by-design culture, Data Science builds quality data that is fit-for-purpose to support statistically sound investigation of critical scientific questions. The Data Science team develops solid analytics that are visually relevant and impactful in supporting key data-driven decisions across Client. The Data Management Science (DMS) group contributes to Data Science by providing complete, correct, and consistent analyzable data at data, data structure and documentation levels following international standards and GCP. The DMS Center of Risk Based Quality Management (RBQM) sub-function is responsible for the implementation of a comprehensive, cross-functional strategy to proactively manage quality risks for clinical trials. Starting at protocol development, the team collaborates to define critical-to-quality factors, design fit-for-purpose quality strategies, and enable ongoing oversight through centralized monitoring and data-driven risk management. The RBQM Data Scientist supports central monitoring and risk-based quality management (RBQM) for clinical trials. This role focuses on implementing and running pre-defined KRIs, QTLs, and other risk metrics using clinical data, with strong emphasis on SAS programming to deliver robust and scalable analytics across multiple studies. Primary Responsibilities/Accountabilities: The RBQM Data Scientist may perform a range of the following responsibilities, depending upon the study's complexity and the study's development stage: Implement and maintain pre-defined KRIs, QTLs, and triggers using robust SAS programs/macros across multiple clinical studies. Extract, transform, and integrate data from EDC systems (e.g., RAVE) and other clinical sources into analysis-ready SAS datasets. Run routine and ad-hoc RBQM/central monitoring outputs (tables, listings, data extracts, dashboard feeds) to support signal detection and study review. Perform QC and troubleshooting of SAS code; ensure outputs are accurate and efficient. Maintain clear technical documentation (specifications, validation records, change logs) for all RBQM programs and processes. Collaborate with Central Monitors, Central Statistical Monitors, Data Management, Biostatistics, and Study Operations to understand requirements and ensure correct implementation of RBQM metrics. Qualifications: PhD, MS, or BA/BS in statistics, biostatistics, computer science, data science, life science, or a related field. Relevant clinical development experience (programming, RBM/RBQM, Data Management), for example: PhD: 3+ years MS: 5+ years BA/BS: 8+ years Advanced SAS programming skills (hard requirement) in a clinical trials environment (Base SAS, Macro, SAS SQL; experience with large, complex clinical datasets). Hands-on experience working with clinical trial data.•Proficiency with Microsoft Word, Excel, and PowerPoint. Technical - Preferred / Strong Plus Experience with RAVE EDC. Awareness or working knowledge of CDISC, CDASH, SDTM standards. Exposure to R, Python, or JavaScript and/or clinical data visualization tools/platforms. Preferred: Knowledge of GCP, ICH, FDA guidance related to clinical trials and risk-based monitoring. Strong analytical and problem-solving skills; ability to interpret complex data and risk outputs. Effective communication and teamwork skills; comfortable collaborating with cross-functional, global teams. Ability to manage multiple programming tasks and deliver high-quality work in a fast-paced environment.
    $99k-138k yearly est. 5d ago
  • Data Engineer

    Zillion Technologies, Inc. 3.9company rating

    Saint Louis, MO jobs

    We're seeking an experienced Data Engineer to help design and build a cloud-native big data analytics platform on AWS. You'll work in an agile engineering team alongside data scientists and engineers to develop scalable data pipelines, analytics, and visualization capabilities. Key Highlights: Build and enhance data pipelines and analytics using Python, R, and AWS services (Glue, Lambda, Redshift, EMR, QuickSight, SageMaker) Design and support big data solutions leveraging Spark, Hadoop, and Redshift Apply DevOps and Infrastructure as Code practices (Terraform, Ansible, AWS CDK) Collaborate cross-functionally to align data architecture with business goals Support security, quality, and operational excellence initiatives Requirements: 7+ years of data engineering experience Strong AWS cloud and big data background Experience with containerization (EKS/ECR), APIs, and Linux Location: Hybrid in St. Louis, MO area (onsite 2-3 days)
    $71k-97k yearly est. 1d ago
  • Staff Machine Learning Data Engineer

    Backflip 3.7company rating

    San Francisco, CA jobs

    Mechanical design, the work done in CAD, is the rate-limiter for progress in the physical world. However, there are only 2-4 million people on Earth who know how to CAD. But what if hundreds of millions could? What if creating something in the real world were as easy as imagining the use case, or sketching it on paper? Backflip is building a foundation model for mechanical design: unifying the world's scattered engineering knowledge into an intelligent, end-to-end design environment. Our goal is to enable anyone to imagine a solution and hit “print.” Founded by a second-time CEO in the same space (first company: Markforged), Backflip combines deep industry insight with breakthrough AI research. Backed by a16z and NEA, we raised a $30M Series A and built a deeply technical, mission-driven team. We're building the AI foundation that tomorrow's space elevators, nanobots, and spaceships will be built in. If you're excited to define the next generation of hard tech, come build it with us. The Role We're looking for a Staff Machine Learning Data Engineer to lead and build the data pipelines powering Backflip's foundation model for manufacturing and CAD. You'll design the systems, tools, and strategies that turn the world's engineering knowledge - text, geometry, and design intent - into high-quality training data. This is a core leadership role within the AI team, driving the data architecture, augmentation, and evaluation that underpin our model's performance and evolution. You'll collaborate with Machine Learning Engineers to run data-driven experiments, analyze results, and deliver AI products that shape the future of the physical world. What You'll Do Architect and own Backflip's ML data pipeline, from ingestion to processing to evaluation. Define data strategy: establish best practices for data augmentation, filtering, and sampling at scale. Design scalable data systems for multimodal training (text, geometry, CAD, and more). Develop and automate data collection, curation, and validation workflows. Collaborate with MLEs to design and execute experiments that measure and improve model performance. Build tools and metrics for dataset analysis, monitoring, and quality assurance. Contribute to model development through insights grounded in data, shaping what, how, and when we train. Who You Are You've built and maintained ML data pipelines at scale, ideally for foundation or generative models, that shipped into production in the real world. You have deep experience with data engineering for ML, including distributed systems, data extraction, transformation, and loading, and large-scale data processing (e.g. PySpark, Beam, Ray, or similar). You're fluent in Python and experienced with ML frameworks and data formats (Parquet, TFRecord, HuggingFace datasets, etc.). You've developed data augmentation, sampling, or curation strategies that improved model performance. You think like both an engineer and an experimentalist: curious, analytical, and grounded in evidence. You collaborate well across AI development, infra, and product, and enjoy building the data systems that make great models possible. You care deeply about data quality, reproducibility, and scalability. You're excited to help shape the future of AI for physical design. Bonus points if: You are comfortable working with a variety of complex data formats, e.g. for 3D geometry kernels or rendering engines. You have an interest in math, geometry, topology, rendering, or computational geometry. You've worked in 3D printing, CAD, or computer graphics domains. Why Backflip This is a rare opportunity to own the data backbone of a frontier foundation model, and help define how AI learns to design the physical world. You'll join a world-class, mission-driven team operating at the intersection of research, engineering, and deep product sense, building systems that let people design the physical world as easily as they imagine it. Your work will directly shape the performance, capability, and impact of Backflip's foundation model, the core of how the world will build in the future. Let's build the tools the future will be made in. #J-18808-Ljbffr
    $126k-178k yearly est. 5d ago

Learn more about NLB Services jobs