Post job

Data engineer jobs in Aurora, IL

- 1,435 jobs
All
Data Engineer
Devops Engineer
Data Architect
Data Scientist
Software Engineer Lead
Senior Software Engineer
Data Consultant
Senior Data Architect
Principal Software Engineer
Senior Software Development Engineer
  • Data Scientist

    Tag-The Aspen Group

    Data engineer job in Chicago, IL

    The Aspen Group (TAG) is one of the largest and most trusted retail healthcare business support organizations in the U.S. and has supported over 20,000 healthcare professionals and team members with close to 1,500 health and wellness offices across 48 states in four distinct categories: dental care, urgent care, medical aesthetics, and animal health. Working in partnership with independent practice owners and clinicians, the team is united by a single purpose: to prove that healthcare can be better and smarter for everyone. TAG provides a comprehensive suite of centralized business support services that power the impact of five consumer-facing businesses: Aspen Dental, ClearChoice Dental Implant Centers, WellNow Urgent Care, Chapter Aesthetic Studio, and Lovet Pet Health Care. Each brand has access to a deep community of experts, tools and resources to grow their practices, and an unwavering commitment to delivering high-quality consumer healthcare experiences at scale. As a reflection of our current needs and planned growth we are very pleased to offer a new opportunity to join our dedicated team as Data Scientist. Join us as a Data Scientist and play a key role in shaping how patients access care across a growing network of brands including Aspen Dental, ClearChoice, WellNow, Chapter Aesthetic Studio, and Lovet. In this role, you won't just analyze data - you'll lead end-to-end initiatives that shape how we optimize revenue across offices, days, and even hours. From designing strategies, deploying solutions and building performance dashboards to partnering with data science on automation and collaborating with teams across Finance, Marketing, Product, Technology and Operations, you'll have a direct hand in driving measurable results. This role is ideal for someone who excels at turning data into decisions, building repeatable processes, and uncovering insights that drive measurable improvements in revenue performance and patient access. You will lead initiatives across forecasting, scheduling optimization, demand modeling, capacity planning, and revenue strategy, while also shaping how analytics is delivered and scaled across the organization. If you're a builder who loves solving complex problems with data, operational logic, and automation, this opportunity is for you. Essential Responsibilities: Revenue Strategy & Optimization Lead strategy development for optimizing revenue performance at the office, day, and hour level by leveraging forecasting, scheduling, and demand modeling - while balancing access for patients and operational efficiency. Build analytical frameworks to support pricing, demand forecasting, scheduling, and access optimization. Identify revenue opportunities through data-driven analysis of booking trends, cancellations, no-shows, and utilization. Monitor and update demand and schedule availability through the analysis of historical and future booking trends, the pricing environment, industry capacity trends, competitive landscape, and other factors. Analytics, Insights & Experimentation Develop and maintain forecasting, demand models, dashboards, and scenario analyses. Run experiments and structured tests to evaluate new operational and scheduling strategies. Create clear, actionable insights that influence senior leaders and cross-functional partners. Process Building & Automation Map existing manual workflows and identify opportunities to automate recurring analyses or reporting. Cross-Functional Leadership Work closely with Operations, Finance, Product, Marketing, and Clinical teams to align strategies and execution. Help shape and scale the function by building new playbooks, reports, and best practices. Act as a subject matter expert in forecasting, demand modeling, and capacity optimization. Qualifications (Skills-Based): We welcome candidates with diverse academic and career pathways. You may have gained your skills through industry experience, coursework, certificates, or hands-on practice. Experience/Education: 5+ years of experience in Revenue Management, Pricing, Operations Research, Supply/Demand Optimization (Airline, Travel, Healthcare, or multi-location service industries preferred). Bachelor's degree in Business, Finance, Economics, Analytics, or Statistics required; Master's degree a plus. Experience working alongside data science/engineering teams to automate and scale analytics processes. Exceptional analytical, problem-solving, and communication skills - with the ability to influence senior stakeholders. Detail-oriented, self-starter mindset with a passion for driving results. Strong analytical and quantitative skills, with experience in forecasting, modeling, or optimization. Strong technical proficiency in SQL and a modern BI platform (e.g., Tableau, Looker). Familiarity with scripting (e.g., Python or R) or automation tools (e.g., DBT, Airflow) - not required, but helpful. Additional Job Description: Base Pay Range: $115,000 - $130,000, plus 10% annual bonus (Actual pay may vary based on experience, performance, and qualifications.) A generous benefits package that includes paid time off, health, dental, vision, and 401(k) savings plan with match. If you are an applicant residing in California, please view our privacy policy here: *********************************************************************************
    $115k-130k yearly 1d ago
  • Data Engineer

    Scaylor

    Data engineer job in Chicago, IL

    Scaylor helps mid-market and enterprise companies make sense of their data. Most teams past $20M ARR are stuck with fragmented systems, old databases, and hundreds of spreadsheets that never quite line up. We build the pipelines that clean, normalize, and connect that data so it can actually be used. Our platform handles everything from parsing financial models and reports to mapping tables across legacy databases and modern APIs. The goal is simple: give companies a single source of truth they can trust. We're a small team of four - one backend engineer, one frontend engineer, and 2 founders. We're looking for our fifth teammate to help us scale the engine behind it all. ⸻ The Role You'll work across data engineering and full-stack development, helping us build reliable data infrastructure that powers real workflows. You'll touch everything from ingestion and transformation pipelines to the APIs and dashboards that surface insights to clients. You'll work directly with the founding team and help make technical decisions that define the next version of Scaylor's core platform. ⸻ What You'll Work On • Build data pipelines that extract, clean, and standardize information from Excel files, PDFs, APIs, and legacy databases • Design schemas and transformation logic for structured and semi-structured data • Develop and maintain backend APIs (Python/FastAPI or Node/Express) for data access and analytics • Help connect backend services to our frontend dashboards (React, Node.js, or similar) • Set up and maintain AWS infrastructure (Lambda, S3, ECS, CloudFormation) • Collaborate with clients to understand their data problems and design workflows that fix them ⸻ You'd Be Great Here If You • Have 3-6 years of experience in data engineering, backend, or full-stack roles • Write clean, maintainable code in Python + JS • Understand ETL, data normalization, and schema mapping • Have experience with SQL and working with legacy databases or systems • Are comfortable managing cloud services and debugging data pipelines • Enjoy solving messy data problems and care about building things that last ⸻ Nice to Have • Familiarity with GCP or SQL databases • Understanding of enterprise data flows (ERP, CRM, or financial systems) • Experience building and deploying containers (Docker, GitHub Actions, CI/CD) • Interest in lightweight ML or LLM-assisted data transformation ⸻ Why Join Scaylor • Be one of the first five team members shaping the product and the company • Work directly with the founder and help define Scaylor's technical direction • Build infrastructure that solves real problems for real companies • Earn meaningful equity and have a say in how the company grows ⸻ Compensation • $130k - $150k with a raise based on set revenue triggers • .4% equity • Relocation to Chicago, IL required
    $130k-150k yearly 5d ago
  • Data Architect

    Geowealth

    Data engineer job in Oak Brook, IL

    GeoWealth is a Chicago-based fintech firm that offers an award-winning digital advisory platform, including Turnkey Asset Management Platform (“TAMP”) capabilities. We deliver a comprehensive and fully integrated wealth management technology platform to professionals in the financial services industry. OPPORTUNITY: We're looking for a Data Architect to join our Engineering Team. In this role, you will oversee the overall data architecture, helping us deliver our best-in-class solutions to our customers. This role will be key in organizing, designing, and leading our team through well-designed data architecture. If you love architecting complex systems, delivering customer focused software, designing best-in-class systems and leading data architecture design this role is for you. RESPONSIBILITIES: Own data architecture and oversee data implementation Set coding/implementation standards Lead our data warehouse design Deliver performant, maintainable, and quality software in collaboration with our teams. Improve our database design to reduce replication and increase performance Partner with other architects and engineers to produce better designed systems SKILLS, KNOWLEDGE, AND EXPERIENCE: 5+ years of experience as Data Architect or equivalent role Bachelor's degree in computer science or equivalent degree Hands-on experience with Oracle Designed and implemented data warehouse Experience with the following is preferred but not required: designing and building monolithic and distributed systems, Postgres, Logi Symphony, PowerBI, Java and JIRA/Confluence COMPANY CULTURE & PERKS - HIGHLIGHTS: Investing in Your Growth 🌱 Casual work environment with fun, hard-working, and open-minded coworkers Competitive salary with opportunity for performance-based annual bonus Opportunities to up-skill, explore new responsibilities, and network across departments Defined and undefined career pathways allowing you to grow your own way Work/Life Balance 🗓️ Flexible PTO and work schedule to ensure our team balances work and life Hybrid work schedule Maternity and paternity leave Taking Care of Your Future ♥️ Medical, Dental, and Vision, Disability insurance Free access to Spring Health, a comprehensive mental health solution 401(k) with company match and a broad selection of investments Voluntary insurance: short-term disability, long-term disability, and life insurance FSA and transit benefits for employees that contribute pre-tax dollars Other Fun Stuff ⭐ Free on-site gym and parking Weekly catered lunches in the office, plus monthly happy hours Stocked kitchen with snacks and drinks GeoWealth was recognized as “Best Place to Work” by Purpose Job's 2025, 2024 and 2022 GeoWealth was recognized as “Best Place to Work” by Built In in 2024, 2023 and 2022 SALARY RANGE: Starting at $170,000-$220,000 + Benefits + Opportunity for Performance Bonus This is an estimated range based on the circumstances at the time of posting, however, may change based on a combination of factors, including but not limited to skills, experience, education, market factors, geographical location, budget, and demand.
    $170k-220k yearly 5d ago
  • Big Data Consultant

    Clifyx

    Data engineer job in Chicago, IL

    Job Title: Bigdata Engineer Employment Type: W2 Contract Detailed Job Description: We are seeking a skilled and experienced Big Data Platform Engineer who is having 7+ yrs of experience with a strong background in both development and administration of big data ecosystems. The ideal candidate will be responsible for designing, building, maintaining, and optimizing scalable data platforms that support advanced analytics, machine learning, and real-time data processing. Key Responsibilities: Platform Engineering & Administration: • Install, configure, and manage big data tools such as Hadoop, Spark, Kafka, Hive, HBase, and others. • Monitor cluster performance, troubleshoot issues, and ensure high availability and reliability. • Implement security policies, access controls, and data governance practices. • Manage upgrades, patches, and capacity planning for big data infrastructure. Development & Data Engineering: • Design and develop scalable data pipelines using tools like Apache Spark, Flink, NiFi, or Airflow. • Build ETL/ELT workflows to ingest, transform, and load data from various sources. • Optimize data storage and retrieval for performance and cost-efficiency. • Collaborate with data scientists and analysts to support model deployment and data exploration.
    $74k-99k yearly est. 2d ago
  • Senior Data Engineer

    Programmers.Io 3.8company rating

    Data engineer job in Chicago, IL

    requires visa independent candidates. Note: (OPT, CPT, H1B holders will not work at this time) Design, develop, and maintain scalable ETL pipelines using AWSGlue Collaborate with data engineers and analysts to understand data requirements Build and manage data extraction, transformation, and loading processes Optimize and troubleshoot existing Glue jobs and workflows Ensure data quality, integrity, and security throughout the ETL process Integrate AWS Glue with other AWS services like S3, Lambda, Redshift, and Step Functions Maintain documentation of data workflows and processes Stay updated with the latest AWS tools and best practices Required Skills Strong hands-on experience with AWS Glue, PySpark, and Python Proficiency in SQL and working with structured/unstructured data (JSON, CSV, Parquet) Experience with data warehousing concepts and tools Familiarity with CI/CD pipelines, Terraform, and scripting (PowerShell, Bash) Solid understanding of data modeling, data integration, and data management Exposure to AWS Batch, Step Functions, and Data Catalogs
    $81k-112k yearly est. 3d ago
  • Data Scientist

    Alined Consulting Group

    Data engineer job in Chicago, IL

    Minimum Qualifications: ● 5+ years of experience leading data science projects that have a direct impact on a company's objectives or PhD degree in quantitative fields such as Statistics, Data Science, Computer Science with 3+ years of experience ● 5+ years of experience utilizing data mining techniques, ML models to assist business decision making. Hands-on experience with deep learning frameworks , LLMs, GenAI tools, and NLP techniques. ● Deep expertise in statistical methods and machine learning concepts, with the ability to mentor team members on methodologies, model tuning, and evaluation techniques. ● 2+ years hands-on experience with deep learning frameworks, LLMs, GenAI tools, and NLP techniques. ● 5+ years of experience using Python to process large, diverse datasets, and develop and deploy predictive models in cloud-based environments and other computing platforms. ● 5+ years of experience in SQL and cloud-hosted data platforms (Google Cloud Platform, AWS, etc.). ● Demonstrated ability to assist business decision-making through data mining and machine learning. ● Strong communication skills to collaborate effectively with business stakeholders. Must be able to interact cross-functionally and drive both business and technical discussions. ● Ability to translate complex business problems into actionable project plans and solve
    $70k-97k yearly est. 1d ago
  • Sr. Data Engineer - PERM - MUST BE LOCAL

    Resource 1, Inc.

    Data engineer job in Naperville, IL

    Resource 1 is in need of a Sr. Data Engineer for a full-time/ permanent position with our client in Naperville, IL. Candidate must be local to Illinois because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus. This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products. Responsibilities: Design and develop scalable data pipelines for ingestion, transformation and integration using AWS services. Pull data from PostgreSQL and SQL Server to migrate to AWS. Create and modify jobs in AWS and modify logic in SQL Server. Create SQL queries, stored procedures and functions in PostgreSQL and RedShift. Provide input on data modeling and schema design as needed. Manage infrastructure through infrastructure-as-code templates (Serverless Framework), supporting new data products and services in AWS. Support inbound/ outbound data flows, including APIs, S3 replication and secured data. Assist with data visualization/ reporting as needed. Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints. Qualifications: 5+ years of data engineering experience. Experience with AWS and its associated array of offerings (Glue, Redshift, Athena, S3, Lambda, Spectrum). Strong experience with SQL, Python and PySpark. A background in supply chain, logistics or distribution would be a plus. Experience with Power BI is a plus.
    $75k-100k yearly est. 5d ago
  • Snowflake Data Engineer

    VC5 Consulting

    Data engineer job in Chicago, IL

    Join a dynamic team focused on building innovative data solutions that drive strategic insights for the business. This is an opportunity to leverage your expertise in Snowflake, ETL processes, and data integration. Key Responsibilities Develop Snowflake-based data models to support enterprise-level reporting. Design and implement batch ETL pipelines for efficient data ingestion from legacy systems. Collaborate with stakeholders to gather and understand data requirements. Required Qualifications Hands-on experience with Snowflake for data modeling and schema design. Proven track record in developing ETL pipelines and understanding transformation logic. Solid SQL skills to perform complex data transformations and optimization. If you are passionate about building cutting-edge data solutions and want to make a significant impact, we would love to see your application! #11290
    $75k-100k yearly est. 1d ago
  • Data Engineer

    Acuity Analytics

    Data engineer job in Chicago, IL

    The Data Engineer will design, build, and optimize the data pipelines and models that support the firm's evolving research, analytics, and systematic portfolio construction environment. This role is central to enabling data-driven investment processes, including quantitative research, AI/ML capabilities, and front-office automation. Candidates must have deep expertise with Snowflake, strong SQL skills, and experience integrating diverse datasets used across investment organizations. The role is highly collaborative and requires comfort working in an iterative, fast-moving environment where data needs evolve rapidly based on stakeholder input. Responsibilities Design, build, and enhance ETL/ELT pipelines in Snowflake, ensuring high performance, reliability, and scalability. Integrate internal and external datasets, including pricing, research content, economic releases, market data, and security reference data. Support real-time or near-real-time data flows where needed (e.g., pricing, indicative quotes, market-sensitive inputs). Collaborate closely with Product Leads, Quant Developers, and UI/UX teams to ensure data structures meet the requirements of research workflows, analytical models, and user-facing applications. Partner with front-office stakeholders to rapidly iterate on evolving analytical and data needs. Implement data validation, monitoring, and quality frameworks to ensure accuracy and reliability across critical datasets. Translate prototype pipelines into production-ready workflows with appropriate documentation, standards, and controls. Contribute to data modeling standards, metadata frameworks, and data governance practices across the platform. Requirements 10+ years of data engineering experience within investment management, financial technology, or similar data-intensive environments. Expert-level SQL, including complex queries, schema design, and performance optimization. Deep hands-on experience with Snowflake, including advanced features such as tasks, streams, performance tuning, and secure data sharing. Strong Python capabilities for ETL/ELT development, data processing, and workflow automation. Experience integrating APIs and working with structured, semi-structured, and unstructured datasets. Familiarity with NLP or AI/ML-oriented datasets (e.g., textual research content, PDFs) is a plus. Experience with Domino or willingness to work within a Domino-based model environment. Working knowledge of investment data structures (holdings, benchmarks, pricing, exposures) is highly preferred. Ability to thrive in a rapid prototyping environment with evolving requirements and close partnership with front-office teams.
    $75k-100k yearly est. 1d ago
  • Senior Data Architect

    Hub Group 4.8company rating

    Data engineer job in Oak Brook, IL

    We are seeking a highly skilled and strategic Senior Data Solution Architect to join our IT Enterprise Data Warehouse team. This role is responsible for designing and implementing scalable, secure, and high-performing data solutions that bridge business needs with technical execution. Design solutions for provisioning data to our cloud data platform using ingestion, transformation, and semantic layer techniques. Additionally, this position provides technical thought leadership and guidance to ensure that data platforms and pipelines effectively support ODS, analytics, reporting, and AI initiatives across the organization. Key Responsibilities: Architecture & Design: Design end-to-end data architecture solutions including operational data stores, data warehouses, and real-time data pipelines. Define standards and best practices for data modeling, integration, and governance. Evaluate and recommend tools, platforms, and frameworks for data management and analytics. Collaboration & Leadership: Partner with business stakeholders, data engineers, data analysts, and other IT teams to translate business requirements into technical solutions. Lead architecture reviews and provide technical guidance to development teams. Advocate for data quality, security, and compliance across all data initiatives. Implementation & Optimization Oversee the implementation of data solutions, ensuring scalability, performance, and reliability. Optimize data workflows and storage strategies for cost and performance efficiency. Monitor and troubleshoot data systems, ensuring high availability and integrity. Required Qualifications: Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or related field. 7+ years of experience in data architecture, data engineering, or related roles. Strong expertise in cloud platforms (e.g., Azure, AWS, GCP) and modern data stack tools (e.g., Snowflake, Databricks). Proficiency in SQL, Python, and data modeling techniques (e.g. Data Vault 2.0) Experience with ETL/ELT tools, APIs, and real-time streaming technologies (e.g., dbt, Coalesce, SSIS, Datastage, Kafka, Spark). Familiarity with data governance, security, and compliance frameworks Preferred Qualifications: Certifications in cloud architecture or data engineering (e.g., SnowPro Advanced: Architect). Strong communication and stakeholder management skills. Why Join Us? Work on cutting-edge data platforms and technologies. Collaborate with cross-functional teams to drive data-driven decision-making. Be part of a culture that values innovation, continuous learning, and impact. ** This is a full-time, W2 position with Hub Group - We are NOT able to provide sponsorship at this time ** Salary: $135,000 - $175,000/year base salary + bonus eligibility This is an estimated range based on the circumstances at the time of posting, however, may change based on a combination of factors, including but not limited to skills, experience, education, market factors, geographical location, budget, and demand Benefits We offer a comprehensive benefits plan including: Medical Dental Vision Flexible Spending Account (FSA) Employee Assistance Program (EAP) Life & AD&D Insurance Disability Paid Time Off Paid Holidays BEWARE OF FRAUD! Hub Group has become aware of online recruiting related scams in which individuals who are not affiliated with or authorized by Hub Group are using Hub Group's name in fraudulent emails, job postings, or social media messages. In light of these scams, please bear the following in mind Hub Group will never solicit money or credit card information in connection with a Hub Group job application. Hub Group does not communicate with candidates via online chatrooms such as Signal or Discord using email accounts such as Gmail or Hotmail. Hub Group job postings are posted on our career site: ******************************** About Us Hub Group is the premier, customer-centric supply chain company offering comprehensive transportation and logistics management solutions. Keeping our customers' needs in focus, Hub Group designs, continually optimizes and applies industry-leading technology to our customers' supply chains for better service, greater efficiency and total visibility. As an award-winning, publicly traded company (NASDAQ: HUBG) with $4 billion in revenue, our 6,000 employees and drivers across the globe are always in pursuit of "The Way Ahead" - a commitment to service, integrity and innovation. We believe the way you do something is just as important as what you do. For more information, visit ****************
    $135k-175k yearly 2d ago
  • Data Architect

    Mastek

    Data engineer job in Chicago, IL

    Job Title: Architect / Senior Data Engineer We are seeking a highly skilled Architect / Senior Data Engineer to design, build, and optimize our modern data ecosystem. The ideal candidate will have deep experience with AWS cloud services, Snowflake, and dbt, along with a strong understanding of scalable data architecture, ETL/ELT development, and data modeling best practices. Key Responsibilities Architect, design, and implement scalable, reliable, and secure data solutions using AWS, Snowflake, and dbt. Develop end-to-end data pipelines (batch and streaming) to support analytics, machine learning, and business intelligence needs. Lead the modernization and migration of legacy data systems to cloud-native architectures. Define and enforce data engineering best practices including coding standards, CI/CD, testing, and monitoring. Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into technical solutions. Optimize Snowflake performance through query tuning, warehouse sizing, and cost management. Establish and maintain data governance, security, and compliance standards across the data platform. Mentor and guide junior data engineers, providing technical leadership and direction. Required Skills & Qualifications 8+ years of experience in Data Engineering, with at least 3+ years in a cloud-native data environment. Hands-on expertise in AWS services such as S3, Glue, Lambda, Step Functions, Redshift, and IAM. Strong experience with Snowflake - data modeling, warehouse design, performance optimization, and cost governance. Proven experience with dbt (data build tool) - model development, documentation, and deployment automation. Proficient in SQL, Python, and ETL/ELT pipeline development. Experience with CI/CD pipelines, version control (Git), and workflow orchestration tools (Airflow, Dagster, Prefect, etc.). Familiarity with data governance and security best practices, including role-based access control and data masking. Strong understanding of data modeling techniques (Kimball, Data Vault, etc.) and data architecture principles. Preferred Qualifications AWS Certification (e.g., AWS Certified Data Analytics - Specialty, Solutions Architect). Strong communication and collaboration skills, with a track record of working in agile environments.
    $83k-113k yearly est. 2d ago
  • Data Architect - Pharma

    Mathco

    Data engineer job in Chicago, IL

    MathCo Role - Data/AI Engineering Manager Onsite - Chicago - 4 days in office (Mandatory) Industry - Pharma (Mandatory) As platform architect/owner, you will: Lead the end-to-end architecture, lifecycle, and governance of the AI/Analytics platform, defining standards, reusable components, and integration patterns. Partner with AI/Data architects to enable scalable model deployment and enhance agentic orchestration. Translate business needs into platform features, manage onboarding, documentation, and cross-functional collaboration for platform adoption. Oversee infrastructure-as-code, CI/CD, observability, and containerized environments to ensure reliability and scalability. Evaluate complex technical proposals and develop actionable platform roadmaps and architecture recommendations Stay current on key AI platform developments and assess their impact on architecture and client strategy Coach others, recognize their strengths, and encourage them to take ownership of their personal development Skills Required Experience in designing, architecting, or managing distributed data and AI platforms in cloud environments (AWS, Azure, or GCP) Proven ability to carry out complex Proof of Concept (POC), pilot projects, and limited production rollouts for AI use-cases, focusing on developing new or improved techniques and procedures. Strong skills in pipeline/workflow optimization and data processing frameworks to evaluate architectural choices Years of Experience Minimum of 8 years in relevant experience, preferably with a consulting background and experience with Pharma clients
    $83k-113k yearly est. 2d ago
  • Data Architect (US Citizen or Green Card Only)

    Ampstek

    Data engineer job in Chicago, IL

    Must Have Skills: • Snowflake • Azure • GCP • Python Nice to Have Skills: • SQL • Kafka • PBI Detailed Job Description: Responsibilities • Interact & Influence business stakeholders to secure strong engagement and ensures that the data & analytical product delivery aligns with longer-term strategic roadmaps • Design & contribute towards the structure and layout of lake house architecture optimizing data storage, and establishing data access controls and security measures • Implement the long-term Data & Analytics strategy and deliver functional objectives • Assess requirement feasibility, translates high-level business requirements into data requirements, appropriate metadata, test data, and data quality standards • Explore Data Sources by working with Application owners to confirm datasets to be extracted • Contribute to establishing and implementing database structure, including schema design, table definitions, column specifications, and naming conventions • Design Data models for Source data products, Master data products & Insight data products. • Document Data Architecture artifacts for different Data Products and solutions and perform peer review across various functions. • Support Data Engineering and BI Engineering teams during the build phase Review Data models development, validate and provide deployment approval • Work closely with data stewards and governance functions to continuously improve data quality and enhance the reliability of data model(s). • Simplify the existing data architecture, delivering reusable services and cost-saving opportunities in line with the policies and standards of the company • Leads and participates in the peer review and quality assurance of project architectural artifacts across the Data Architecture group through governance forums • Collaborate and contribute to the development and enhancement of standards, guidelines, and best practices within Data Architecture discipline. • Works with Product owners, Business stewards, Data Scientists and end users to understand data consumers' needs and develop data products/ data solutions • Evaluates and recommends emerging technologies for data management, storage, and analytics
    $83k-113k yearly est. 1d ago
  • DevOps Cloud Engineer

    Laka & Company

    Data engineer job in Chicago, IL

    Duties: You will be responsible for: (1) Designing, deploying, securing, and managing enterprise cloud and hybrid infrastructure across compute, storage, database, networking, and security domains using services within Amazon Web Services (including EC2, Lambda, S3, RDS, VPC, IAM, and related technologies); (2) Implementing and maintaining Infrastructure as Code (IaC) using tools such as GitHub, Pulumi, or AWS CloudFormation to automate provisioning, configuration, and lifecycle management; (3) Continuously evaluating and optimizing AWS environments to ensure performance, availability, scalability, cost efficiency, and operational stability; (4) Designing, building, and maintaining CI/CD pipelines using GitHub Actions, AWS CodePipeline, or Jenkins, including integration of automated testing, security scanning, and compliance checks (e.g., Orca Security or similar tools); (5) Leveraging automation and AI-based tools to strengthen the efficiency and intelligence of CI/CD and DevOps processes; (6) Implementing security best practices across identity and access management, network architecture, encryption, monitoring, logging, and incident response in coordination with the Information Security team; (7) Supporting vulnerability management, incident response, remediation, and follow-up to ensure secure and compliant cloud operations; (8) Setting up and maintaining monitoring, logging, alerting, and SIEM integrations using platforms such as AWS CloudWatch, LogicMonitor, Splunk, or Orca Security; (9) Troubleshooting infrastructure, networking, and deployment issues across hybrid environments and participating in weekly on-call rotation for production support; (10) Managing Windows and Linux patching, BC/DR capabilities, and policy governance using AWS Systems Manager, Cloud Custodian, and related tooling; (11) Collaborating with developers, system administrators, engineers, and business stakeholders to design and deliver reliable and secure cloud solutions; (12) Evaluating, recommending, and implementing new tools, frameworks, and automation opportunities to enhance performance, availability, security, and operational maturity; (13) Documenting system standards, architecture diagrams, operating procedures, and best practices to ensure alignment, maintainability, and operational excellence; (14) Contributing to a culture of collaboration, agility, innovation, continuous improvement, and cross-team partnership. Required: ****Critical Note: This is NOT a traditional DevOps Cloud Engineer and traditional DevOps Cloud Engineers should not invest time in applying. The requirements for consideration are shared specifically below this critical note, but to provide important and essential insight for you to be considered, the following is being shared: ALL applicants must have hands-on experience at some point in their professional work experience foundational or traditional IT infrastructure skills---not cloud based (e.g. actual non-cloud based system administration, network engineering/administration, firewalls/security) with background/experience in building/administering/engineering/supporting/operating either on-premises or hybrid IT infrastructures, who grew into more of the DevOps space, would be highly preferred versus a pure cloud-only person. Required: A completed and verifiable Bachelor's degree in Computer Science, Information Systems, or a related STEM field is required. Must have 3 or more years of professional Dev/Ops and Cloud Engineering experience with Prior experience as a Systems Engineer, Systems Adminstration, or Network Engineer with pater exeperience in DevOps practices, cloud automation, and modern infrastructure. Both components of this requirement are an absolute must have. Must have strong, hands-on expertise with AWS compute, storage, networking, database, serverless, and security services, including EC2, Lambda, S3, RDS, CloudFormation, VPC, IAM, and container services such as ECS/EKS. Must have experience building and managing Infrastructure as Code using Pulumi, Terraform, AWS CloudFormation, and scripting languages such as Python, Bash, or Node.js. Must have hands-on experience administering and developing CI/CD pipelines using GitHub Actions, AWS CodeCommit/CodePipeline, or equivalent automation platforms. Must have working knowledge of networking technologies including routing, switching, VPNs, firewalls, and network security principles, along with experience managing hybrid connectivity. Must have familiarity with IAM, SIEM, SASE, and the integration of security within CI/CD pipelines. Must have experience with monitoring and observability tools such as AWS CloudWatch, LogicMonitor, Splunk, Orca Security, or similar enterprise platforms. Must demonstrate strong communication skills, the ability to work closely with peers and stakeholders, and the ability to operate effectively in a fast-paced, dynamic environment. Pluses: AWS certifications such as AWS Certified Solutions Architect - Associate or AWS Certified DevOps Engineer - Associate. Experience in financial services or other regulated industries. Experience supporting governance, compliance, or cloud security programs.
    $80k-105k yearly est. 2d ago
  • Azure Cloud & DevOps Engineer

    Sprocket Sports

    Data engineer job in Chicago, IL

    📱 Azure Cloud & DevOps Engineer 📍 Chicago, IL | 🏢 Hybrid | 💼 Full-Time At Sprocket Sports, We are currently seeking an Azure Cloud & DevOps Engineer to join our Team. The ideal candidate has a passion for youth sports and managing a best-in-class software platform that will be used by thousands of youth sports club administrators, coaches, parents and players. About Sprocket Sprocket Sports is a fast-growing technology company based in Chicago and a national leader in the youth sports space. Our software and services help clubs streamline operations, reduce costs, and grow faster, so they can focus on what really matters: kids playing sports. We're also proud to be a certified Great Place to Work 2024, with a culture that balances high standards, accountability, and fun. What You'll Do As an experienced DevOps / cloud engineer you will help us scale and maintain a high-performing, reliable, and cost-effective cloud infrastructure. As an Azure Cloud Engineer, you will be the backbone of our cloud infrastructure, ensuring our platform is always available, fast, and secure for our users. You will manage our resources in Microsoft Azure, focusing heavily on performance optimization, cost control, and proactive system health monitoring. This role is perfect for someone passionate about cloud technology, DevOps principles, and continuous improvement. In this role you will interact with our software engineers, product managers and occasionally with operational stakeholders. We are seeking individuals who like to think creatively and have a passion for continually improving the platform. Responsibilities: Core Azure Cloud Management Resource & Cost Optimization: Manage, provision, and maintain our complete suite of Azure resources (e.g., App Services, Azure Functions, AKS, VMs). Proactively manage and reduce cloud costs by identifying and implementing efficiencies in resource utilization and recommending right-sizing strategies. Security and Compliance: Ensure security best practices are implemented across all Azure services, including network segmentation, access control (IAM), and patching. Performance & Reliability Engineering (SRE Focus) System Health and Monitoring: Ongoing monitoring of application and system performance using Azure and DataDog to detect and diagnose issues before they impact users. Review system logs, metrics, and tracing data to identify areas of concern, bottlenecks, and opportunities for performance tuning. Performance Testing Lead efforts to conduct load testing and performance testing on the system. Database Performance Tuning: Review and optimize SQL performance by analyzing query plans, identifying slow-running queries, and recommending improvements (indexing, schema changes, stored procedures). Manage and monitor our Azure SQL Database resources for optimal health and throughput. Incident Response: Participate in on-call rotation to provide 24/7 support for critical infrastructure incidents and drive root cause analysis (RCA). DevOps Automation Infrastructure as Code (IaC): Implement Infrastructure-as-Code (ARM, Bicep, or Terraform) to maintain consistent, auditable deployments. Continuous Integration / Continuous Delivery (CI/CD): Work closely with the development team to automate and streamline deployment pipelines (CI/CD) using Azure DevOps, ensuring fast and reliable releases. Configuration Management: Implement and manage configuration for applications and infrastructure. What We're Looking For: Bachelor's degree in a Computer Science or related field. 3+ years of professional experience in Cloud Engineering, DevOps, or a similar role, with a strong focus on Microsoft Azure. Deep hands-on experience with core Azure services and strong networking fundamentals. Solid experience with monitoring and observability platforms, specifically DataDog. Scripting proficiency in PowerShell. Demonstrated ability to analyze and optimize relational database performance (SQL/T-SQL). Strong problem-solving skills. Strong communication and interpersonal skills; ability to analytically defend design decisions and take feedback without ego. Strong attention to detail and accountability. Why Join Us? ✅ Certified Great Place to Work 2024 🤝 Mission-driven team with a big vision 🚀 Fast-growing startup with room to grow 💼 Competitive salary + equity 📊 401(k) with company match 🩺 Comprehensive medical and dental 🎉 A culture built on Higher Standards, Greater Accountability, and More Fun
    $80k-105k yearly est. 4d ago
  • Senior DevOps Engineer

    Qorali

    Data engineer job in Chicago, IL

    Qorali is excited to have a new role that we can share with you to take your career to the next level! This role is involved with modern technologies that are integrated deeply with different platforms and operations with significant opportunities within the company to have continuous growth. You will work with teams to implement monitoring practices to enhance the environment and efficiency for both cloud and on-prem spaces. Expectations for role Tracking metrics with alerts and notifications with runbooks for operational monitoring, availability and scalability Implementation of resolutions for optimization for different services with the team Incident response production while keeping automation Lead the for the team improvement in research, retrospectives, and discussion/code reviews Mentoring junior team members Maintenance of large-scale systems with the ability to troubleshoot and problem solve. Technical Skills 6+ years of DevOps experience AWS (preferred) or Azure Experience with monitoring environments including tools such as Splunk, AppDynamics, Datadog, Prometheus or Grafana. Scripting languages (Java, Python) Containerization creation in Kubernetes, Docker or Rancher CI/CD experience (Jenkins preferred) Leveraging the use of language models to enhance DevOps automation workflow Benefits 15% bonus 20+ PTO 6% 401k match Health, vision, dental and life plans Two days of remote working per week This role is unable to support Visa Sponsorship or C2C. C2H.
    $80k-105k yearly est. 5d ago
  • Azure Devops Engineer

    IMCS Group 3.9company rating

    Data engineer job in Chicago, IL

    Set up CI/CD pipelines to support automated deployment of resources to Cloud environments, all at medium to high level of complexity · This is a hands-on role that develops and supports build and release automation pipelines. You will be part of the team that will deploy a highly available full software stack in public/ private clouds · Remediate gaps and support the automation requirements of continuous integration and continuous deployment · Identify and develop metrics and dashboards to monitor adoption and maturity of DevOps · Experience in Docker/Containerization and Kubernetes · Ability to contribute to architecture discussions around technology controls and their implementation in a DevOps/Cloud environment · Work collaboratively with architecture, security and other engineers to estimate, design, code, deploy and support working software / technology components · Foster the adoption of DevSecOps culture and capabilities across Agile product delivery teams · Embed “shift-left” security practices using tools like Checkmarx, SonarQube, PrismaCloud. · Work in an Agile/Scrum environment; planning, estimating, and completing tasks on · Liaison with Agile Delivery Process teams to support necessary configurations/setup in Azure DevOps (ADO) for Agile ceremonies Champion Modern SDLC by leading the consistent application of the redesigned SDLC framework, aligning with Agile, DevSecOps, and platform standards · Work with development and support teams to design improved deployment, provisioning and integration workflows, ensure environments stability and identify areas and plans for improvement · Contribute to new technology, vendor package and tool road mapping, evaluation and introduction Ensure compliance with Performance, Security, Availability, Recoverability standards and policies and provide Monitoring recommendations for tasks of low to medium level of complexity · 5+ years of demonstrable software engineering and DevOps experience · 5+ years working in SCRUM/Agile software development environment · Experience deploying and administering Continuous integration tools such as Azure DevOps, is a must · Experience with Infrastructure cloud tools such as Terraform, Docker, and Aspire etc. · Experience with automated testing solutions for unit testing, integration and system testing · Bachelor's Degree or equivalent experience. Computer Science or related field preferred. · Strong cloud engineering experience primarily with Azure and AWS. · Experience in working with Terraform, Ansible, and/or Chef for infrastructure automation and configuration · Experience with Docker and Kubernetes on platforms such as AWS ECS and AWS EKS · Experience with programming languages such as Python, Poweshell, and C++ is a plus · Experience with APM, monitoring and logging tools such as Datadog, Solarwinds, Cloud watch and Splunk · Experience with SQL databases such as MySQL and , NoSQL databases like AWS Dynamo DB and MongoDB, graph DB such as Neo4J, AWS Neptune. Experience with project management and workflow tools and concepts such as Jira, Agile, Scrum/Kanban, etc. · Proficiency in cross-platform scripting language and build tools (Python,ANT,Artifactory, MS Build,NuGet) · Proficiency in OOP software development using C# or similar languages · Ability to define scalable and secure CI/CD pipelines · Understanding of deployment strategies using Docker and Podman for containerization · Experience with pair programming using GitHub Copilot Strong communication/presentation skills and ability to explain standards, processes, and cloud architecture with team and management.
    $79k-104k yearly est. 5d ago
  • Lead Principal Java Scala Blockchain Software Engineer

    Request Technology, LLC

    Data engineer job in Chicago, IL

    This is not a C2C role, permanent W2 direct-hire only*** is bonus eligible*** Prestigious Financial Institution is currently seeking a Lead Principal Software Java Engineer, with Scala and Blockchain experience. Candidate will be responsible for the development and delivery of business features, integrating a variety of upstream data sources and presenting data through the user interface, all while enriching and advancing the platform. This software must achieve a blend of data-rich presentation, performance, user experience, and the capacity to support the busiest trading days in the world economy with rock-solid reliability. The candidate must be able to solve problems creatively, communicate effectively, and proactively engage in technical decision making to achieve these objectives. Responsibilities: Working alongside experts that are building next generation blockchain-based securities lending system, and paving the future of digital transformation in the capital markets industry Collaborating with others to deliver complex projects which may involve multiple systems Continuously thinking about the next steps while improving yourself and others around you Developing solutions to complex technical challenges while coding, testing, troubleshooting, debugging, and documenting the systems you develop Optimizing application performance through analysis, code refactoring, and system tuning Recommending technologies and tools that improve the efficiency and quality of the systems and development processes. Qualifications: [Required] 2+ years of development experience with Scala [Required] 7+ years of experience in software development [Required] 5+ years of experience in Java or related technologies [Required] 3+ years of experience in react js or similar technologies [Required] 1+ years of experience with distributed application design & blockchain [Required] Experience with Akka or other actor-based systems [Required] Experience with Devops and CICD tools (GIT, Jenkins, Docker, Kubernetes, Harness, Rancher) [Required] Ability to write clean, bug-free code that is easy to understand and easily maintainable [Required] Experience with BDD methodologies & automated acceptance testing Technical Skills & Background: [Required] Scala-based software development experience [Required] Web/mobile application development experience [Required] Understanding of message brokers, Queues and distributed datastores (Kafka, MQ, Redis, Splunk) [Required] Experience working Unix/Linux environments, large software system development, security software development, public-cloud platforms [Required] Fluent in functional programming, object-oriented design, industry best practices, software patterns, and architecture principles [Required] Proficient in the following types of testing: unit, integration, system, functional, non-functional, regression, performance, security, and acceptance [Required] Deep understanding of performance issues and multi-threaded development [Required] Experience with continuous integration tools and techniques, automating processes, and writing scripts using Python and other languages. Education: [Required] BS degree in Computer Science, similar technical field required [Preferred] Masters preferred
    $97k-129k yearly est. 2d ago
  • Senior SDET/QA Lead

    DSM-H Consulting

    Data engineer job in Chicago, IL

    Note: Need local candidates only and interview will be onsite Role and Overview of the role: Looking for a candidate who has 8 to 10 years of experience. It's a Senior lead kind of a role who would be involved in trying to understand development solutions for different features that are coming available, try and understand the testing scope for these new solutions, come up with a test approach, test plan, outline the test cases. Perform automation for these cases and develop automated squirts and then continuously monitor. This candidate will do the PR reviews, be sort of the senior QA who will be helping out the juniors with the questions they have for somebody who can take ownership and then make sure on time without any issues. Looking for somebody who is really strong in Java. Candidates should have Java Background and use Karate and then different automated testing tools. Top Skills: l Java l Cucumber l JBehave / BDD l At least 8 years of test automation framework design l Strong experience in testing Web Services (REST APIs) (3+5 years) l The ability to write queries in SQL or other relational databases l 3+ years of experience in developing scenario based performance testing using JMeter l Experience testing full stack and integration testing with 3rd parties l End-to-end system integration testing experience for software platforms Education and Experience: l Years of experience: 8-10 yrs experience l Degree requirement: Bachelor's degree and 8+ years of experience Position's Contributions to Work Group: - AKA Senior SDET Extend testing automation framework using JAVA/JAVA Script Take ownership in understanding business requirements/ACs and develop test strategy/test plan Develop automation testcases using existing automation framework Typical task breakdown: Develop test automation code for Continuous Integration (CI), Continuous Delivery (CD), of systems, infrastructure, and test framework. • Plan, design, develop, and maintain API test automation framework that facilitates automation scripting, execution, and analysis of results • Provide technical leadership and mentoring for test engineers on multiple applications/projects onshore and offshore; train and mentor project team members to create, execute, analyze, and maintain automated regression suites • Coordinate with product owner to resolve open issues/enhancements/upgrades and understand the use of a specific functionality as needed • Develop automated functional scripts using tools such as Java, Karate, JMeter. • Perform exploratory and manual testing of the product suite as appropriate • Provide expertise in testing methodologies, best practices, and standards Technical Skills (Required) - Strong design and development skills in two or more of the following technologies and tools: Java (3-5 years) Cucumber(3-5 years), JBehave or other BDD testing frameworks • At least 8 years of test automation framework design • Strong experience in testing Webservices (REST APIs) • Proven experience developing test scripts, test cases, and test data • The ability to write queries in SQL or other relational databases • 3+ years of experience in developing scenario based performance testing using JMeter • Experience testing full stack and integration testing with 3rd parties • End-to-end system integration testing experience for software platforms (Desired) • Hands on experience with Python • Development experience in AWS Cloud technology • Experience in TDD, continuous integration, code review practice is strongly desired • Experience with Apigee or other API gateways is a plus • Experience with DevOps concepts and tools (e.g., CI/CD, Jenkins, Git) • At least 2 years working on an Agile team with a solid understanding of Agile/Lean practices • Understanding of a micro service Architecture • Experience load and performance testing • Strong documentation skills Soft Skills (Required) • Ability to adapt quickly to a complex environment • Pro-active, flexible and creative • Very strong communication skills and the ability to collaborate with developers and business users.
    $83k-111k yearly est. 1d ago
  • Senior Python Developer

    Systechcorp Inc.

    Data engineer job in Chicago, IL

    Design & build production-grade services and APIs (FastAPI / Django / Flask) using clean, well-tested Python. Architect scalable systems (microservices, event-driven patterns, async I/O, caching) with high availability and failover. Data & storage: model schemas; write efficient SQL; integrate with Postgres/MySQL, caching (Redis) Performance & reliability: profile (cProfile, py-spy), tune hot paths, apply back-pressure, circuit breakers, retries, and idempotency. Security & compliance: enforce authN/Z, secrets management, secure coding, dependency hygiene (SCA), and data protection. DevOps & quality: code reviews, automated testing (pytest), static typing (mypy/pyright), linting, and CI/CD best practices. Cloud & platform: containerize ; deploy to Kubernetes or serverless (Azure Functions); manage IaC (Terraform). Observability: instrument with OpenTelemetry; create actionable dashboards/alerts Minimum qualifications 10+ years of professional software engineering with Python in production. Deep expertise with at least one Python web framework (FastAPI, Django, or Flask) and modern async programming. Strong CS fundamentals: algorithms, data structures, and concurrency Proven experience designing distributed systems and event-driven architectures. Solid SQL/ORM experience (SQLAlchemy/Django ORM) and schema design. Mastery of testing (unit/integration/contract), CI/CD (GitHub /Azure DevOps), and release strategies. Hands-on with cloud (Azure), containers, Kubernetes, and infrastructure automation. Excellent communication; ability to lead cross-functional initiatives. Nice to have : Security background: OAuth2/OIDC, Key Vault/Secrets Manager, threat modeling, SDLC governance. FinTech domain experience Front-end familiarity (React) for API-consumer alignment.
    $83k-108k yearly est. 4d ago

Learn more about data engineer jobs

How much does a data engineer earn in Aurora, IL?

The average data engineer in Aurora, IL earns between $65,000 and $114,000 annually. This compares to the national average data engineer range of $80,000 to $149,000.

Average data engineer salary in Aurora, IL

$86,000

What are the biggest employers of Data Engineers in Aurora, IL?

The biggest employers of Data Engineers in Aurora, IL are:
  1. Addison Group
  2. Calamos Investments
  3. Kforce
  4. Calamos Recruiting
  5. Claritev
  6. Insight Global
  7. Resource 1, Inc.
Job type you want
Full Time
Part Time
Internship
Temporary