Data Scientist
Data engineer job in Chicago, IL
The Aspen Group (TAG) is one of the largest and most trusted retail healthcare business support organizations in the U.S. and has supported over 20,000 healthcare professionals and team members with close to 1,500 health and wellness offices across 48 states in four distinct categories: dental care, urgent care, medical aesthetics, and animal health. Working in partnership with independent practice owners and clinicians, the team is united by a single purpose: to prove that healthcare can be better and smarter for everyone. TAG provides a comprehensive suite of centralized business support services that power the impact of five consumer-facing businesses: Aspen Dental, ClearChoice Dental Implant Centers, WellNow Urgent Care, Chapter Aesthetic Studio, and Lovet Pet Health Care. Each brand has access to a deep community of experts, tools and resources to grow their practices, and an unwavering commitment to delivering high-quality consumer healthcare experiences at scale.
As a reflection of our current needs and planned growth we are very pleased to offer a new opportunity to join our dedicated team as Data Scientist.
Join us as a Data Scientist and play a key role in shaping how patients access care across a growing network of brands including Aspen Dental, ClearChoice, WellNow, Chapter Aesthetic Studio, and Lovet. In this role, you won't just analyze data - you'll lead end-to-end initiatives that shape how we optimize revenue across offices, days, and even hours. From designing strategies, deploying solutions and building performance dashboards to partnering with data science on automation and collaborating with teams across Finance, Marketing, Product, Technology and Operations, you'll have a direct hand in driving measurable results.
This role is ideal for someone who excels at turning data into decisions, building repeatable processes, and uncovering insights that drive measurable improvements in revenue performance and patient access. You will lead initiatives across forecasting, scheduling optimization, demand modeling, capacity planning, and revenue strategy, while also shaping how analytics is delivered and scaled across the organization. If you're a builder who loves solving complex problems with data, operational logic, and automation, this opportunity is for you.
Essential Responsibilities:
Revenue Strategy & Optimization
Lead strategy development for optimizing revenue performance at the office, day, and hour level by leveraging forecasting, scheduling, and demand modeling - while balancing access for patients and operational efficiency.
Build analytical frameworks to support pricing, demand forecasting, scheduling, and access optimization.
Identify revenue opportunities through data-driven analysis of booking trends, cancellations, no-shows, and utilization.
Monitor and update demand and schedule availability through the analysis of historical and future booking trends, the pricing environment, industry capacity trends, competitive landscape, and other factors.
Analytics, Insights & Experimentation
Develop and maintain forecasting, demand models, dashboards, and scenario analyses.
Run experiments and structured tests to evaluate new operational and scheduling strategies.
Create clear, actionable insights that influence senior leaders and cross-functional partners.
Process Building & Automation
Map existing manual workflows and identify opportunities to automate recurring analyses or reporting.
Cross-Functional Leadership
Work closely with Operations, Finance, Product, Marketing, and Clinical teams to align strategies and execution.
Help shape and scale the function by building new playbooks, reports, and best practices.
Act as a subject matter expert in forecasting, demand modeling, and capacity optimization.
Qualifications (Skills-Based):
We welcome candidates with diverse academic and career pathways. You may have gained your skills through industry experience, coursework, certificates, or hands-on practice.
Experience/Education:
5+ years of experience in Revenue Management, Pricing, Operations Research, Supply/Demand Optimization (Airline, Travel, Healthcare, or multi-location service industries preferred).
Bachelor's degree in Business, Finance, Economics, Analytics, or Statistics required; Master's degree a plus.
Experience working alongside data science/engineering teams to automate and scale analytics processes.
Exceptional analytical, problem-solving, and communication skills - with the ability to influence senior stakeholders.
Detail-oriented, self-starter mindset with a passion for driving results.
Strong analytical and quantitative skills, with experience in forecasting, modeling, or optimization.
Strong technical proficiency in SQL and a modern BI platform (e.g., Tableau, Looker).
Familiarity with scripting (e.g., Python or R) or automation tools (e.g., DBT, Airflow) - not required, but helpful.
Additional Job Description:
Base Pay Range: $115,000 - $130,000, plus 10% annual bonus (Actual pay may vary based on experience, performance, and qualifications.)
A generous benefits package that includes paid time off, health, dental, vision, and 401(k) savings plan with match.
If you are an applicant residing in California, please view our privacy policy here: *********************************************************************************
Data Engineer
Data engineer job in Chicago, IL
Scaylor helps mid-market and enterprise companies make sense of their data. Most teams past $20M ARR are stuck with fragmented systems, old databases, and hundreds of spreadsheets that never quite line up. We build the pipelines that clean, normalize, and connect that data so it can actually be used.
Our platform handles everything from parsing financial models and reports to mapping tables across legacy databases and modern APIs. The goal is simple: give companies a single source of truth they can trust.
We're a small team of four - one backend engineer, one frontend engineer, and 2 founders. We're looking for our fifth teammate to help us scale the engine behind it all.
โธป
The Role
You'll work across data engineering and full-stack development, helping us build reliable data infrastructure that powers real workflows. You'll touch everything from ingestion and transformation pipelines to the APIs and dashboards that surface insights to clients.
You'll work directly with the founding team and help make technical decisions that define the next version of Scaylor's core platform.
โธป
What You'll Work On
โข Build data pipelines that extract, clean, and standardize information from Excel files, PDFs, APIs, and legacy databases
โข Design schemas and transformation logic for structured and semi-structured data
โข Develop and maintain backend APIs (Python/FastAPI or Node/Express) for data access and analytics
โข Help connect backend services to our frontend dashboards (React, Node.js, or similar)
โข Set up and maintain AWS infrastructure (Lambda, S3, ECS, CloudFormation)
โข Collaborate with clients to understand their data problems and design workflows that fix them
โธป
You'd Be Great Here If You
โข Have 3-6 years of experience in data engineering, backend, or full-stack roles
โข Write clean, maintainable code in Python + JS
โข Understand ETL, data normalization, and schema mapping
โข Have experience with SQL and working with legacy databases or systems
โข Are comfortable managing cloud services and debugging data pipelines
โข Enjoy solving messy data problems and care about building things that last
โธป
Nice to Have
โข Familiarity with GCP or SQL databases
โข Understanding of enterprise data flows (ERP, CRM, or financial systems)
โข Experience building and deploying containers (Docker, GitHub Actions, CI/CD)
โข Interest in lightweight ML or LLM-assisted data transformation
โธป
Why Join Scaylor
โข Be one of the first five team members shaping the product and the company
โข Work directly with the founder and help define Scaylor's technical direction
โข Build infrastructure that solves real problems for real companies
โข Earn meaningful equity and have a say in how the company grows
โธป
Compensation
โข $130k - $150k with a raise based on set revenue triggers
โข .4% equity
โข Relocation to Chicago, IL required
Data Architect
Data engineer job in Oak Brook, IL
GeoWealth is a Chicago-based fintech firm that offers an award-winning digital advisory platform, including Turnkey Asset Management Platform (โTAMPโ) capabilities. We deliver a comprehensive and fully integrated wealth management technology platform to professionals in the financial services industry.
OPPORTUNITY:
We're looking for a Data Architect to join our Engineering Team. In this role, you will oversee the overall data architecture, helping us deliver our best-in-class solutions to our customers. This role will be key in organizing, designing, and leading our team through well-designed data architecture. If you love architecting complex systems, delivering customer focused software, designing best-in-class systems and leading data architecture design this role is for you.
RESPONSIBILITIES:
Own data architecture and oversee data implementation
Set coding/implementation standards
Lead our data warehouse design
Deliver performant, maintainable, and quality software in collaboration with our teams.
Improve our database design to reduce replication and increase performance
Partner with other architects and engineers to produce better designed systems
SKILLS, KNOWLEDGE, AND EXPERIENCE:
5+ years of experience as Data Architect or equivalent role
Bachelor's degree in computer science or equivalent degree
Hands-on experience with Oracle
Designed and implemented data warehouse
Experience with the following is preferred but not required: designing and building monolithic and distributed systems, Postgres, Logi Symphony, PowerBI, Java and JIRA/Confluence
COMPANY CULTURE & PERKS - HIGHLIGHTS:
Investing in Your Growth ๐ฑ
Casual work environment with fun, hard-working, and open-minded coworkers
Competitive salary with opportunity for performance-based annual bonus
Opportunities to up-skill, explore new responsibilities, and network across departments
Defined and undefined career pathways allowing you to grow your own way
Work/Life Balance ๐๏ธ
Flexible PTO and work schedule to ensure our team balances work and life
Hybrid work schedule
Maternity and paternity leave
Taking Care of Your Future โฅ๏ธ
Medical, Dental, and Vision, Disability insurance
Free access to Spring Health, a comprehensive mental health solution
401(k) with company match and a broad selection of investments
Voluntary insurance: short-term disability, long-term disability, and life insurance
FSA and transit benefits for employees that contribute pre-tax dollars
Other Fun Stuff โญ
Free on-site gym and parking
Weekly catered lunches in the office, plus monthly happy hours
Stocked kitchen with snacks and drinks
GeoWealth was recognized as โBest Place to Workโ by Purpose Job's 2025, 2024 and 2022
GeoWealth was recognized as โBest Place to Workโ by Built In in 2024, 2023 and 2022
SALARY RANGE:
Starting at $170,000-$220,000 + Benefits + Opportunity for Performance Bonus
This is an estimated range based on the circumstances at the time of posting, however, may change based on a combination of factors, including but not limited to skills, experience, education, market factors, geographical location, budget, and demand.
Big Data Consultant
Data engineer job in Chicago, IL
Job Title: Bigdata Engineer
Employment Type: W2 Contract
Detailed Job Description:
We are seeking a skilled and experienced Big Data Platform Engineer who is having 7+ yrs of experience with a strong background in both development and administration of big data ecosystems. The ideal candidate will be responsible for designing, building, maintaining, and optimizing scalable data platforms that support advanced analytics, machine learning, and real-time data processing.
Key Responsibilities:
Platform Engineering & Administration:
โข Install, configure, and manage big data tools such as Hadoop, Spark, Kafka, Hive, HBase, and others.
โข Monitor cluster performance, troubleshoot issues, and ensure high availability and reliability.
โข Implement security policies, access controls, and data governance practices.
โข Manage upgrades, patches, and capacity planning for big data infrastructure.
Development & Data Engineering:
โข Design and develop scalable data pipelines using tools like Apache Spark, Flink, NiFi, or Airflow.
โข Build ETL/ELT workflows to ingest, transform, and load data from various sources.
โข Optimize data storage and retrieval for performance and cost-efficiency.
โข Collaborate with data scientists and analysts to support model deployment and data exploration.
Senior Data Engineer
Data engineer job in Chicago, IL
requires visa independent candidates.
Note: (OPT, CPT, H1B holders will not work at this time)
Design, develop, and maintain scalable ETL pipelines using AWSGlue
Collaborate with data engineers and analysts to understand data requirements
Build and manage data extraction, transformation, and loading processes
Optimize and troubleshoot existing Glue jobs and workflows
Ensure data quality, integrity, and security throughout the ETL process
Integrate AWS Glue with other AWS services like S3, Lambda, Redshift, and Step Functions
Maintain documentation of data workflows and processes
Stay updated with the latest AWS tools and best practices
Required Skills
Strong hands-on experience with AWS Glue, PySpark, and Python
Proficiency in SQL and working with structured/unstructured data (JSON, CSV, Parquet)
Experience with data warehousing concepts and tools
Familiarity with CI/CD pipelines, Terraform, and scripting (PowerShell, Bash)
Solid understanding of data modeling, data integration, and data management
Exposure to AWS Batch, Step Functions, and Data Catalogs
Data Scientist
Data engineer job in Chicago, IL
Minimum Qualifications:
โ 5+ years of experience leading data science projects that have a direct impact on a company's
objectives or PhD degree in quantitative fields such as Statistics, Data Science, Computer Science
with 3+ years of experience
โ 5+ years of experience utilizing data mining techniques, ML models to assist business decision
making. Hands-on experience with deep learning frameworks , LLMs, GenAI tools, and NLP
techniques.
โ Deep expertise in statistical methods and machine learning concepts, with the ability to mentor
team members on methodologies, model tuning, and evaluation techniques.
โ 2+ years hands-on experience with deep learning frameworks, LLMs, GenAI tools, and NLP
techniques.
โ 5+ years of experience using Python to process large, diverse datasets, and develop and deploy
predictive models in cloud-based environments and other computing platforms.
โ 5+ years of experience in SQL and cloud-hosted data platforms (Google Cloud Platform, AWS,
etc.).
โ Demonstrated ability to assist business decision-making through data mining and machine
learning.
โ Strong communication skills to collaborate effectively with business stakeholders. Must be able
to interact cross-functionally and drive both business and technical discussions.
โ Ability to translate complex business problems into actionable project plans and solve
Sr. Data Engineer - PERM - MUST BE LOCAL
Data engineer job in Naperville, IL
Resource 1 is in need of a Sr. Data Engineer for a full-time/ permanent position with our client in Naperville, IL. Candidate must be
local to Illinois
because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus.
This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products.
Responsibilities:
Design and develop scalable data pipelines for ingestion, transformation and integration using AWS services.
Pull data from PostgreSQL and SQL Server to migrate to AWS.
Create and modify jobs in AWS and modify logic in SQL Server.
Create SQL queries, stored procedures and functions in PostgreSQL and RedShift.
Provide input on data modeling and schema design as needed.
Manage infrastructure through infrastructure-as-code templates (Serverless Framework), supporting new data products and services in AWS.
Support inbound/ outbound data flows, including APIs, S3 replication and secured data.
Assist with data visualization/ reporting as needed.
Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints.
Qualifications:
5+ years of data engineering experience.
Experience with AWS and its associated array of offerings (Glue, Redshift, Athena, S3, Lambda, Spectrum).
Strong experience with SQL, Python and PySpark.
A background in supply chain, logistics or distribution would be a plus.
Experience with Power BI is a plus.
Data Engineer
Data engineer job in Chicago, IL
Job Title: Data Engineer - Workflow Automation
Employment Type: Contract to Hire or Full-Time
Department: Project Scion / Information Management Solutions
Key Responsibilities:
Design, build, and manage workflows using Automic or experience with similar tools like Autosys, Apache Airflow, or Cybermation.
workflow orchestration across multi-cloud ecosystems (AWS, Azure, Snowflake, Databricks, Redshift).
Monitor and troubleshoot workflow execution, ensuring high availability, reliability, and performance.
Administer and maintain workflow platforms.
Collaborate with architecture and infrastructure teams to align workflows with cloud strategies.
Support migrations, upgrades, and workflow optimization efforts
Required Skills:
Has 5+ years of experience in IT managing production grade system
Hands-on experience with Automic or similar enterprise workflow automation tools.
Strong analytical and problem-solving skills.
Good communication and documenting skills.
Familiarity with cloud platforms and technologies (e.g., AWS, Azure, Snowflake, Databricks).
Scripting proficiency (e.g., Shell, Python).
Ability to manage workflows across hybrid environments and optimize performance.
Experience managing production operations & support activities
Preferred Skills:
Experience with CI/CD pipeline integration.
Knowledge of cloud-native orchestration tools
Exposure to monitoring and alerting systems.
Data Engineer
Data engineer job in Chicago, IL
The Data Engineer will design, build, and optimize the data pipelines and models that support the firm's evolving research, analytics, and systematic portfolio construction environment. This role is central to enabling data-driven investment processes, including quantitative research, AI/ML capabilities, and front-office automation.
Candidates must have deep expertise with Snowflake, strong SQL skills, and experience integrating diverse datasets used across investment organizations. The role is highly collaborative and requires comfort working in an iterative, fast-moving environment where data needs evolve rapidly based on stakeholder input.
Responsibilities
Design, build, and enhance ETL/ELT pipelines in Snowflake, ensuring high performance, reliability, and scalability.
Integrate internal and external datasets, including pricing, research content, economic releases, market data, and security reference data.
Support real-time or near-real-time data flows where needed (e.g., pricing, indicative quotes, market-sensitive inputs).
Collaborate closely with Product Leads, Quant Developers, and UI/UX teams to ensure data structures meet the requirements of research workflows, analytical models, and user-facing applications.
Partner with front-office stakeholders to rapidly iterate on evolving analytical and data needs.
Implement data validation, monitoring, and quality frameworks to ensure accuracy and reliability across critical datasets.
Translate prototype pipelines into production-ready workflows with appropriate documentation, standards, and controls.
Contribute to data modeling standards, metadata frameworks, and data governance practices across the platform.
Requirements
10+ years of data engineering experience within investment management, financial technology, or similar data-intensive environments.
Expert-level SQL, including complex queries, schema design, and performance optimization.
Deep hands-on experience with Snowflake, including advanced features such as tasks, streams, performance tuning, and secure data sharing.
Strong Python capabilities for ETL/ELT development, data processing, and workflow automation.
Experience integrating APIs and working with structured, semi-structured, and unstructured datasets.
Familiarity with NLP or AI/ML-oriented datasets (e.g., textual research content, PDFs) is a plus.
Experience with Domino or willingness to work within a Domino-based model environment.
Working knowledge of investment data structures (holdings, benchmarks, pricing, exposures) is highly preferred.
Ability to thrive in a rapid prototyping environment with evolving requirements and close partnership with front-office teams.
Snowflake Data Engineer
Data engineer job in Chicago, IL
Join a dynamic team focused on building innovative data solutions that drive strategic insights for the business. This is an opportunity to leverage your expertise in Snowflake, ETL processes, and data integration.
Key Responsibilities
Develop Snowflake-based data models to support enterprise-level reporting.
Design and implement batch ETL pipelines for efficient data ingestion from legacy systems.
Collaborate with stakeholders to gather and understand data requirements.
Required Qualifications
Hands-on experience with Snowflake for data modeling and schema design.
Proven track record in developing ETL pipelines and understanding transformation logic.
Solid SQL skills to perform complex data transformations and optimization.
If you are passionate about building cutting-edge data solutions and want to make a significant impact, we would love to see your application!
#11290
Senior Data Architect
Data engineer job in Oak Brook, IL
We are seeking a highly skilled and strategic Senior Data Solution Architect to join our IT Enterprise Data Warehouse team. This role is responsible for designing and implementing scalable, secure, and high-performing data solutions that bridge business needs with technical execution. Design solutions for provisioning data to our cloud data platform using ingestion, transformation, and semantic layer techniques. Additionally, this position provides technical thought leadership and guidance to ensure that data platforms and pipelines effectively support ODS, analytics, reporting, and AI initiatives across the organization.
Key Responsibilities:
Architecture & Design:
Design end-to-end data architecture solutions including operational data stores, data warehouses, and real-time data pipelines.
Define standards and best practices for data modeling, integration, and governance.
Evaluate and recommend tools, platforms, and frameworks for data management and analytics.
Collaboration & Leadership:
Partner with business stakeholders, data engineers, data analysts, and other IT teams to translate business requirements into technical solutions.
Lead architecture reviews and provide technical guidance to development teams.
Advocate for data quality, security, and compliance across all data initiatives.
Implementation & Optimization
Oversee the implementation of data solutions, ensuring scalability, performance, and reliability.
Optimize data workflows and storage strategies for cost and performance efficiency.
Monitor and troubleshoot data systems, ensuring high availability and integrity.
Required Qualifications:
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or related field.
7+ years of experience in data architecture, data engineering, or related roles.
Strong expertise in cloud platforms (e.g., Azure, AWS, GCP) and modern data stack tools (e.g., Snowflake, Databricks).
Proficiency in SQL, Python, and data modeling techniques (e.g. Data Vault 2.0)
Experience with ETL/ELT tools, APIs, and real-time streaming technologies (e.g., dbt, Coalesce, SSIS, Datastage, Kafka, Spark).
Familiarity with data governance, security, and compliance frameworks
Preferred Qualifications:
Certifications in cloud architecture or data engineering (e.g., SnowPro Advanced: Architect).
Strong communication and stakeholder management skills.
Why Join Us?
Work on cutting-edge data platforms and technologies.
Collaborate with cross-functional teams to drive data-driven decision-making.
Be part of a culture that values innovation, continuous learning, and impact.
** This is a full-time, W2 position with Hub Group - We are NOT able to provide sponsorship at this time **
Salary: $135,000 - $175,000/year base salary
+ bonus eligibility
This is an estimated range based on the circumstances at the time of posting, however, may change based on a combination of factors, including but not limited to skills, experience, education, market factors, geographical location, budget, and demand
Benefits
We offer a comprehensive benefits plan including:
Medical
Dental
Vision
Flexible Spending Account (FSA)
Employee Assistance Program (EAP)
Life & AD&D Insurance
Disability
Paid Time Off
Paid Holidays
BEWARE OF FRAUD!
Hub Group has become aware of online recruiting related scams in which individuals who are not affiliated with or authorized by Hub Group are using Hub Group's name in fraudulent emails, job postings, or social media messages. In light of these scams, please bear the following in mind
Hub Group will never solicit money or credit card information in connection with a Hub Group job application.
Hub Group does not communicate with candidates via online chatrooms such as Signal or Discord using email accounts such as Gmail or Hotmail.
Hub Group job postings are posted on our career site: ********************************
About Us
Hub Group is the premier, customer-centric supply chain company offering comprehensive transportation and logistics management solutions. Keeping our customers' needs in focus, Hub Group designs, continually optimizes and applies industry-leading technology to our customers' supply chains for better service, greater efficiency and total visibility. As an award-winning, publicly traded company (NASDAQ: HUBG) with $4 billion in revenue, our 6,000 employees and drivers across the globe are always in pursuit of "The Way Ahead" - a commitment to service, integrity and innovation. We believe the way you do something is just as important as what you do. For more information, visit ****************
Data Architect - Pharma
Data engineer job in Chicago, IL
MathCo
Role - Data/AI Engineering Manager
Onsite - Chicago - 4 days in office (Mandatory)
Industry - Pharma (Mandatory)
As platform architect/owner, you will:
Lead the end-to-end architecture, lifecycle, and governance of the AI/Analytics platform, defining standards, reusable components, and integration patterns.
Partner with AI/Data architects to enable scalable model deployment and enhance agentic orchestration.
Translate business needs into platform features, manage onboarding, documentation, and cross-functional collaboration for platform adoption.
Oversee infrastructure-as-code, CI/CD, observability, and containerized environments to ensure reliability and scalability.
Evaluate complex technical proposals and develop actionable platform roadmaps and architecture recommendations
Stay current on key AI platform developments and assess their impact on architecture and client strategy
Coach others, recognize their strengths, and encourage them to take ownership of their personal development
Skills Required
Experience in designing, architecting, or managing distributed data and AI platforms in cloud environments (AWS, Azure, or GCP)
Proven ability to carry out complex Proof of Concept (POC), pilot projects, and limited production rollouts for AI use-cases, focusing on developing new or improved techniques and procedures.
Strong skills in pipeline/workflow optimization and data processing frameworks to evaluate architectural choices
Years of Experience
Minimum of 8 years in relevant experience, preferably with a consulting
background and experience with Pharma clients
Data Architect (US Citizen or Green Card Only)
Data engineer job in Chicago, IL
Must Have Skills:
โข Snowflake
โข Azure
โข GCP
โข Python
Nice to Have Skills:
โข SQL
โข Kafka
โข PBI
Detailed Job Description:
Responsibilities
โข Interact & Influence business stakeholders to secure strong engagement and ensures that the data & analytical product delivery aligns with longer-term strategic roadmaps
โข Design & contribute towards the structure and layout of lake house architecture optimizing data storage, and establishing data access controls and security measures
โข Implement the long-term Data & Analytics strategy and deliver functional objectives
โข Assess requirement feasibility, translates high-level business requirements into data requirements, appropriate metadata, test data, and data quality standards
โข Explore Data Sources by working with Application owners to confirm datasets to be extracted
โข Contribute to establishing and implementing database structure, including schema design, table definitions, column specifications, and naming conventions
โข Design Data models for Source data products, Master data products & Insight data products.
โข Document Data Architecture artifacts for different Data Products and solutions and perform peer review across various functions.
โข Support Data Engineering and BI Engineering teams during the build phase
Review Data models development, validate and provide deployment approval
โข Work closely with data stewards and governance functions to continuously improve data quality and enhance the reliability of data model(s).
โข Simplify the existing data architecture, delivering reusable services and cost-saving opportunities in line with the policies and standards of the company
โข Leads and participates in the peer review and quality assurance of project architectural artifacts across the Data Architecture group through governance forums
โข Collaborate and contribute to the development and enhancement of standards, guidelines, and best practices within Data Architecture discipline.
โข Works with Product owners, Business stewards, Data Scientists and end users to understand data consumers' needs and develop data products/ data solutions
โข Evaluates and recommends emerging technologies for data management, storage, and analytics
Senior Back End Developer - Distributed Systems (C# or Golang)
Data engineer job in Chicago, IL
Our client, a fast-growing organization developing secure, scalable technologies for next-generation AI applications, is seeking a Backend Engineer to join their core platform team.
In this role, you'll help build and refine the foundational services that power authentication, observability, data flows, and high-availability systems across a distributed ecosystem. This is an opportunity to work on complex backend challenges while shaping the infrastructure that supports mission-critical applications.
What You'll Do
Develop, enhance, and support backend services that form the foundation of the platform.
Build and maintain core authentication and authorization capabilities.
Apply principles of Domain-Driven Design to guide how services and components evolve over time.
Architect, extend, and support event-sourced systems to ensure durable, consistent operations at scale.
Participate in API design and integration efforts across internal and external stakeholders.
Implement and support messaging frameworks (e.g., NATS) to enable reliable service-to-service communication.
Maintain and improve observability tooling-including metrics, tracing, and logging-to ensure healthy system performance.
Work closely with infrastructure, DevOps, and engineering teams to ensure robust, secure, and maintainable operations.
What You Bring
3-6+ years of experience as a backend engineer.
Strong knowledge of distributed systems and microservices.
Proficiency in at least one modern backend programming language (C#, Go, Rust, etc.).
Practical experience with IAM concepts and authentication/authorization frameworks.
Exposure to event-sourcing patterns, DDD, and common messaging systems (e.g., NATS, Kafka, SNS, RabbitMQ).
Familiarity with Redis or similar in-memory caching technologies.
Experience working with observability tools such as Prometheus, Jaeger, ELK, or Application Insights.
Understanding of cloud-native environments and deployment workflows (AWS, Azure, or GCP).
Why This Role Is Compelling
You'll contribute directly to a foundational platform used across an entire organization-impacting performance, reliability, and security at every layer. If you enjoy solving distributed-system challenges and working on complex, high-scale backend services, this is a strong match.
#BackendEngineering #DistributedSystems #PlatformEngineering #CloudNative #SoftwareJobs
Lead DevOps Engineer
Data engineer job in Chicago, IL
Qorali is seeking a Lead DevOps Engineer to drive the evolution of our cloud and automation strategy. In this role, you'll own the design and delivery of enterprise-scale cloud infrastructure, lead mission-critical DevOps initiatives, and mentor engineers across the organization.
We're looking for a hands-on technical leader with deep expertise in AWS, Kubernetes, CI/CD pipelines, Terraform, and Kafka - someone who thrives on solving complex challenges and setting best practices for scalable, secure, and resilient systems.
Key Responsibilities
Architect and implement highly available, automated cloud solutions on AWS.
Build and optimize CI/CD pipelines to accelerate software delivery.
Design, deploy, and manage containerized workloads with Kubernetes.
Lead Kafka platform operations to support real-time, high-throughput applications.
Champion infrastructure-as-code with Terraform, driving automation and repeatability.
Provide technical leadership, mentoring, and serve as escalation point for critical issues.
Collaborate with development, security, and operations teams to deliver end-to-end DevOps solutions.
Qualifications
7+ years of experience in DevOps, cloud engineering, or infrastructure automation.
Proven expertise in AWS, Kubernetes, Terraform, CI/CD (Jenkins/GitHub Actions), Python and Kafka.
Experience with configuration management (Ansible, Puppet, or Chef).
Strong understanding of cloud security, compliance frameworks (CIS, NIST), and high-availability design.
Demonstrated leadership experience, guiding technical teams and influencing DevOps best practices.
Compensation & Benefits
$150-180k base salary + 15% bonus
22+ days PTO
Health, vision, dental & life insurance
6% 401k matching
Location: Hybrid, Chicago or Dallas
DevOps Cloud Engineer
Data engineer job in Chicago, IL
Duties: You will be responsible for: (1) Designing, deploying, securing, and managing enterprise cloud and hybrid infrastructure across compute, storage, database, networking, and security domains using services within Amazon Web Services (including EC2, Lambda, S3, RDS, VPC, IAM, and related technologies); (2) Implementing and maintaining Infrastructure as Code (IaC) using tools such as GitHub, Pulumi, or AWS CloudFormation to automate provisioning, configuration, and lifecycle management; (3) Continuously evaluating and optimizing AWS environments to ensure performance, availability, scalability, cost efficiency, and operational stability; (4) Designing, building, and maintaining CI/CD pipelines using GitHub Actions, AWS CodePipeline, or Jenkins, including integration of automated testing, security scanning, and compliance checks (e.g., Orca Security or similar tools); (5) Leveraging automation and AI-based tools to strengthen the efficiency and intelligence of CI/CD and DevOps processes; (6) Implementing security best practices across identity and access management, network architecture, encryption, monitoring, logging, and incident response in coordination with the Information Security team; (7) Supporting vulnerability management, incident response, remediation, and follow-up to ensure secure and compliant cloud operations; (8) Setting up and maintaining monitoring, logging, alerting, and SIEM integrations using platforms such as AWS CloudWatch, LogicMonitor, Splunk, or Orca Security; (9) Troubleshooting infrastructure, networking, and deployment issues across hybrid environments and participating in weekly on-call rotation for production support; (10) Managing Windows and Linux patching, BC/DR capabilities, and policy governance using AWS Systems Manager, Cloud Custodian, and related tooling; (11) Collaborating with developers, system administrators, engineers, and business stakeholders to design and deliver reliable and secure cloud solutions; (12) Evaluating, recommending, and implementing new tools, frameworks, and automation opportunities to enhance performance, availability, security, and operational maturity; (13) Documenting system standards, architecture diagrams, operating procedures, and best practices to ensure alignment, maintainability, and operational excellence; (14) Contributing to a culture of collaboration, agility, innovation, continuous improvement, and cross-team partnership.
Required:
****Critical Note: This is NOT a traditional DevOps Cloud Engineer and traditional DevOps Cloud Engineers should not invest time in applying. The requirements for consideration are shared specifically below this critical note, but to provide important and essential insight for you to be considered, the following is being shared:
ALL applicants must have hands-on experience at some point in their professional work experience foundational or traditional IT infrastructure skills---not cloud based (e.g. actual non-cloud based system administration, network engineering/administration, firewalls/security) with background/experience in building/administering/engineering/supporting/operating either on-premises or hybrid IT infrastructures, who grew into more of the DevOps space, would be highly preferred versus a pure cloud-only person.
Required:
A completed and verifiable Bachelor's degree in Computer Science, Information Systems, or a related STEM field is required.
Must have 3 or more years of professional Dev/Ops and Cloud Engineering experience with Prior experience as a Systems Engineer, Systems Adminstration, or Network Engineer with pater exeperience in DevOps practices, cloud automation, and modern infrastructure. Both components of this requirement are an absolute must have.
Must have strong, hands-on expertise with AWS compute, storage, networking, database, serverless, and security services, including EC2, Lambda, S3, RDS, CloudFormation, VPC, IAM, and container services such as ECS/EKS.
Must have experience building and managing Infrastructure as Code using Pulumi, Terraform, AWS CloudFormation, and scripting languages such as Python, Bash, or Node.js.
Must have hands-on experience administering and developing CI/CD pipelines using GitHub Actions, AWS CodeCommit/CodePipeline, or equivalent automation platforms.
Must have working knowledge of networking technologies including routing, switching, VPNs, firewalls, and network security principles, along with experience managing hybrid connectivity.
Must have familiarity with IAM, SIEM, SASE, and the integration of security within CI/CD pipelines.
Must have experience with monitoring and observability tools such as AWS CloudWatch, LogicMonitor, Splunk, Orca Security, or similar enterprise platforms.
Must demonstrate strong communication skills, the ability to work closely with peers and stakeholders, and the ability to operate effectively in a fast-paced, dynamic environment.
Pluses: AWS certifications such as AWS Certified Solutions Architect - Associate or AWS Certified DevOps Engineer - Associate. Experience in financial services or other regulated industries. Experience supporting governance, compliance, or cloud security programs.
Azure Cloud & DevOps Engineer
Data engineer job in Chicago, IL
๐ฑ Azure Cloud & DevOps Engineer
๐ Chicago, IL | ๐ข Hybrid | ๐ผ Full-Time
At Sprocket Sports, We are currently seeking an Azure Cloud & DevOps Engineer to join our Team. The ideal candidate has a passion for youth sports and managing a best-in-class software platform that will be used by thousands of youth sports club administrators, coaches, parents and players.
About Sprocket
Sprocket Sports is a fast-growing technology company based in Chicago and a national leader in the youth sports space. Our software and services help clubs streamline operations, reduce costs, and grow faster, so they can focus on what really matters: kids playing sports. We're also proud to be a certified Great Place to Work 2024, with a culture that balances high standards, accountability, and fun.
What You'll Do
As an experienced DevOps / cloud engineer you will help us scale and maintain a high-performing, reliable, and cost-effective cloud infrastructure. As an Azure Cloud Engineer, you will be the backbone of our cloud infrastructure, ensuring our platform is always available, fast, and secure for our users. You will manage our resources in Microsoft Azure, focusing heavily on performance optimization, cost control, and proactive system health monitoring. This role is perfect for someone passionate about cloud technology, DevOps principles, and continuous improvement. In this role you will interact with our software engineers, product managers and occasionally with operational stakeholders. We are seeking individuals who like to think creatively and have a passion for continually improving the platform.
Responsibilities:
Core Azure Cloud Management
Resource & Cost Optimization:
Manage, provision, and maintain our complete suite of Azure resources (e.g., App Services, Azure Functions, AKS, VMs).
Proactively manage and reduce cloud costs by identifying and implementing efficiencies in resource utilization and recommending right-sizing strategies.
Security and Compliance:
Ensure security best practices are implemented across all Azure services, including network segmentation, access control (IAM), and patching.
Performance & Reliability Engineering (SRE Focus)
System Health and Monitoring:
Ongoing monitoring of application and system performance using Azure and DataDog to detect and diagnose issues before they impact users.
Review system logs, metrics, and tracing data to identify areas of concern, bottlenecks, and opportunities for performance tuning.
Performance Testing
Lead efforts to conduct load testing and performance testing on the system.
Database Performance Tuning:
Review and optimize SQL performance by analyzing query plans, identifying slow-running queries, and recommending improvements (indexing, schema changes, stored procedures).
Manage and monitor our Azure SQL Database resources for optimal health and throughput.
Incident Response: Participate in on-call rotation to provide 24/7 support for critical infrastructure incidents and drive root cause analysis (RCA).
DevOps Automation
Infrastructure as Code (IaC):
Implement Infrastructure-as-Code (ARM, Bicep, or Terraform) to maintain consistent, auditable deployments.
Continuous Integration / Continuous Delivery (CI/CD):
Work closely with the development team to automate and streamline deployment pipelines (CI/CD) using Azure DevOps, ensuring fast and reliable releases.
Configuration Management: Implement and manage configuration for applications and infrastructure.
What We're Looking For:
Bachelor's degree in a Computer Science or related field.
3+ years of professional experience in Cloud Engineering, DevOps, or a similar role, with a strong focus on Microsoft Azure.
Deep hands-on experience with core Azure services and strong networking fundamentals.
Solid experience with monitoring and observability platforms, specifically DataDog.
Scripting proficiency in PowerShell.
Demonstrated ability to analyze and optimize relational database performance (SQL/T-SQL).
Strong problem-solving skills.
Strong communication and interpersonal skills; ability to analytically defend design decisions and take feedback without ego.
Strong attention to detail and accountability.
Why Join Us?
โ
Certified Great Place to Work 2024
๐ค Mission-driven team with a big vision
๐ Fast-growing startup with room to grow
๐ผ Competitive salary + equity
๐ 401(k) with company match
๐ฉบ Comprehensive medical and dental
๐ A culture built on Higher Standards, Greater Accountability, and More Fun
Azure Devops Engineer
Data engineer job in Chicago, IL
Set up CI/CD pipelines to support automated deployment of resources to Cloud environments, all at medium to high level of complexity
ยท This is a hands-on role that develops and supports build and release automation pipelines. You will be part of the team that will deploy a highly available full software stack in public/ private clouds
ยท Remediate gaps and support the automation requirements of continuous integration and continuous deployment
ยท Identify and develop metrics and dashboards to monitor adoption and maturity of DevOps
ยท Experience in Docker/Containerization and Kubernetes
ยท Ability to contribute to architecture discussions around technology controls and their implementation in a DevOps/Cloud environment
ยท Work collaboratively with architecture, security and other engineers to estimate, design, code, deploy and support working software / technology components
ยท Foster the adoption of DevSecOps culture and capabilities across Agile product delivery teams
ยท Embed โshift-leftโ security practices using tools like Checkmarx, SonarQube, PrismaCloud.
ยท Work in an Agile/Scrum environment; planning, estimating, and completing tasks on
ยท Liaison with Agile Delivery Process teams to support necessary configurations/setup in Azure DevOps (ADO) for Agile ceremonies
Champion Modern SDLC by leading the consistent application of the redesigned SDLC framework, aligning with Agile, DevSecOps, and platform standards
ยท Work with development and support teams to design improved deployment, provisioning and integration workflows, ensure environments stability and identify areas and plans for improvement
ยท Contribute to new technology, vendor package and tool road mapping, evaluation and introduction
Ensure compliance with Performance, Security, Availability, Recoverability standards and policies and provide Monitoring recommendations for tasks of low to medium level of complexity
ยท 5+ years of demonstrable software engineering and DevOps experience
ยท 5+ years working in SCRUM/Agile software development environment
ยท Experience deploying and administering Continuous integration tools such as Azure DevOps, is a must
ยท Experience with Infrastructure cloud tools such as Terraform, Docker, and Aspire etc.
ยท Experience with automated testing solutions for unit testing, integration and system testing
ยท Bachelor's Degree or equivalent experience. Computer Science or related field preferred.
ยท Strong cloud engineering experience primarily with Azure and AWS.
ยท Experience in working with Terraform, Ansible, and/or Chef for infrastructure automation and configuration
ยท Experience with Docker and Kubernetes on platforms such as AWS ECS and AWS EKS
ยท Experience with programming languages such as Python, Poweshell, and C++ is a plus
ยท Experience with APM, monitoring and logging tools such as Datadog, Solarwinds, Cloud watch and Splunk
ยท Experience with SQL databases such as MySQL and , NoSQL databases like AWS Dynamo DB and MongoDB, graph DB such as Neo4J, AWS Neptune.
Experience with project management and workflow tools and concepts such as Jira, Agile, Scrum/Kanban, etc.
ยท Proficiency in cross-platform scripting language and build tools (Python,ANT,Artifactory, MS Build,NuGet)
ยท Proficiency in OOP software development using C# or similar languages
ยท Ability to define scalable and secure CI/CD pipelines
ยท Understanding of deployment strategies using Docker and Podman for containerization
ยท Experience with pair programming using GitHub Copilot
Strong communication/presentation skills and ability to explain standards, processes, and cloud architecture with team and management.
Lead Principal Java Scala Blockchain Software Engineer
Data engineer job in Chicago, IL
This is not a C2C role, permanent W2 direct-hire only***
is bonus eligible***
Prestigious Financial Institution is currently seeking a Lead Principal Software Java Engineer, with Scala and Blockchain experience. Candidate will be responsible for the development and delivery of business features, integrating a variety of upstream data sources and presenting data through the user interface, all while enriching and advancing the platform. This software must achieve a blend of data-rich presentation, performance, user experience, and the capacity to support the busiest trading days in the world economy with rock-solid reliability. The candidate must be able to solve problems creatively, communicate effectively, and proactively engage in technical decision making to achieve these objectives.
Responsibilities:
Working alongside experts that are building next generation blockchain-based securities lending system, and paving the future of digital transformation in the capital markets industry
Collaborating with others to deliver complex projects which may involve multiple systems
Continuously thinking about the next steps while improving yourself and others around you
Developing solutions to complex technical challenges while coding, testing, troubleshooting, debugging, and documenting the systems you develop
Optimizing application performance through analysis, code refactoring, and system tuning
Recommending technologies and tools that improve the efficiency and quality of the systems and development processes.
Qualifications:
[Required] 2+ years of development experience with Scala
[Required] 7+ years of experience in software development
[Required] 5+ years of experience in Java or related technologies
[Required] 3+ years of experience in react js or similar technologies
[Required] 1+ years of experience with distributed application design & blockchain
[Required] Experience with Akka or other actor-based systems
[Required] Experience with Devops and CICD tools (GIT, Jenkins, Docker, Kubernetes, Harness, Rancher)
[Required] Ability to write clean, bug-free code that is easy to understand and easily maintainable
[Required] Experience with BDD methodologies & automated acceptance testing
Technical Skills & Background:
[Required] Scala-based software development experience
[Required] Web/mobile application development experience
[Required] Understanding of message brokers, Queues and distributed datastores (Kafka, MQ, Redis, Splunk)
[Required] Experience working Unix/Linux environments, large software system development, security software development, public-cloud platforms
[Required] Fluent in functional programming, object-oriented design, industry best practices, software patterns, and architecture principles
[Required] Proficient in the following types of testing: unit, integration, system, functional, non-functional, regression, performance, security, and acceptance
[Required] Deep understanding of performance issues and multi-threaded development
[Required] Experience with continuous integration tools and techniques, automating processes, and writing scripts using Python and other languages.
Education:
[Required] BS degree in Computer Science, similar technical field required
[Preferred] Masters preferred
Senior Java Software Engineer
Data engineer job in Chicago, IL
We are looking for a Java Developer to analyse, design, code, and test Java/HTML/CSS/SQL code and web applications.
What You'll Do
Analyse business requirements to determine appropriate technology solutions
Write code, complete programming, perform testing, and debugging of web applications
Design and implement web services
Create SQL queries and database objects
Work with non-technical end users as needed
Follow department standards and methodologies
Interact and communicate effectively with all levels of staff, senior management, and customers
Provide ad-hoc reporting and analysis as required
What You'll Need
React and Unit testing for this one is a must.
Required:
9 years of experience with Java 8, 11, and higher versions
5 years of experience with React and Unit Testing
6 years of experience with SQL
6 years of experience with JavaScript
6 years of experience with CSS
5 years of experience with Bootstrap
5 years of experience with JPA (Java Persistence API)
5 years of experience with JQuery
5 years of experience with Spring Framework (including MVC)
Experience in agile development processes, especially Scrum
Excellent communication and interpersonal skills
Ability to work well individually and in a team environment
Preferred:
6 years of experience with Eclipse IDE
5 years of experience with AWS Cloud (CodeCommit, CodeBuild, CodePipeline, etc.)
3 years of experience with Apache Tomcat/TomEE
3 years of experience with JUnit & Selenium
3 years of experience with Python
3 years of experience with Jira & Confluence