Data engineer jobs in Keller, TX

Technology Recovery Services provides subject matter expertise and direction on complex IT disaster recovery projects/initiatives and supports IT disaster recovery technical planning, coordination and service maturity working across IT, business resilience, risk management, regulatory and compliance. Summary of Essential Functions: Govern disaster recovery plans and procedures for critical business applications and infrastructure. Create, update, and publish disaster recovery related policies, procedures, and guidelines. Ensure annual updates and validations of DR policies and procedures to maintain readiness and resilience. Maintain upto-date knowledge of disaster recovery and business continuity best practices. Perform regular disaster recovery testing, including simulation exercises, incident response simulations, tabletop exercises, and actual failover drills to validate procedures and identify improvements. Train staff and educate employees on disaster recovery processes, their roles during incidents, and adherence to disaster recovery policies. Coordinates Technology Response to Natural Disasters and Aircraft Accidents Qualifications: Strong knowledge of Air vault and ransomware recovery technologies Proven ability to build, cultivate, and promote strong relationships with internal customers at all levels of the organization, as well as with Technology counterparts, business partners, and external groups Proficiency in handling operational issues effectively and understanding escalation, communication, and crisis management Demonstrated call control and situation management skills under fast paced, highly dynamic situations Knowledge of basic IT and Airline Ecosystems Understand SLA's, engagement process and urgency needed to engage teams during critical situations Ability to understand and explain interconnected application functionality in a complex environment and share knowledge with peers Skilled in a Customer centric attitude and the ability to focus on providing best-in-class service for customers and stakeholders Ability to execute with a high level of operational urgency with an ability to maintain calm, and work closely with a team and stakeholders during a critical situation while using project management skills Ability to present to C Level executives with outstanding communication skills Ability to lead a large group up to 200 people including support, development, leaders and executives on a single call Ability to effectively triage - be able to detect and determine symptom vs cause and capture key data from various sources, systems and people Knowledge of business strategies and priorities Excellent communication and stakeholder engagement skills. Required: 3 plus years of similar or related experience in such fields as Disaster Recovery, Business Continuity and Enterprise Operational Resilience. Working knowledge of Disaster Recovery professional practices, including Business Impact Analysis, disaster recovery plan (DRP), redundancy and failover mechanisms DR related regulatory requirement, and Business Continuity Plan exercises and audits. Ability to motivate, influence, and train others. Strong analytical skills and problem-solving skills using data analysis tools including Alteryx and Tableau. Ability to communicate technical and operational issues clearly to both technical and nontechnical audiences.

We are seeking a highly experienced Senior Data Engineer with deep expertise in modern data engineering frameworks and cloud-native architectures, primarily on AWS. This role focuses on designing, building, and optimizing scalable data pipelines and distributed systems. You will collaborate cross-functionally to deliver secure, high-quality data solutions that drive business decisions. Key Responsibilities Design & Build: Develop and maintain scalable, highly available AWS-based data pipelines, specializing in EKS/ECS containerized workloads and services like Glue, EMR, and Lake Formation. Orchestration: Implement automated data ingestion, transformation, and workflow orchestration using Airflow, NiFi, and AWS Step Functions. Real-time: Architect and implement real-time streaming solutions with Kafka, MSK, and Flink. Data Lake & Storage: Architect secure S3 data storage and govern data lakes using Lake Formation and Glue Data Catalog. Optimization: Optimize distributed processing solutions (Databricks, Spark, Hadoop) and troubleshoot performance across cloud-native systems. Governance: Ensure robust data quality, security, and governance via IAM, Lake Formation controls, and automated validations. Mentorship: Mentor junior team members and foster technical excellence. Requirements Experience: 7+ years in data engineering; strong hands-on experience designing cloud data pipelines. AWS Expertise: Deep proficiency in EKS, ECS, S3, Lake Formation, Glue, EMR, IAM, and MSK. Core Tools: Strong experience with Kafka, Airflow, NiFi, Databricks, Spark, Hadoop, and Flink. Coding: Proficiency in Python, Scala, or Java for building data pipelines and automation. Databases: Strong SQL skills and experience with relational/NoSQL databases (e.g., Redshift, DynamoDB). Cloud-Native Skills: Strong knowledge of Kubernetes, containerization, and CI/CD pipelines. Education: Bachelor's degree in Computer Science or related field.

IDR is seeking a Data Engineer to join one of our top clients for an opportunity in Coppell, TX. This role involves designing, building, and maintaining enterprise-grade data architectures, with a focus on cloud-based data engineering, analytics, and machine learning applications. The company operates within the technology and data services industry, providing innovative solutions to large-scale clients. Position Overview for the Data Engineer: Develop and maintain scalable data pipelines utilizing Databricks and Azure environments Design data models and optimize ETL/ELT processes for large datasets Collaborate with cross-functional teams to implement data solutions supporting analytics, BI, and ML projects Ensure data quality, availability, and performance across enterprise systems Automate workflows and implement CI/CD pipelines to improve data deployment processes Requirements for the Data Engineer: 8-10 years of experience on modern data platforms with a strong background in cloud-based data engineering Strong expertise in Databricks (PySpark/Scala, Delta Lake, Unity Catalog) Hands-on experience with Azure (AWS/GCP also acceptable IF Super strong in Databricks) Advanced SQL skills and strong experience with data modeling, ETL/ELT development and data orchestration Experience with CI/CD (Azure DevOps, GitHub Actions, Terraform, etc.) What's in it for you? Competitive compensation package Full Benefits; Medical, Vision, Dental, and more! Opportunity to get in with an industry leading organization. Why IDR? 25+ Years of Proven Industry Experience in 4 major markets Employee Stock Ownership Program Dedicated Engagement Manager who is committed to you and your success. Medical, Dental, Vision, and Life Insurance ClearlyRated's Best of Staffing Client and Talent Award winner 12 years in a row.

About Us Longbridge Securities, founded in March 2019 and headquartered in Singapore, is a next-generation online brokerage platform. Established by a team of seasoned finance professionals and technical experts from leading global firms, we are committed to advancing financial technology innovation. Our mission is to empower every investor by offering enhanced financial opportunities. What You'll Do As part of our global expansion, we're seeking a Data Engineer to design and build batch/real-time data warehouses and maintain data platforms that power trading and research for the US market. You'll work on data pipelines, APIs, storage systems, and quality monitoring to ensure reliable, scalable, and efficient data services. Responsibilities: Design and build batch/real-time data warehouses to support the US market growth Develop efficient ETL pipelines to optimize data processing performance and ensure data quality/stability Build a unified data middleware layer to reduce business data development costs and improve service reusability Collaborate with business teams to identify core metrics and data requirements, delivering actionable data solutions Discover data insights through collaboration with the business owner Maintain and develop enterprise data platforms for the US market Qualifications 7+ years of data engineering experience with a proven track record in data platform/data warehouse projects Proficient in Hadoop ecosystem (Hive, Kafka, Spark, Flink), Trino, SQL, and at least one programming language (Python/Java/Scala) Solid understanding of data warehouse modeling (dimensional modeling, star/snowflake schemas) and ETL performance optimization Familiarity with AWS/cloud platforms and experience with Docker, Kubernetes Experience with open-source data platform development, familiar with at least one relational database (MySQL/PostgreSQL) Strong cross-department collaboration skills to translate business requirements into technical solutions Bachelor's degree or higher in Computer Science, Data Science, Statistics, or related fields Comfortable working in a fast-moving fintech/tech startup environment Qualifications 7+ years of data engineering experience with a proven track record in data platform/data warehouse projects Proficient in Hadoop ecosystem (Hive, Kafka, Spark, Flink), Trino, SQL, and at least one programming language (Python/Java/Scala) Solid understanding of data warehouse modeling (dimensional modeling, star/snowflake schemas) and ETL performance optimization Familiarity with AWS/cloud platforms and experience with Docker, Kubernetes Experience with open-source data platform development, familiar with at least one relational database (MySQL/PostgreSQL) Strong cross-department collaboration skills to translate business requirements into technical solutions Bachelor's degree or higher in Computer Science, Data Science, Statistics, or related fields Comfortable working in a fast-moving fintech/tech startup environment Proficiency in Mandarin and English at the business communication level for international team collaboration Bonus Point: Experience with DolphinScheduler and SeaTunnel is a plus

W2 Contract to Hire Role with Monthly Travel to the Dallas Texas area We are looking for a highly skilled and independent Data Engineer to support our analytics and data science teams, as well as external client data needs. This role involves writing and optimizing complex SQL queries, generating client-specific data extracts, and building scalable ETL pipelines using Azure Data Factory. The ideal candidate will have a strong foundation in data engineering, with a collaborative mindset and the ability to work across teams and systems. Duties/Responsibilities:Develop and optimize complex SQL queries to support internal analytics and external client data requests. Generate custom data lists and extracts based on client specifications and business rules. Design, build, and maintain efficient ETL pipelines using Azure Data Factory. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions. Work with Salesforce data; familiarity with SOQL is preferred but not required. Support Power BI reporting through basic data modeling and integration. Assist in implementing MLOps practices for model deployment and monitoring. Use Python for data manipulation, automation, and integration tasks. Ensure data quality, consistency, and security across all workflows and systems. Required Skills/Abilities/Attributes: 5+ years of experience in data engineering or a related field. Strong proficiency in SQL, including query optimization and performance tuning. Experience with Azure Data Factory, with git repository and pipeline deployment. Ability to translate client requirements into accurate and timely data outputs. Working knowledge of Python for data-related tasks. Strong problem-solving skills and ability to work independently. Excellent communication and documentation skills. Preferred Skills/ExperiencePrevious knowledge of building pipelines for ML models. Extensive experience creating/managing stored procedures and functions in MS SQL Server 2+ years of experience in cloud architecture (Azure, AWS, etc) Experience with ‘code management' systems (Azure Devops) 2+ years of reporting design and management (PowerBI Preferred) Ability to influence others through the articulation of ideas, concepts, benefits, etc. Education and Experience: Bachelor's degree in a computer science field or applicable business experience. Minimum 3 years of experience in a Data Engineering role Healthcare experience preferred. Physical Requirements:Prolonged periods sitting at a desk and working on a computer. Ability to lift 20 lbs.

Plano TX- Nearby candidates only W2 Candidates Must Have: 5+ years of experience with data modeling, warehousing, analysis & data profiling experience and ability to identify trends and anomalies in the data Experience on AWS technologies like S3, AWS Glue, EMR, and IAM roles/permissions Experience with one or more query language (e.g., SQL, PL/SQL, DDL, SparkSQL, Scala) Experience working with relational database such as Teradata and handling both structured and unstructured datasets Data Modeling tools (Any of - Erwin, Power Designer, ER Studio) Preferred / Ideal to have - Proficiency in Python Experience with NoSQL, non-relational databases / data stores (e.g., object storage, document or key-value stores, graph databases, column-family databases) Experience with Snowflake and Databricks

Now Hiring: Senior Data Engineer (GCP / Big Data / ETL) Duration: 6 Months (Possible Extension) We're seeking an experienced Senior Data Engineer with deep expertise in Data Warehousing, ETL, Big Data, and modern GCP-based data pipelines. This role is ideal for someone who thrives in cross-functional environments and can architect, optimize, and scale enterprise-level data solutions on the cloud. Must-Have Skills (Non-Negotiable) 9+ years in Data Engineering & Data Warehousing 9+ years hands-on ETL experience (Informatica, DataStage, etc.) 9+ years working with Teradata 3+ years hands-on GCP and BigQuery Experience with Dataflow, Pub/Sub, Cloud Storage, and modern GCP data pipelines Strong background in query optimization, data structures, metadata & workload management Experience delivering microservices-based data solutions Proficiency in Big Data & cloud architecture 3+ years with SQL & NoSQL 3+ years with Python or similar scripting languages 3+ years with Docker, Kubernetes, CI/CD for data pipelines Expertise in deploying & scaling apps in containerized environments (K8s) Strong communication, analytical thinking, and ability to collaborate across technical & non-technical teams Familiarity with AGILE/SDLC methodologies Key Responsibilities Build, enhance, and optimize modern data pipelines on GCP Implement scalable ETL frameworks, data structures, and workflow dependency management Architect and tune BigQuery datasets, queries, and storage layers Collaborate with cross-functional teams to define data requirements and support business objectives Lead efforts in containerized deployments, CI/CD integrations, and performance optimization Drive clarity in project goals, timelines, and deliverables during Agile planning sessions 📩 Interested? Apply now or DM us to explore this opportunity! You can share resumes at ******************* OR Call us on *****************

Job Title: GCP Data Engineer Employment Type: W2/CTH Client: Direct We are seeking a highly skilled Data Engineer with strong expertise in Python, SQL, and Google Cloud Platform (GCP) services. The ideal candidate will have 6-8 years of hands-on experience in building and maintaining scalable data pipelines, working with APIs, and leveraging GCP tools such as BigQuery, Cloud Composer, and Dataflow. Core Responsibilities: • Design, build, and maintain scalable data pipelines to support analytics and business operations. • Develop and optimize ETL processes for structured and unstructured data. • Work with BigQuery, Cloud Composer, and other GCP services to manage data workflows. • Collaborate with data analysts and business teams to ensure data availability and quality. • Integrate data from multiple sources using APIs and custom scripts. • Monitor and troubleshoot pipeline performance and reliability. Technical Skills: o Strong proficiency in Python and SQL. o Experience with data pipeline development and ETL frameworks. • GCP Expertise: o Hands-on experience with BigQuery, Cloud Composer, and Dataflow. • Additional Requirements: o Familiarity with workflow orchestration tools and cloud-based data architecture. o Strong problem-solving and analytical skills. o Excellent communication and collaboration abilities.

Data Engineer (3-4 Years Experience) Remote / On-site - based on client needs ) Employment Type: Full-time ( Contract or Contract-to-Hire ) Experience Level: Mid-level (3-4 years) Company: Aaratech Inc 🛑 Eligibility: Open to U.S. Citizens and Green Card holders only. We do not offer visa sponsorship. 🔍 About Aaratech Inc Aaratech Inc is a specialized IT consulting and staffing company that places elite engineering talent into high-impact roles at leading U.S. organizations. We focus on modern technologies across cloud, data, and software disciplines. Our client engagements offer long-term stability, competitive compensation, and the opportunity to work on cutting-edge data projects. 🎯 Position Overview We are seeking a Data Engineer with 3-4 years of experience to join a client-facing role focused on building and maintaining scalable data pipelines, robust data models, and modern data warehousing solutions. You'll work with a variety of tools and frameworks, including Apache Spark, Snowflake, and Python, to deliver clean, reliable, and timely data for advanced analytics and reporting. 🛠️ Key Responsibilities Design and develop scalable Data Pipelines to support batch and real-time processing Implement efficient Extract, Transform, Load (ETL) processes using tools like Apache Spark and dbt Develop and optimize queries using SQL for data analysis and warehousing Build and maintain Data Warehousing solutions using platforms like Snowflake or BigQuery Collaborate with business and technical teams to gather requirements and create accurate Data Models Write reusable and maintainable code in Python (Programming Language) for data ingestion, processing, and automation Ensure end-to-end Data Processing integrity, scalability, and performance Follow best practices for data governance, security, and compliance ✅ Required Skills & Experience 3-4 years of experience in Data Engineering or a similar role Strong proficiency in SQL and Python (Programming Language) Experience with Extract, Transform, Load (ETL) frameworks and building data pipelines Solid understanding of Data Warehousing concepts and architecture Hands-on experience with Snowflake, Apache Spark, or similar big data technologies Proven experience in Data Modeling and data schema design Exposure to Data Processing frameworks and performance optimization techniques Familiarity with cloud platforms like AWS, GCP, or Azure ⭐ Nice to Have Experience with streaming data pipelines (e.g., Kafka, Kinesis) Exposure to CI/CD practices in data development Prior work in consulting or multi-client environments Understanding of data quality frameworks and monitoring strategies

W2 Contract Dallas, TX (Onsite) We are seeking an experienced Data Scientist to join our team in Dallas, Texas. The ideal candidate will have a strong foundation in machine learning, data modeling, and statistical analysis, with the ability to transform complex datasets into clear, actionable insights that drive business impact. Key Responsibilities Develop, implement, and optimize machine learning models to support business objectives. Perform exploratory data analysis, feature engineering, and predictive modeling. Translate analytical findings into meaningful recommendations for technical and non-technical stakeholders. Collaborate with cross-functional teams to identify data-driven opportunities and improve decision-making. Build scalable data pipelines and maintain robust analytical workflows. Communicate insights through reports, dashboards, and data visualizations. Qualifications Bachelor's or Master's degree in Data Science, Statistics, Computer Science, or a related field. Proven experience working with machine learning algorithms and statistical modeling techniques. Proficiency in Python or R, along with hands-on experience using libraries such as Pandas, NumPy, Scikit-learn, or TensorFlow. Strong SQL skills and familiarity with relational or NoSQL databases. Experience with data visualization tools (e.g., Tableau, Power BI, matplotlib). Excellent problem-solving, communication, and collaboration skills.

Must be local to TX Data Engineer - SQL, Python and Pyspark Expert (Onsite - Dallas, TX) Data Engineer with strong proficiency in SQL, Python, and PySpark to support high-performance data pipelines and analytics initiatives. This role will focus on scalable data processing, transformation, and integration efforts that enable business insights, regulatory compliance, and operational efficiency. Key Responsibilities Design, develop, and optimize ETL/ELT pipelines using SQL, Python, and PySpark for large-scale data environments Implement scalable data processing workflows in distributed data platforms (e.g., Hadoop, Databricks, or Spark environments) Partner with business stakeholders to understand and model mortgage lifecycle data (origination, underwriting, servicing, foreclosure, etc.) Create and maintain data marts, views, and reusable data components to support downstream reporting and analytics Ensure data quality, consistency, security, and lineage across all stages of data processing Assist in data migration and modernization efforts to cloud-based data warehouses (e.g., Snowflake, Azure Synapse, GCP BigQuery) Document data flows, logic, and transformation rules Troubleshoot performance and quality issues in batch and real-time pipelines Support compliance-related reporting (e.g., HMDA, CFPB) Required Qualifications 6+ years of experience in data engineering or data development Advanced expertise in SQL (joins, CTEs, optimization, partitioning, etc.) Strong hands-on skills in Python for scripting, data wrangling, and automation Proficient in PySpark for building distributed data pipelines and processing large volumes of structured/unstructured data Experience working with mortgage banking data sets and domain knowledge is highly preferred Strong understanding of data modeling (dimensional, normalized, star schema) Experience with cloud-based platforms (e.g., Azure Databricks, AWS EMR, GCP Dataproc) Familiarity with ETL tools, orchestration frameworks (e.g., Airflow, ADF, dbt)

Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. Headquartered in New Jersey, our workforce of 6,000+ Ascenders delivers solutions from around the globe. Ascendion is built differently to engineer the next. Ascendion | Engineering to elevate life We have a culture built on opportunity, inclusion, and a spirit of partnership. Come, change the world with us: Build the coolest tech for the world's leading brands Solve complex problems - and learn new skills Experience the power of transforming digital engineering for Fortune 500 clients Master your craft with leading training programs and hands-on experience Experience a community of change makers! Join a culture of high-performing innovators with endless ideas and a passion for tech. Our culture is the fabric of our company, and it is what makes us unique and diverse. The way we share ideas, learning, experiences, successes, and joy allows everyone to be their best at Ascendion. Title - Data Architect Duration - Contract to hire Required Qualifications: Knowledge on Finance Domain-regulatory reporting (GL) - (supporting data modeling within the financial team which is regularly doing AR/GL, etc) Need strong DW skills Experience/strong in Data modeling skills Developing and implementing data framework, reference models, data modeling (operational and analytical). Hands on expertise in leading definition, design, and deployment planning of data management strategies Hands on expertise in data modeling for operational, warehouse Understand business systems analysis, and process and data artifacts within an enterprise architecture framework Experience in implementing information security and data access control across all forms of data stores (RDBMS, Unstructured, File Stores etc.). Very Good understanding of underlying hardware architecture (process and storage) used by data stores (RDBMS and non-RDBMS). Strong in Designing & Development of Stored Procedure Knowledge of Control-M Plus Location - Plano TX Salary Range: The salary for this position is between $140k - $160k annually. Factors which may affect pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate. Benefits:The Company offers the following benefits for this position, subject to applicable eligibility requirements: [medical insurance] [dental insurance] [vision insurance] [401(k) retirement plan] [long-term disability insurance] [short-term disability insurance] [5 personal days accrued each calendar year. The Paid time off benefits meet the paid sick and safe time laws that pertains to the City/ State] [10-15 days of paid vacation time] [6 paid holidays and 1 floating holiday per calendar year] [Ascendion Learning Management System] This position is eligible for commissions in accordance with the terms of the Company's plan. Commissions for this position are estimated to be based on individual performance. Additionally, this role is also eligible for a bonus based on the achievement of mutually agreed KRAs. Want to change the world? Let us know. Tell us about your experiences, education, and ambitions. Bring your knowledge, unique viewpoint, and creativity to the table. Let's talk!

Our client is seeking a Senior Data Analytics Engineer (Customer Data) to join their team! This position is located in remote. Build, optimize, and maintain customer data pipelines in PySpark/Databricks to support CDP-driven use cases across AWS/Azure/GCP Transform raw and integrated customer data into analytics-ready datasets used for dashboards, reporting, segmentation, personalization, and downstream AI/ML applications Develop and enrich customer behavior metrics, campaign analytics, and performance insights such as: ad engagement, lifecycle metrics, retention Partner with Marketing, Sales, Product, and Data Science teams to translate business goals into metrics, features, and analytical data models Build datasets consumed by Power BI/Tableau dashboards (hands-on dashboard creation not required) Ensure high cluster performance and pipeline optimization in Databricks, including troubleshooting skewed joins, sorting, partitioning, and real-time processing needs Work across multiple cloud and vendor ecosystems such as: AWS/Azure/GCP; Hightouch or comparable CDP vendors Participate in the data ingestion and digestion phases, shaping integrated data into analytical layers for MarTech and BI Contribute to and enforce data engineering standards, documentation, governance, and best practices across the organization Desired Skills/Experience: 6+ years of experience in Data Engineering, Analytics Engineering, or related fields, including data modeling experience Strong Data Engineering fundamentals with the ability to design pipelines, optimize performance, and deliver real-time or near-real-time datasets Ability to deeply understand data, identifying gaps, designing meaningful transformations, and creating metrics with clear business context Understanding of how customer data moves through Customer Data Platforms (CDPs) and how to design pipelines that integrate with them Experience supporting Marketing, Customer Data, MarTech, CDP, segmentation, or personalization teams strongly preferred Hands-on experience required with: Databricks, PySpark, Python, SQL, Building analytics datasets for dashboards/reporting and customer behavior analytics or campaign performance insights Experience designing and implementing features that feed downstream AI or customer-facing applications Benefits: Medical, Dental, & Vision Insurance Plans Employee-Owned Profit Sharing (ESOP) 401K offered The approximate pay range for this position starting at $150-160,000+. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.

Job Title: Senior Lead Data Engineer Type: Full Time Our client is seeking a hands-on Senior Data Engineer to guide development teams in building scalable, cloud-native solutions. This leadership role combines technical expertise with mentoring, driving innovation across Agile teams to deliver high-impact applications using modern full-stack technologies. About the Role You'll lead developers focused on machine learning, microservices, and full-stack systems while collaborating with product managers to create robust, performant solutions. Stay ahead of tech trends, experiment with emerging tools, and contribute to engineering communities through mentoring and knowledge sharing. Key Responsibilities Design, develop, test, deploy, and support full-stack solutions across Agile teams. Lead engineering teams specializing in ML, distributed microservices, and cloud systems. Build with Java, Scala, Python, RDBMS/NoSQL databases, and cloud data warehouses like Redshift/Snowflake. Partner with product managers to deliver cloud-based applications powering exceptional user experiences. Perform unit testing and code reviews for rigorous design, clean code, and peak performance. Experiment with new technologies and mentor peers in internal/external tech communities. What You Bring Required Bachelor's degree in Computer Science, Engineering, or related field. 6+ years in application development. 2+ years with big data technologies. 1+ year with cloud platforms (AWS, Azure, Google Cloud). Preferred Master's degree. 9+ years in app dev (Python, SQL, Scala, Java). 4+ years public cloud, real-time streaming, NoSQL (MongoDB/Cassandra), data warehousing. 5+ years distributed tools (Hadoop, Spark, Kafka, etc.). 4+ years UNIX/Linux/shell scripting; 2+ years Agile practices.

Junior Data Engineer DESCRIPTION: BeaconFire is based in Central NJ, specializing in Software Development, Web Development, and Business Intelligence; looking for candidates who are good communicators and self-motivated. You will play a key role in building, maintaining, and operating integrations, reporting pipelines, and data transformation systems. Qualifications: Passion for data and a deep desire to learn. Master's Degree in Computer Science/Information Technology, Data Analytics/Data Science, or related discipline. Intermediate Python. Experience in data processing is a plus. (Numpy, Pandas, etc) Experience with relational databases (SQL Server, Oracle, MySQL, etc.) Strong written and verbal communication skills. Ability to work both independently and as part of a team. Responsibilities: Collaborate with the analytics team to find reliable data solutions to meet the business needs. Design and implement scalable ETL or ELT processes to support the business demand for data. Perform data extraction, manipulation, and production from database tables. Build utilities, user-defined functions, and frameworks to better enable data flow patterns. Build and incorporate automated unit tests, participate in integration testing efforts. Work with teams to resolve operational & performance issues. Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to. Compensation: $65,000.00 to $80,000.00 /year BeaconFire is an e-verified company. Work visa sponsorship is available.

KPI Partners is a 5 times Gartner-recognized data, analytics, and AI consulting company. We are leaders in data engineering on Azure, AWS, Google, Snowflake, and Databricks. Founded in 2006, KPI has over 400 consultants and has successfully delivered over 1,000 projects to our clients. We are looking for skilled data engineers who want to work with the best team in data engineering. Title: Senior Data Architect Location: Plano, TX (Hybrid) Job Type: Contract - 6 Months Key Skills: SQL, PySpark, Databricks, and Azure Cloud Key Note: Looking for a Data Architect who is Hands-on with SQL, PySpark, Databricks, and Azure Cloud. About the Role: We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team at KPI, working on challenging and multi-year data transformation projects. This is an excellent opportunity for a talented data engineer to play a key role in building innovative data solutions using Azure Native Services and related technologies. If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems, this role is for you. Key Responsibilities: Data Engineering: Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies. Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions. Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability. Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform. Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development. Must-Have Skills & Qualifications: Minimum 12+ years of overall experience in IT Industry. 4+ years of experience in data engineering, with a strong background in building large-scale data solutions. 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions) Proven expertise in SQL for querying, manipulating, and analyzing large datasets. Strong knowledge of ETL processes and data warehousing fundamentals. Self-motivated and independent, with a “let's get this done” mindset and the ability to thrive in a fast-paced and dynamic environment. Good-to-Have Skills: Databricks Certification is a plus. Data Modeling, Azure Architect Certification.

Infosys is seeking a Google Cloud (GCP) data engineer with experience in Github and python. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued. Required Qualifications: Candidate must be located within commuting distance of Richardson, TX or be willing to relocate to the area. This position may require travel in the US Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time At least 4 years of Information Technology experience. Experience working with technologies like - GCP with data engineering - data flow / air flow, pub sub/ kafta, data proc/Hadoop, Big Query. ETL development experience with strong SQL background such as Python/R, Scala, Java, Hive, Spark, Kafka Strong knowledge on Python Program development to build reusable frameworks, enhance existing frameworks. Application build experience with core GCP Services like Dataproc, GKE, Composer, Deep understanding GCP IAM & Github. Must have done IAM set up Knowledge on CICD pipeline using Terraform in Git. Preferred Qualifications: Good knowledge on Google Big Query, using advance SQL programing techniques to build Big Query Data sets in Ingestion and Transformation layer. Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data Knowledge on Airflow Dag creation, execution, and monitoring. Good understanding of Agile software development frameworks Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams. Experience and desire to work in a global delivery environment.

About Us: TheMathCompany or MathCo is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decisionmaking. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCo's proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO). At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'. Job Description: • Seeking an experienced Retail Big Data Modeling Architect to join our Data Modeling & Architecture team. • As a key member of this team, you will be designing and implementing robust data models that support our critical business functions, including supply chain optimization, customer loyalty programs, customer journey analysis, analytics reporting, and feature development for machine learning. • You will work closely with cross-functional teams, including data engineers, data scientists, business analysts, and stakeholders, to ensure data accuracy, consistency, and accessibility. • Your expertise will drive the development of scalable and efficient data solutions that empower our organization to make informed decisions and achieve strategic objectives As Data Modeling Architect, you will: • Design and develop conceptual, logical, and physical data models for various domains, including supply chain, customer, product, sales, and financial data. • Lead the development of data modelling standards, best practices, and guidelines. Develop end-to-end solution architectures for data-driven and AI-focused applications, ensuring alignment with business objectives and technology strategy • Mentor and guide junior data modelers, providing technical expertise and fostering their professional growth. • Design data models to support enterprise and operational reporting, enabling data-driven decision-making. • Collaborate with data scientists to develop features for machine learning models, ensuring data quality and accessibility. • Optimize data models for performance and scalability, supporting real time analytics and reporting. • Ensure data models comply with data governance policies and standards. Identify and define data quality checks and validation processes to maintain data integrity. • Implement data quality monitoring and reporting mechanisms. Collaborate with data stewards to resolve data quality issues Skills Required • Proven expertise in designing and implementing data models for supply chain, customer loyalty, customer journey, and analytics reporting. • Strong understanding of dimensional modelling, star schema, snowflake schema, and other data warehousing concepts. • Experience with NoSQL databases and big data technologies (e.g., Hadoop, Spark). • Proficiency in SQL and data modelling tools (e.g., ERwin, PowerDesigner, ER/Studio). • Knowledge of machine learning concepts and applications. • Experience with agile development methodologies. Solid understanding of data governance, security, privacy, and compliance standards. • Exceptional communication, presentation, and stakeholder management skills. • Experience working in agile project environments.

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree - a Larsen & Toubro Group company - combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit ******************** Job Title: Data Architect Work Location Dallas, Texas Job Description: The ideal candidate will have a good understanding of big data technologies data engineering and cloud computing DWH Projects with a focus on Azure Databricks Work closely with business stakeholders and other IT teams to understand requirements and define the scope for engagement with reasonable timeline Ensure proper documentation of architecture processes while ensuring compliance with security and governance standards Ensure best practices are followed by team in terms of code quality data security and scalability Stay updated with the latest developments in Databricks and associated technologies to drive innovation 12 years of experience along with 5 years of data Analytics project experience Experience with Azure Databricks notebook development and Delta Lake Good understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory Fabric Experience with ETLELT processes data warehousing and building data lakes SQL skills and familiarity with NoSQL databases Experience with CICD pipelines and version control systems like Git Soft Skills Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders Strong problem-solving skills and a proactive approach to identifying and resolving issues Leadership skills with the ability to manage and mentor a team of data engineers Power BI for dashboarding and reporting Microsoft Fabric for analytics and integration tasks Spark Streaming for processing real time data streams Over 12 years of IT experience including 4 years specializing in developing data ingestion and transformation pipelines using Databricks Synapse notebooks and Azure Data Factory Good understanding on different domain industries with respect to data Analytics project DWH projects Should be good in Excel and Power Point Good understanding and experience with Delta tables Delta Lake and Azure Data Lake Storage Gen2 Experience in building and optimizing query layers using Databricks SQL Familiarity with modern CICD practices especially in the context of Databricks and cloud native solutions Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”): Benefits and Perks: Comprehensive Medical Plan Covering Medical, Dental, Vision Short Term and Long-Term Disability Coverage 401(k) Plan with Company match Life Insurance Vacation Time, Sick Leave, Paid Holidays Paid Paternity and Maternity Leave The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation. Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting. LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.