Data Engineer
Data engineer job in Hamilton, NJ
Key Responsibilities:
Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
Manage FTP/SFTP file transfers between internal systems and external vendors.
Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.
Required Skills & Experience:
10+ years of experience in data engineering or production support within financial services or trading environments.
Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
Strong Python and SQL programming skills.
Experience with Bloomberg data feeds (BPIPE, TSIP,SFTP).
Experience with Git, CI/CD pipelines, and Azure DevOps.
Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling.
Experience handling FTP/SFTP file transfers and automation (e.g., using scripts or managed file transfer tools).
Solid understanding of equities trading, fixed income trading, trading workflows, and financial instruments.
Excellent communication, problem-solving, and stakeholder management skills.
Data Engineer
Data engineer job in Philadelphia, PA
Data Engineer - Job Opportunity
Full time Permanent
Remote - East coast only
Please note this role is open for US citizens or Green Card Holders only
We're looking for a Data Engineer to help build and enhance scalable data systems that power analytics, reporting, and business decision-making. This role is ideal for someone who enjoys solving complex technical challenges, optimizing data workflows, and collaborating across teams to deliver reliable, high-quality data solutions.
What You'll Do
Develop and maintain scalable data infrastructure, cloud-native workflows, and ETL/ELT pipelines supporting analytics and operational workloads.
Transform, model, and organize data from multiple sources to enable accurate reporting and data-driven insights.
Improve data quality and system performance by identifying issues, optimizing architecture, and enhancing reliability and scalability.
Monitor pipelines, troubleshoot discrepancies, and resolve data or platform issues-including participating in on-call support when needed.
Prototype analytical tools, automation solutions, and algorithms to support complex analysis and drive operational efficiency.
Collaborate closely with BI, Finance, and cross-functional teams to deliver robust and scalable data products.
Create and maintain clear, detailed documentation (configurations, specifications, test scripts, and project tracking).
Contribute to Agile development processes, engineering excellence, and continuous improvement initiatives.
What You Bring
Bachelor's degree in Computer Science or a related technical field.
2-4 years of hands-on SQL experience (Oracle, PostgreSQL, etc.).
2-4 years of experience with Java or Groovy.
2+ years working with orchestration and ingestion tools (e.g., Airflow, Airbyte).
2+ years integrating with APIs (SOAP, REST).
Experience with cloud data warehouses and modern ELT/ETL frameworks (e.g., Snowflake, Redshift, DBT) is a plus.
Comfortable working in an Agile environment.
Practical knowledge of version control and CI/CD workflows.
Experience with automation, including unit and integration testing.
Understanding of cloud storage solutions (e.g., S3, Blob Storage, Object Store).
Proactive mindset with strong analytical, logical-thinking, and consultative skills.
Ability to reason about design decisions and understand their broader technical impact.
Strong collaboration, adaptability, and prioritization abilities.
Excellent problem-solving and troubleshooting skills.
Data Engineer & Analytics(Reporting, Visualization) (US Citizen Only)
Data engineer job in Philadelphia, PA
1. Comfortable writing and tuning SQL queries on Vertica .
2. Can work with large datasets.
3. Good understanding of MicroStrategy basics like Attributes, Facts, and Hierarchies.
4. Skilled at translating complex technical outputs into simple, meaningful visuals and summaries.
5. Experience optimizing MicroStrategy reports for performance and scalability.
6. Experience creating data pipeline using cloud platforms (edited)
Python Data Controls Developer
Data engineer job in Mount Laurel, NJ
Mount Laurel, NJ - (3 days onsite role)
Mode of Hiring: Full Time
Salary: Negotiable for right candidates
Minimum of 7 - 10 years of experience working in a financial institution, preferably in Global Banks
Minimum of 7 - 10 years of experience in SQL development, including query optimization, stored procedures, and indexing.
Strong working experience in Python for data manipulation, scripting, and automation
Understanding of the Compliance domain and concepts i.e., Anti-Money laundering (AML), Know your Customer (KYC), Customer Risk Rating etc. is a must
Minimum of 5 - 7 years of experience in data (data lifecycle, data governance, data quality, Metadata, Data issue resolution and other data concepts)
Distinguished Data Engineer- Bank Tech
Data engineer job in Camden, NJ
Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to deliver next generation technology solutions.
Horzianal, Bank data organization to accelerate data modernization across the bank by defining, building, and operating on a unified, resilient, and compliant Enterprise Data Platforms. Enable bank domains to produce and leverage modern data for a modern bank. The position focused on setting the technical vision, prototyping and driving the most complex data domain data architecture for the banking domains. In addition, partner closely with enterprise teams to develop highly resilient data platforms.
Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices
Visionaries, collaborating on Capital One's toughest issues, to deliver on business needs that directly impact the lives of our customers and associates
Role models and mentors, helping to coach and strengthen the technical expertise and know-how of our engineering and product community
Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities
Responsibilities:
Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in
Strike the right balance between lending expertise and providing an inclusive environment where others' ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team
Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible
Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization
Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner
Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One's Tech talent
Basic Qualifications:
Bachelor's Degree
At least 7 years of experience in data engineering
At least 3 years of experience in data architecture
At least 2 years of experience building applications in AWS
Preferred Qualifications:
Masters' Degree
9+ years of experience in data engineering
3+ years of data modeling experience
2+ years of experience with ontology standards for defining a domain
2+ years of experience using Python, SQL or Scala
1+ year of experience deploying machine learning models
3+ years of experience implementing big data processing solutions on AWS
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
McLean, VA: $263,900 - $301,200 for Distinguished Data Engineer
Philadelphia, PA: $239,900 - $273,800 for Distinguished Data Engineer
Richmond, VA: $239,900 - $273,800 for Distinguished Data Engineer
Wilmington, DE: $239,900 - $273,800 for Distinguished Data Engineer
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections ; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1- or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
SRE/DevOps w/ HashiCorp & Clojure Exp
Data engineer job in Philadelphia, PA
Locals Only! SRE/DevOps w/ HashiCorp & Clojure Exp Philadelphia, PA: 100% Onsite! 12 + Months
MUST: HashiCorp Clojure
Role: Lead SRE initiatives, automating and monitoring cloud infrastructure to ensure reliable, scalable, and secure systems for eCommerce.
Required: Must Have:
AWS, Terraform, HashiCorp Stack (Nomad, Vault, Consul)
Programming in Python/Clojure
Automation, monitoring, and log centralization (Splunk)
Experience leading large-scale cloud infrastructure
Desired Skills and Experience
Locals Only!
SRE/DevOps w/ HashiCorp & Clojure Exp
Philadelphia, PA: 100% Onsite!
12 + Months
Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.
Dexian connects the right talent and the right technology with the right organizations to deliver trajectory-changing results that help everyone achieve their ambitions and goals. To learn more, please visit ********************
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
Sr. Software Engineer / Software Developers
Data engineer job in King of Prussia, PA
Sr. Apply now, read the job details by scrolling down Double check you have the necessary skills before sending an application. Software Data Engineer (Master's or equiv. deg. w/1 yr exp.) Exp. to include: installing, supporting & configuring operating systems(CentOS, Ubuntu, Windows); & work/w: TCP/IP, ETL, DBT, SnowSQL, JSON, Python scripts, HQL queries, Hadoop, Snowflake, HIVE, SQL, & SQL Server.
Software Developers (Master's or equiv.
deg.
w/3 yr exp.
Bachelor's or equiv.
degree w/5 yr exp) Exp.
to include: (A) design & develop applications; work/w: AWS, Informatica Power Center, Java, J2EE, Oracle 19c, SQL Server, O-Data, Angular, REST Web Service & Plainsware.
OR (B) design & develop applications; & xevrcyc work/w: SharePoint, .Net, Entity Framework, Web API, AngularJS, Jquery, SQL Server, Oracle, REST, Java Script, Informatica, Tableau, ETL and UCT.
Send resume: Eigen X, LLC, 1030 Continental Drive, King of Prussia, PA 19406.
Java Software Engineer
Data engineer job in East Windsor, NJ
Job Responsibilities:
Develop applications using Java 8/JEE (and higher), Angular 2+, React.js, SQL, Spring, HTML5, CSS, JavaScript, and TypeScript, among other tools.
Write scalable, secure, and maintainable code that powers our clients' platforms.
Create, deploy, and maintain automated system tests.
Work with Testers to understand defects and resolve them in a timely manner.
Support continuous improvement by investigating alternatives and technologies, and presenting these for architectural review.
Collaborate effectively with other team members to accomplish shared user story and sprint goals.
Requirement:
Experience in programming languages: Java and JavaScript
Decent understanding of the software development life cycle
Basic programming skills using object-oriented programming (OOP) languages, with in-depth
knowledge of common APIs and data structures like Collections, Maps, Lists, Sets, etc.
Knowledge of relational databases (e.g., SQL Server, Oracle) and basic SQL query language skills
Preferred Qualifications:
Master's Degree in Computer Science (CS)
0-1 year of practical experience in Java coding
Experience using Spring, Maven, Angular frameworks, HTML, and CSS
Knowledge of other contemporary Java technologies (e.g., WebLogic, RabbitMQ, Tomcat)
Familiarity with JSP, J2EE, and JDBC
Senior Dotnet Developer
Data engineer job in Ewing, NJ
The Software Engineer, III is a fullstack engineer with strong Node.js and functional programming (Scala & Ruby) skills. Our applications leverage Node.js, Bootstrap, JQuery, Mondo DB, Elastic Search, Redis, React.js and delightful interactive experience to the web. Our applications run in the AWS cloud environment. We use Agile Methodologies to enable our engineering team to work closely with partners and with our design & product teams. This role is full time and preferably located long-term in New York City or southern New Jersey areas.
Essential Job Duties and Responsibilities include:
Design, develop, and maintain modern web applications and UIs using .NET technologies such as C#, ASP.NET MVC, ASP.NET Core, Razor Pages, and Blazor.
Create clean, maintainable, and well-documented code following industry best practices and coding standards.
Develop and consume RESTful APIs and web services.
Build responsive and accessible user interfaces using HTML, CSS, JavaScript, and UI libraries/frameworks such as React, Angular, Vue.js, or Bootstrap.
Work with relational and NoSQL databases (e.g., SQL Server, MongoDB) and object-relational mappers (ORMs) such as Entity Framework Core.
Conduct unit and integration testing to validate functionality and ensure high-quality deliverables.
Participate in peer code reviews and provide constructive feedback to ensure continuous improvement and knowledge sharing.
Identify, troubleshoot, and resolve complex technical issues in development and production environments.
Collaborate with cross-functional teams throughout the software development lifecycle.
Stay current with emerging .NET technologies and trends.
May mentor and support junior developers in their technical growth and day-to-day work.
Maintain regular and punctual attendance.
Preferred Qualifications:
Experience with CI/CD pipelines and DevOps practices.
Familiarity with cloud platforms (e.g., Azure, AWS) and deploying .NET applications in cloud environments.
Knowledge of Blazor for interactive web UIs using C# instead of JavaScript
Education and/or Experience:
7+ years of professional software development experience with a strong focus on web and UI development in the .NET ecosystem.
Advanced proficiency in C#, ASP.NET, ASP.NET Core, and MVC frameworks; experience with VBScript is a plus.
Deep understanding of object-oriented programming (OOP) and design patterns.
Strong front-end development skills, including HTML, CSS, JavaScript, and at least one modern UI framework (React, Angular, Vue.js, etc.).
Proven experience developing and integrating RESTful APIs.
Hands-on experience with SQL Server and/or NoSQL databases; proficient in using Entity Framework Core or similar ORMs.
Familiarity with version control systems such as Git.
Solid grasp of Agile/Scrum development methodologies.
Excellent problem-solving abilities and strong attention to detail.
Effective communication and interpersonal skills with the ability to work independently and within a team.
Sr. C++FIX or Market Data Developer
Data engineer job in Princeton, NJ
Looking for a highly motivated C++ Trading Systems Developer with demonstrated experience in designing, developing and delivering core production software solutions in a mission critical trading systems environment. Major responsibilities include: Assessing business and systems requirements and developing functional specifications Designing and developing high quality, high performance trading systems software written in C++ to meet deliverable timelines and requirements Adhering to software development life cycle process/methodology Building business level subject matter expertise in trading systems functionality and processing Provide second level support for production on an ad hoc basis when necessary Location: Princeton, NJ Organizational Structure: The developer will be an integral part of a core development team and report to the Trading System Development management team. Qualifications: Full software development life cycle experience in a mission critical trading systems environment a must… Options, Equities, Futures, etc. Must possess excellent software design skills and knowledge of advanced data structures Must have exceptionally strong C++ knowledge and debugging skills in a Linux environment Solid knowledge of Object Oriented Programming concepts a must Strong knowledge of TCP/IP multicast and socket programming required Knowledge of the BOOST libraries and STL required Must have experience in developing real-time applications in a distributed processing architecture Must have excellent organizational and communication skills Must be able to work effectively in a team environment Strong knowledge of the logical business domain in Options or Equities trading systems a big plus Experience coding interface solutions for FIX, OPRA, CTA or UTP a big plus Knowledge of scripting languages such as Python, Shell, and Perl a plus Education and Experience: Minimum of a Bachelor's degree or equivalent in IT/Computer Science 7+ years of experience in C++ development 5+ years of demonstrated experience in delivering software solutions in a trading systems environment for an Exchange or a Wall Street firm
Identity and Access Management Software Engineering Lead
Data engineer job in Philadelphia, PA
Identity and Access Management - Software Engineering Lead- Must have either (KeyCloak, Auth0, Okta, or similar)
Are you a Software Engineering lead with a strong security background ready to broaden your impact and take on a hands-on software engineering leadership role?
Are you a collaborative Software Engineering Lead looking to work for a mission driven global organization?
About the role - As an Engineering Lead for NeoID-Elsevier's next-generation Identity and Access Management (IAM) platform-you'll leverage your deep security expertise to architect, build, and evolve the authentication and authorization backbone for Elsevier's global products. You'll also lead and manage a team of 5 engineers, fostering their growth and ensuring delivery excellence. You'll have the opportunity to work with industry standard protocols such as OAuth2, OIDC and SAML, as well as healthcare's SMART on FHIR and EHR integrations.
About the team- This team is entrusted with building Elsevier's next-generation Identity and Access Management (IAM) platform. This diverse team of engineers are also building and evolving the authentication and authorization backbone for Elsevier's global products. This team is building a brand new product in Cyber Security that will provide Authorization and Authentication for ALL Elsevier products
Qualifications
Current and extensive experience with at least one major IAM platform (KeyCloak, Auth0, Okta, or similar) - KeyCloak and Auth0 experience are strong pluses. Only candidates with this experience will be considered for this critical role.
Possess an in-depth security mindset, with proven experience designing and implementing secure authentication and authorization systems
Have an extensive understanding of OAuth2, OIDC and SAML protocols, including relevant RFCs and enterprise/server-side implementations
Familiarity with healthcare identity protocols, including SMART on FHIR and EHR integrations
Have current hands-on experience with AWS cloud services and infrastructure management. Proficiency in Infrastructure as Code (IaC) tools, especially Terraform
Strong networking skills, including network security, protocols, and troubleshooting
Familiarity with software development methodologies (Agile, Waterfall, etc.)
Experience with Java/J2EE, JavaScript, and related technologies, or willingness to learn and deepen expertise
Knowledge of data modeling, optimization, and secure data handling best practices
Accountabilities
Leading the design and implementation of secure, scalable IAM solutions, with a focus on OAuth2/OIDC and healthcare protocols such as SMART on FHIR and EHR integrations
Managing, mentoring and supporting a team of 5 engineers, fostering a culture of security, innovation, and technical excellence
Collaborating with product managers and stakeholders to define requirements and strategic direction for the platform, including healthcare and life sciences use cases
Writing and reviewing code, performing code reviews, and ensuring adherence to security and engineering best practices
Troubleshooting and resolving complex technical issues, providing expert guidance on IAM, security, and healthcare protocol topics
Contributing to architectural decisions and long-term platform strategy
Staying current with industry trends, emerging technologies, and evolving security threats in the IAM and healthcare space
Why Elsevier?
Join a global leader in information and analytics, and help shape the future of secure, seamless access to knowledge for millions of users worldwide, including healthcare professionals and researchers. If you are an Engineering Lead ready to expand your skills, take on a hands-on software engineering leadership role, and grow as a people manager, we want to hear from you.
MLOps Engineer
Data engineer job in Philadelphia, PA
Role : ML Ops Lead
Duration : Long Term
Skills :
4 - 7 years of experience in DevOps, MLOps, platform engineering, or cloud infrastructure.
Strong skills in containerization (Docker, Kubernetes), API hosting, and cloud-native services.
Experience with vector DBs (e.g., FAISS, Pinecone, Weaviate) and model hosting stacks.
Familiarity with logging frameworks, APM tools, tracing layers, and prompt/versioning logs.
Bonus: exposure to LangChain, LangGraph, LLM APIs, and retrieval-based architectures.
Responsibilities :
Set up and manage runtime environments for LLMs, vector DBs, and orchestration flows (e.g., LangGraph).
Support deployments in cloud, hybrid, and client-hosted environments.
Containerize systems for deployment (Docker, Kubernetes, etc.) and manage inference scaling.
Integrate observability tooling: prompt tracing, version logs, eval hooks, error pipelines.
Collaborate on RAG stack deployments (retriever, ranker, vector DB, toolchains).
Support CI/CD, secrets management, error triage, and environment configuration.
Contribute to platform-level IP, including reusable scaffolding and infrastructure accelerators.
Ensure systems are compliant with governance expectations and auditable (esp. in insurance contexts).
Preferred Attributes :
Systems thinker with strong debugging skills..
Able to work across cloud, on-prem, and hybrid client environments.
Comfortable partnering with architects and engineers to ensure smooth delivery.
Proactive about observability, compliance, and runtime reliability.
About ValueMomentum
ValueMomentum is a leading solutions provider for the global property & casualty insurance industry, supported by deep domain and technology capabilities. We offer a comprehensive suite of advisory, development, implementation, and maintenance services across the entire P&C insurance value chain. This includes Underwriting, Claims, Distribution, and more, empowering insurers to stay ahead with sustained growth, high performance, and enhanced stakeholder value. Trusted by over 75 insurers, ValueMomentum is one of the largest standalone insurance-focused solutions providers to the US insurance industry.
Our culture - Our fuel
At ValueMomentum, we believe in making employees win by nurturing them from within, collaborating and looking out for each other.
People first - We make employees win.
Nurture leaders - We nurture from within.
Enjoy wins - Celebrating wins and creating leaders.
Collaboration - A culture of collaboration and people-centricity.
Diversity - Committed to diversity, equity, and inclusion.
Fun - Help people have fun at work.
Senior Data Consultant
Data engineer job in Marlton, NJ
About the Role
As a Data Solutions Consultant, you will play a key role supporting multiple initiatives for enterprise and global customers. This role sits at the intersection of business, data, and technology, working closely with client stakeholders to turn complex requirements into scalable, cloud-based data solutions.
You'll be responsible for gathering business requirements, defining and implementing data models, designing data pipelines, and ensuring insights are delivered to stakeholders in a clear, efficient, and impactful way. The work is performed in a modern cloud environment, leveraging AI-driven tools to improve productivity and accelerate outcomes.
Key Responsibilities
Partner with client stakeholders to gather, clarify, and translate business requirements
Define and implement robust data models using a Medallion architecture
Design and develop scalable, cloud-based data pipelines
Build optimized, user-friendly reporting and analytics solutions
Ensure data is accessible, reliable, and actionable for business stakeholders
Contribute to innovative, AI-enabled approaches to data and analytics delivery
Requirements
Bachelor's degree in Computer Science, Engineering, or a related field
2+ years of hands-on experience delivering Data & Analytics projects in cloud environments
Strong communication and collaboration skills with both technical and business stakeholders
Strong problem-solving and analytical capabilities
Proven experience designing and implementing data models in cloud-based environments
(AWS, Azure, or GCP)
Experience using generative AI tools to improve productivity and extract insights
Strong SQL skills and solid understanding of database management systems
Preferred Qualifications
Master's degree in Computer Science, Engineering, or a related field
Cloud or data engineering certifications
Experience developing ETL pipelines using dbt
Big Data /Hadoop Consultant
Data engineer job in King of Prussia, PA
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description:-
At least 4 years of experience in software design, development and release.
Well versed with agile development methodologies.
Experience in Data Ingestion, Streaming and Big Data technologies.
Excellent communication and stakeholder management
Ability to work with distributed teams.
Exposure to Data Warehousing, Reporting and related technologies would be an added advantage.
Apache Flume, NiFi, Kafka, Spark or Storm.
Good Analytical skills
A high degree of initiative and flexibility
Excellent verbal and written communication skills
Qualifications
Basic Qualifications :-
Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 4 years of experience within the Information Technologies.
Additional Information
Note:-
This is a Full-Time & Permanent job opportunity for you.
Only US Citizen, Green Card Holder, GC-EAD, H4-EAD & L2-EAD can apply.
No OPT-EAD, H1B & TN candidates please.
Please mention your Visa Status in your email or resume.
ETL/BI/Data reports consultants
Data engineer job in Philadelphia, PA
AYR Global IT Solutions is a national staffing firm focused on cloud, cyber security, web application services, ERP, and BI implementations by providing proven and experienced consultants to our clients.
Our competitive, transparent pricing
model and industry experience make us a top choice of Global System
Integrators and enterprise customers with federal and commercial
projects supported nationwide.
Job Description
Subject: ETL/BI/Data reports consultants
Location: Philadelphia, Pa.
Duration: One year plus
Qualifications
Experience - Must haves!
5+ years coding advanced SQL queries, ETL automation, and stored procedures to support business inquiries
5+ years of demonstrated reporting, analytical, and database experience in a dynamic business environment
Advanced BI/Reporting Tool experience (SSRS) required.
Experience with transforming complex datasets into relevant visualizations
Familiar with relational database technology and terminology
Functional Competencies
SQL coding proficiency (5+ years)
Microsoft Reporting Services (SSRS) - Ability to develop advanced reports, manage subscriptions, etc.
Microsoft Integration Services (SSIS) - Ability to manage SQL Server ETL processes / job failures, etc.
Relational database development (SQL Server, Teradata)
SQL Server - Table, View & Procedure development
Teradata environment experience
Teradata SQL Assistant experience
Excel - Charts, Pivot Tables, Equations, VBA
Tableau experience a plus
Oracle experience a plus
Qualifications
Bachelor's degree required (preferably in Information Systems, Business Intelligence, or Computer Science) with related experience, or an equivalent combination of education and experience from which comparable knowledge and abilities can be acquired.
A sound technical background with the ability to analyze complex data sets, business processes, and quickly adapt to the use of new technologies.
Must have excellent communication skills with the ability to share technical capabilities and work cross-functionally between business functions.
Additional Information
If anyone might be intersted please send resumes to kmarsh@ayrglobal (dot) com or you can reach me direct at **************
Data & AI Consultant - Philadelphia - Graduates
Data engineer job in Philadelphia, PA
Thorogood is an independent, specialized, data and analytics consulting firm that works with some of the biggest and best-known companies around the world. We have offices in London, Philadelphia, Boston, Singapore, São Paulo, and Bangalore, and we work as a global unit to service blue chip customers drawing from the consumer goods, pharmaceutical, insurance, and banking sectors, among others. Together, we compete on the basis of our specialism, our people, our independence, high quality, and our experience delivering assuredly for customers over several decades.
We help our customers leverage the latest technologies to make timely, data-driven business decisions. Our multi-skilled teams understand the critical interplay of data engineering, data science, and data visualization. We work across these areas to create business-focused, end-to-end technology solutions robust enough to meet enterprise needs. We recognize the importance of environmental sustainability, both in how we work and in the solutions we build for our clients. Our services span strategy, implementation, advanced analytics services, user empowerment, and support.
Additional information about us, our people, what we do, and some of perspectives can be found on our website here.
About the Position Overview
Our consultants are expected to have a strong interest in business. Understanding our clients' organizations and industries is key to identifying areas of opportunity for us to help. Similarly, consultants must have excellent listening, writing, and presenting skills, alongside the aptitude and motivation to master multiple data-focused technologies in a fast-moving field. This combination of business, people, and technical skills is essential.
Our Brazil and US entities are managed together as one Thorogood Americas in support of development of our business not only in the region, but around the world. We work with our colleagues in the US, UK, India, Singapore, and Brazil to provide effective solutions for our clients situated across the globe. The global nature of our work exposes our consultants to a variety of experiences across industries and cultures. The ability to work collaboratively and effectively as part of a distributed team is therefore imperative for the position.
Our most successful consultants develop a well-rounded set of skills in each of these areas of business, people, and technology. You'll do so via a number of opportunities:
Comprehensive training: During your first months at Thorogood, experienced consultants will introduce you to the technologies we work with, the industries we serve, and the ways in which we develop our business. Crucially, we will share how we live our values. When you've finished, we'll plan to have you working on a client project immediately.
Building your core technology skills: We're the kind of people who learn best by doing. You'll be working on a team locked onto business value for the customer to develop fast, effective, and high-quality technical solutions.
Working with top clients: Thorogood works with some of the biggest and best-known companies in the world. You'll be a part of client interactions, sometimes leading them, to make sure we're keeping our projects on track and delivering value to our customers.
Developing relationships: We consider ourselves trusted advisors for our clients. We earn this trust through listening carefully, sharing the expertise we have acquired, and helping to progress the objectives within their organizations.
Shaping future projects: We are always listening to customers to understand their objectives and needs and working with our consultants to share proposals on how we can help.
Working as part of a supportive project team: You'll be working from our offices in Philadelphia, with occasional travel externally to client sites and internally to other Thorogood offices. Your project teams will be comprised of consultants across many levels of experience, working together daily to support one another along the way.
Becoming an expert, yourself: Our subject matter experts are not necessarily the most tenured people at Thorogood. In the rapidly changing world of data and analytics, we look to all levels of experience to gain expertise in new technologies and analytical techniques.
In addition to project work, Thorogood consultants run our company. We expect you to contribute here, as well:
Helping to grow our business: Interact with current and prospective clients, listen to their needs, and drive business development activities and discussions. Together, we'll consider the business objectives in conjunction with the technical possibilities in order to understand the opportunities for their organizations.
Delivering educationally focused marketing events: Prepare and present informational events for contacts at prospective and current clients.
Fostering vendor partnerships: Help maintain and further our relationships with key vendor partners in the space including Microsoft, Databricks, Amazon Web Services, Google Cloud and others, whose offerings we implement for customers.
Developing our consultancy: Contribute to recruiting, training, and managing our people.
Additional Benefits
We individually select each of our consultants very carefully through our comprehensive interview and assessment process. We place a great deal of value on consultants' growth and wellbeing. In addition to a challenging and rewarding career path, Thorogood offers the following benefits:
Very competitive salary and compensation program
Company-sponsored health, dental, and vision coverage
401(k) program with employer match
Generous vacation allowance with incremental increases over time based on consultant tenure
Incentive programs
Opportunities for national and international travel
Focus on work-life balance
Location and Timing
This position is based at our Center City office in Philadelphia, PA. Our consultants are currently working in a flexible, hybrid work model. However, a level of in-person attendance at our office is required. The expected start date for this position is approximately between January 2026 or July 2026, depending on candidate start date availability.
About You
Qualified candidates must have
Strong interest in business, people, and technology
Strong academic record in a related discipline, including engineering, computer science, mathematics, statistics, business, management, or another business and quantitative-focused field
Bachelor's degree with graduation between December 2025 and June 2026
Candidates must demonstrate effectiveness in
Working individually and as part of project teams
Maintaining responsibility and accountability for quality and work delivery
Client focus and relationship management
Time management and priority setting
Data awareness and business interest
Learning new technologies
This is an entry-level position; no prior full-time employment experience is required. Please do highlight if you have studied or worked with
Cloud BI & Analytics technology platforms, e.g. Databricks, Snowflake, Amazon Web Services, Microsoft Azure, or Google Cloud Platform
SQL, Python, R, Scala, Spark, or any other programming or statistical programming languages and frameworks
Applied mathematics, statistics, probability, machine learning, artificial intelligence, large language models, and/or generative artificial intelligence
Data science, data engineering, data analysis, or data visualization technologies
Managed structured, semi-structured, and unstructured data storage, transformation, or analysis
Integrating data solutions into web applications
Please note: Thorogood will ensure that every employee is authorized to work in the United States. If you are offered employment with the Company, we shall require proof of your authorization to work within the United States. Thorogood does not sponsor applicants for work visas. Applicants must be currently authorized to work within the United States on a full-time basis
Microsoft Dynamics 365 CE Data Migration Consultant
Data engineer job in Middletown, PA
Data-Core Systems, Inc. is a provider of information technology, consulting and business process services. We offer breakthrough tech solutions and have worked with companies, hospitals, universities and government organizations. A proven partner with a passion for client satisfaction, we combine technology innovation, business process expertise and a global, collaborative workforce that exemplifies the future of work. For more information about Data-Core Systems, Inc., please visit *****************************
Our client is a roadway system and as a part of their digital transformation they are implementing a solution based on SAP BRIM & Microsoft Dynamics CE.
Data-Core Systems Inc. is seeking Microsoft Dynamics 365 CE Data Migration Consultant to be a part of our Consulting team. You will be responsible for planning, designing, and executing the migration of customer, account, vehicle, financial, and transaction data from a variety of source systems-including legacy CRMs, ERPs, SQL databases, flat files, Excel, cloud platforms, and tolling systems-into Microsoft Dynamics 365 Customer Engagement (CE). This role involves understanding complex data models, extracting structured and unstructured data, transforming and mapping it to Dynamics CE entities, and ensuring data quality, integrity, and reconciliation throughout the migration lifecycle.
Roles & Responsibilities:
Analyze source system data structures, including customer profiles, accounts, vehicles, transponders, payment methods, transactions, violations, invoices, and billing records
Identify critical data relationships, parent/child hierarchies, and foreign key dependencies
Develop detailed data mapping and transformation documentation from source systems to Dynamics 365 CE entities (standard and custom)
Build, test, and execute ETL pipelines using tools such as SSIS/KingswaySoft, Azure Data Factory, Power Platform Dataflows, or custom .NET utilities
Perform data cleansing, normalization, deduplication, and standardization to meet Dynamics CE data model requirements
Execute multiple migration cycles, including test loads, validation, and final production migration
Ensure referential integrity, high data quality, and accuracy of historical data
Generate reconciliation reports, resolve data inconsistencies, and troubleshoot migration errors
Document migration strategies, execution runbooks, and transformation rules for future reference
Required Skills & Experience:
8-12 years of proven experience migrating data from tolling systems, transportation platforms, legacy CRMs, or other high-volume transactional systems
Strong SQL skills for complex queries, stored procedures, data transformation, and data validation
Hands-on experience with Microsoft Dynamics 365 CE / CRM data model, entities, and relationships
Proficiency with ETL/migration tools: SSIS with KingswaySoft, Azure Data Factory, Power Platform Dataflows, Custom C#/.NET migration scripts
Experience with large-scale migrations involving millions of records
Strong understanding of relational data structures such as: Customer ⇄ Account ⇄ Vehicle ⇄ Transponder ⇄ Transaction
Ability to analyze large datasets, identify anomalies, and resolve inconsistencies
Bachelor's degree in engineering or a bachelor's degree in technology from a recognized university
Preferred Skills & Experience:
Experience with financial transactions, billing data, or violation/enforcement records.
Experience in enterprise-scale Dynamics 365 CE migrations.
Familiarity with data governance, security, and compliance requirements for financial or transportation data.
Knowledge of historical data migration and archival strategies.
We are an equal opportunity employer.
Senior Data Engineer
Data engineer job in Philadelphia, PA
Full-time Perm
Remote - EAST COAST ONLY
Role open to US Citizens and Green Card Holders only
We're looking for a Senior Data Engineer to lead the design, build, and optimization of modern data pipelines and cloud-native data infrastructure. This role is ideal for someone who thrives on solving complex data challenges, improving systems at scale, and collaborating across technical and business teams to deliver high-impact solutions.
What You'll Do
Architect, develop, and maintain scalable, secure data infrastructure supporting analytics, reporting, and operational workflows.
Design and optimize ETL/ELT pipelines to integrate data from diverse internal and external sources.
Prepare and transform structured and unstructured data to support modeling, reporting, and advanced analysis.
Improve data quality, reliability, and performance across platforms and workflows.
Monitor pipelines, troubleshoot discrepancies, and ensure accuracy and timely data delivery.
Identify architectural bottlenecks and drive long-term scalability improvements.
Collaborate with Product, BI, Finance, and engineering teams to build end-to-end data solutions.
Prototype algorithms, transformations, and automation tools to accelerate insights.
Lead cloud-native workflow design, including logging, monitoring, and storage best practices.
Create and maintain high-quality technical documentation.
Contribute to Agile ceremonies, engineering best practices, and continuous improvement initiatives.
Mentor teammates and guide adoption of data platform tools and patterns.
Participate in on-call rotation to maintain platform stability and availability.
What You Bring
Bachelor's degree in Computer Science or related technical field.
4+ years of advanced SQL experience (Oracle, PostgreSQL, etc.).
4+ years working with Java or Groovy.
3+ years integrating with SOAP or REST APIs.
2+ years with DBT and data modeling.
Strong understanding of modern data architectures, distributed systems, and performance optimization.
Experience with Snowflake or similar cloud data platforms (preferred).
Hands-on experience with Git, Jenkins, CI/CD, and automation/testing practices.
Solid grasp of cloud concepts and cloud-native engineering.
Excellent problem-solving, communication, and cross-team collaboration skills.
Ability to lead projects, own solutions end-to-end, and influence technical direction.
Proactive mindset with strong analytical and consultative abilities.
Distinguished Data Engineer- Bank Tech
Data engineer job in Cherry Hill, NJ
Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to deliver next generation technology solutions.
Horzianal, Bank data organization to accelerate data modernization across the bank by defining, building, and operating on a unified, resilient, and compliant Enterprise Data Platforms. Enable bank domains to produce and leverage modern data for a modern bank. The position focused on setting the technical vision, prototyping and driving the most complex data domain data architecture for the banking domains. In addition, partner closely with enterprise teams to develop highly resilient data platforms.
Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices
Visionaries, collaborating on Capital One's toughest issues, to deliver on business needs that directly impact the lives of our customers and associates
Role models and mentors, helping to coach and strengthen the technical expertise and know-how of our engineering and product community
Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities
Responsibilities:
Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in
Strike the right balance between lending expertise and providing an inclusive environment where others' ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team
Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible
Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization
Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner
Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One's Tech talent
Basic Qualifications:
Bachelor's Degree
At least 7 years of experience in data engineering
At least 3 years of experience in data architecture
At least 2 years of experience building applications in AWS
Preferred Qualifications:
Masters' Degree
9+ years of experience in data engineering
3+ years of data modeling experience
2+ years of experience with ontology standards for defining a domain
2+ years of experience using Python, SQL or Scala
1+ year of experience deploying machine learning models
3+ years of experience implementing big data processing solutions on AWS
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
McLean, VA: $263,900 - $301,200 for Distinguished Data Engineer
Philadelphia, PA: $239,900 - $273,800 for Distinguished Data Engineer
Richmond, VA: $239,900 - $273,800 for Distinguished Data Engineer
Wilmington, DE: $239,900 - $273,800 for Distinguished Data Engineer
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections ; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1- or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Identity and Access Management - Software Engineering Lead
Data engineer job in Philadelphia, PA
About the role - As Engineering Lead for NeoID-Elsevier's next-generation Identity and Access Management (IAM) platform-you'll leverage your deep security expertise to architect, build, and evolve the authentication and authorization backbone for Elsevier's global products. You'll also lead and manage a team of 5 engineers, fostering their growth and ensuring delivery excellence. You'll have the opportunity to work with industry standard protocols such as OAuth2, OIDC and SAML, as well as healthcare's SMART on FHIR and EHR integrations.
About the team- This team is entrusted with building Elsevier's next-generation Identity and Access Management (IAM) platform. This diverse team of engineers are also building and evolving the authentication and authorization backbone for Elsevier's global products. This team is building a brand new product in Cyber Security that will provide Authorization and Authentication for ALL Elsevier products
Qualifications
Current and extensive experience with at least one major IAM platform (KeyCloak, Auth0, Okta, or similar) - KeyCloak and Auth0 experience are strong pluses. Only candidates with this experience will be considered for this critical role.
Possess an in-depth security mindset, with proven experience designing and implementing secure authentication and authorization systems
Have an extensive understanding of OAuth2, OIDC and SAML protocols, including relevant RFCs and enterprise/server-side implementations
Familiarity with healthcare identity protocols, including SMART on FHIR and EHR integrations
Have current hands-on experience with AWS cloud services and infrastructure management. Proficiency in Infrastructure as Code (IaC) tools, especially Terraform
Strong networking skills, including network security, protocols, and troubleshooting
Familiarity with software development methodologies (Agile, Waterfall, etc.)
Current experience as a people manager of ideally Software and Security professionals.
Experience with Java/J2EE, JavaScript, and related technologies, or willingness to learn and deepen expertise
Knowledge of data modeling, optimization, and secure data handling best practices
Accountabilities
Leading the design and implementation of secure, scalable IAM solutions, with a focus on OAuth2/OIDC and healthcare protocols such as SMART on FHIR and EHR integrations
Managing, mentoring and supporting a team of 5 engineers, fostering a culture of security, innovation, and technical excellence
Collaborating with product managers and stakeholders to define requirements and strategic direction for the platform, including healthcare and life sciences use cases
Writing and reviewing code, performing code reviews, and ensuring adherence to security and engineering best practices
Troubleshooting and resolving complex technical issues, providing expert guidance on IAM, security, and healthcare protocol topics
Contributing to architectural decisions and long-term platform strategy
Staying current with industry trends, emerging technologies, and evolving security threats in the IAM and healthcare space