{"@context":"https://schema.org","@type":"JobPosting","directApply":"https://schema.org/False","title":"Senior Data Engineer","description":"

Abacus Insights is a mission-driven, growth-stage technology company focused on transforming the healthcare industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing our customers to uncover differentiated insights that address their client's needs. In addition, our employees know that they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to historically siloed and inaccessible data. Through our platform, these healthcare organizations can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.

Since our founding in 2017, Abacus has built a highly successful SaaS business, raising more than $81 Million from leading VC firms with deep expertise in the healthcare and technology industries. We are solving problems of massive scale and complexity in a sector ready for disruption. We're growing quickly and would love for you to be a part of it!

About the Role:

We are seeking an accomplished Sr. Data Engineer to join our dynamic and rapidly expanding Tech Ops division. With significant projected growth, we invite you to contribute to our success. In this role, you will collaborate with customers, data vendors, and various internal teams to integrate data into a state-of-the-art data platform. This platform is constructed on highly scalable, flexible, and resilient cloud architectures. As a trusted advocate for our clients, you will play a key role in facilitating the successful adoption of Abacus’s core data management solutions. Your expertise will ensure seamless data ingestion and management, leveraging cutting-edge technologies and best practices in data engineering.

You will:

Work with clients & implementation team and understand the data distribution requirements
Develop data pipelines integrating with Databricks and Snowflake, ensuring data accuracy and integrity.
Lead the architecture and implementation of solutions for health plan clients, optimizing cloud-based technologies.
Collaborate with cross-functional teams and clients to translate requirements into technical solutions.
Implement robust data security measures and ensure compliance with healthcare regulations like HIPAA.
Provide technical leadership, mentoring junior engineers and staying updated on industry trends.
Focus on optimizing data processes for efficiency, regularly reviewing architectures, and creating detailed documentation.
Conduct training for team members and clients to enhance understanding and utilization of data solutions.

What we're looking for:

Bachelor’s Degree in computer science, computer engineering or any related IT field
5+ years of data engineering experience
Basic US Healthcare Knowledge (e.g. Medical Claims, Member/Eligibility etc.)
Experience communicating with both technical and non-technical stakeholders
Proficient with Python and SQL
Build and manage efficient ETL pipelines using Databricks workflows or other orchestration framework
Familiarity with both structured and semi-structured data and ingesting and processing this data using pyspark
Fundamental AWS services (S3, SQS) or similar services for other clouds
Terraform and GitLab CICD
Query tuning and performance optimization in SQL and/or SparkSQL
Familiarity with data warehousing (snowflake or similar)

Bonus Points:

Experience working for a cloud-based data services provider to large healthcare clients.
DBT
Kafka

Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

","identifier":"https://remote.com/jobs/abacus-insights-c16l5att/senior-data-engineer-j1y2o4gp","employmentType":"FULL_TIME","hiringOrganization":{"@type":"Organization","name":"Abacus Insights","sameAs":"https://abacusinsights.com"},"datePosted":"2025-09-03T20:05:59Z","applicantLocationRequirements":[{"@type":"Country","name":"Albania"},{"@type":"Country","name":"Algeria"},{"@type":"Country","name":"American Samoa"},{"@type":"Country","name":"Andorra"},{"@type":"Country","name":"Angola"},{"@type":"Country","name":"Anguilla"},{"@type":"Country","name":"Antigua and Barbuda"},{"@type":"Country","name":"Argentina"},{"@type":"Country","name":"Armenia"},{"@type":"Country","name":"Aruba"},{"@type":"Country","name":"Australia"},{"@type":"Country","name":"Austria"},{"@type":"Country","name":"Azerbaijan"},{"@type":"Country","name":"Bahamas"},{"@type":"Country","name":"Bahrain"},{"@type":"Country","name":"Bangladesh"},{"@type":"Country","name":"Barbados"},{"@type":"Country","name":"Belgium"},{"@type":"Country","name":"Belize"},{"@type":"Country","name":"Benin"},{"@type":"Country","name":"Bermuda"},{"@type":"Country","name":"Bhutan"},{"@type":"Country","name":"Bolivia"},{"@type":"Country","name":"Bosnia and Herzegovina"},{"@type":"Country","name":"Botswana"},{"@type":"Country","name":"Brazil"},{"@type":"Country","name":"British Virgin Islands"},{"@type":"Country","name":"Brunei"},{"@type":"Country","name":"Bulgaria"},{"@type":"Country","name":"Burkina Faso"},{"@type":"Country","name":"Burundi"},{"@type":"Country","name":"Cabo Verde"},{"@type":"Country","name":"Cambodia"},{"@type":"Country","name":"Cameroon"},{"@type":"Country","name":"Canada"},{"@type":"Country","name":"Cayman Islands"},{"@type":"Country","name":"Central African Republic (CAR)"},{"@type":"Country","name":"Chad"},{"@type":"Country","name":"Chile"},{"@type":"Country","name":"China"},{"@type":"Country","name":"Christmas Island"},{"@type":"Country","name":"Cocos (Keeling) Islands"},{"@type":"Country","name":"Colombia"},{"@type":"Country","name":"Comoros"},{"@type":"Country","name":"Cook Islands"},{"@type":"Country","name":"Costa Rica"},{"@type":"Country","name":"Cote d'Ivoire"},{"@type":"Country","name":"Croatia"},{"@type":"Country","name":"Curacao"},{"@type":"Country","name":"Cyprus"},{"@type":"Country","name":"Czech Republic"},{"@type":"Country","name":"Democratic Republic of the Congo"},{"@type":"Country","name":"Denmark"},{"@type":"Country","name":"Djibouti"},{"@type":"Country","name":"Dominica"},{"@type":"Country","name":"Dominican Republic"},{"@type":"Country","name":"Ecuador"},{"@type":"Country","name":"Egypt"},{"@type":"Country","name":"El Salvador"},{"@type":"Country","name":"Equatorial Guinea"},{"@type":"Country","name":"Eritrea"},{"@type":"Country","name":"Estonia"},{"@type":"Country","name":"Ethiopia"},{"@type":"Country","name":"Falkland Islands (Malvinas)"},{"@type":"Country","name":"Faroe Islands"},{"@type":"Country","name":"Fiji"},{"@type":"Country","name":"Finland"},{"@type":"Country","name":"France"},{"@type":"Country","name":"French Guiana"},{"@type":"Country","name":"French Polynesia"},{"@type":"Country","name":"Gabon"},{"@type":"Country","name":"Gambia"},{"@type":"Country","name":"Georgia"},{"@type":"Country","name":"Germany"},{"@type":"Country","name":"Ghana"},{"@type":"Country","name":"Gibraltar"},{"@type":"Country","name":"Greece"},{"@type":"Country","name":"Greenland"},{"@type":"Country","name":"Grenada"},{"@type":"Country","name":"Guadeloupe"},{"@type":"Country","name":"Guam"},{"@type":"Country","name":"Guatemala"},{"@type":"Country","name":"Guernsey"},{"@type":"Country","name":"Guinea"},{"@type":"Country","name":"Guinea-Bissau"},{"@type":"Country","name":"Guyana"},{"@type":"Country","name":"Haiti"},{"@type":"Country","name":"Honduras"},{"@type":"Country","name":"Hong Kong"},{"@type":"Country","name":"Hungary"},{"@type":"Country","name":"Iceland"},{"@type":"Country","name":"India"},{"@type":"Country","name":"Indonesia"},{"@type":"Country","name":"Ireland"},{"@type":"Country","name":"Isle of Man"},{"@type":"Country","name":"Israel"},{"@type":"Country","name":"Italy"},{"@type":"Country","name":"Jamaica"},{"@type":"Country","name":"Japan"},{"@type":"Country","name":"Jersey"},{"@type":"Country","name":"Jordan"},{"@type":"Country","name":"Kazakhstan"},{"@type":"Country","name":"Kenya"},{"@type":"Country","name":"Kiribati"},{"@type":"Country","name":"Kosovo"},{"@type":"Country","name":"Kuwait"},{"@type":"Country","name":"Kyrgyzstan"},{"@type":"Country","name":"Laos"},{"@type":"Country","name":"Latvia"},{"@type":"Country","name":"Lebanon"},{"@type":"Country","name":"Lesotho"},{"@type":"Country","name":"Liberia"},{"@type":"Country","name":"Libya"},{"@type":"Country","name":"Liechtenstein"},{"@type":"Country","name":"Lithuania"},{"@type":"Country","name":"Luxembourg"},{"@type":"Country","name":"Macao"},{"@type":"Country","name":"Madagascar"},{"@type":"Country","name":"Malawi"},{"@type":"Country","name":"Malaysia"},{"@type":"Country","name":"Maldives"},{"@type":"Country","name":"Mali"},{"@type":"Country","name":"Malta"},{"@type":"Country","name":"Marshall Islands"},{"@type":"Country","name":"Martinique"},{"@type":"Country","name":"Mauritania"},{"@type":"Country","name":"Mauritius"},{"@type":"Country","name":"Mayotte"},{"@type":"Country","name":"Mexico"},{"@type":"Country","name":"Micronesia"},{"@type":"Country","name":"Moldova"},{"@type":"Country","name":"Monaco"},{"@type":"Country","name":"Mongolia"},{"@type":"Country","name":"Montenegro"},{"@type":"Country","name":"Montserrat"},{"@type":"Country","name":"Morocco"},{"@type":"Country","name":"Mozambique"},{"@type":"Country","name":"Namibia"},{"@type":"Country","name":"Nauru"},{"@type":"Country","name":"Nepal"},{"@type":"Country","name":"Netherlands"},{"@type":"Country","name":"New Caledonia"},{"@type":"Country","name":"New Zealand"},{"@type":"Country","name":"Nicaragua"},{"@type":"Country","name":"Niger"},{"@type":"Country","name":"Nigeria"},{"@type":"Country","name":"Niue"},{"@type":"Country","name":"Norfolk Island"},{"@type":"Country","name":"Northern Mariana Islands"},{"@type":"Country","name":"North Macedonia"},{"@type":"Country","name":"Norway"},{"@type":"Country","name":"Oman"},{"@type":"Country","name":"Pakistan"},{"@type":"Country","name":"Palau"},{"@type":"Country","name":"Palestine"},{"@type":"Country","name":"Panama"},{"@type":"Country","name":"Papua New Guinea"},{"@type":"Country","name":"Paraguay"},{"@type":"Country","name":"Peru"},{"@type":"Country","name":"Philippines"},{"@type":"Country","name":"Poland"},{"@type":"Country","name":"Portugal"},{"@type":"Country","name":"Puerto Rico"},{"@type":"Country","name":"Qatar"},{"@type":"Country","name":"Republic of the Congo"},{"@type":"Country","name":"Réunion"},{"@type":"Country","name":"Romania"},{"@type":"Country","name":"Rwanda"},{"@type":"Country","name":"Saint Helena"},{"@type":"Country","name":"Saint Kitts and Nevis"},{"@type":"Country","name":"Saint Lucia"},{"@type":"Country","name":"Saint Pierre and Miquelon"},{"@type":"Country","name":"Saint Vincent and the Grenadines"},{"@type":"Country","name":"Samoa"},{"@type":"Country","name":"San Marino"},{"@type":"Country","name":"Sao Tome and Principe"},{"@type":"Country","name":"Saudi Arabia"},{"@type":"Country","name":"Senegal"},{"@type":"Country","name":"Serbia"},{"@type":"Country","name":"Seychelles"},{"@type":"Country","name":"Sierra Leone"},{"@type":"Country","name":"Singapore"},{"@type":"Country","name":"Slovakia"},{"@type":"Country","name":"Slovenia"},{"@type":"Country","name":"Solomon Islands"},{"@type":"Country","name":"Somalia"},{"@type":"Country","name":"South Africa"},{"@type":"Country","name":"South Korea"},{"@type":"Country","name":"South Sudan"},{"@type":"Country","name":"Spain"},{"@type":"Country","name":"Sri Lanka"},{"@type":"Country","name":"Sudan"},{"@type":"Country","name":"Suriname"},{"@type":"Country","name":"Swaziland"},{"@type":"Country","name":"Sweden"},{"@type":"Country","name":"Switzerland"},{"@type":"Country","name":"Taiwan"},{"@type":"Country","name":"Tajikistan"},{"@type":"Country","name":"Tanzania"},{"@type":"Country","name":"Thailand"},{"@type":"Country","name":"Timor-Leste"},{"@type":"Country","name":"Togo"},{"@type":"Country","name":"Tonga"},{"@type":"Country","name":"Trinidad and Tobago"},{"@type":"Country","name":"Tunisia"},{"@type":"Country","name":"Turkey"},{"@type":"Country","name":"Turkmenistan"},{"@type":"Country","name":"Turks and Caicos Islands"},{"@type":"Country","name":"Tuvalu"},{"@type":"Country","name":"Uganda"},{"@type":"Country","name":"Ukraine"},{"@type":"Country","name":"United Arab Emirates (UAE)"},{"@type":"Country","name":"United Kingdom (UK)"},{"@type":"Country","name":"United States"},{"@type":"Country","name":"Uruguay"},{"@type":"Country","name":"U.S. Virgin Islands"},{"@type":"Country","name":"Uzbekistan"},{"@type":"Country","name":"Vanuatu"},{"@type":"Country","name":"Vatican City (Holy See)"},{"@type":"Country","name":"Vietnam"},{"@type":"Country","name":"Wallis and Futuna Islands"},{"@type":"Country","name":"Yemen"},{"@type":"Country","name":"Zambia"},{"@type":"Country","name":"Zimbabwe"}],"jobLocationType":"TELECOMMUTE"}