Job Description S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and sustain data pipelines that ingest, transform, store, and distribute mission-relevant data across the DIFC2 software ecosystem and external mission partner systems/ You will support the development and delivery of software capabilities that improve data accessibility, mission integration, operational visibility, and cross-system interoperability across a highly dynamic mission environment. The focuses on enabling reliable, automated, and secure data flows that support mission capabilities on operational timelines.

Requirements

The engineer will leverage both low-code/no-code ETL technologies and custom software development to implement scalable data pipelines that support the data architecture.

Data Pipeline Development & Sustainment: Design and implement automated data pipelines that ingest, transform, persist, and expose data artifacts for use by internal and external stakeholders. Utilize government-provided data platform infrastructure to build scalable ETL workflows. Develop custom transformation logic when required using appropriate programming languages and data processing frameworks.

Expose processed data products through standardized service interfaces such as REST APIs or platform-native services. Data Pipeline Development & Sustainment: Implement data validation, normalization, and transformation logic to ensure accuracy and usability of integrated datasets. Troubleshoot data pipeline failures and implement monitoring, logging, and recovery mechanisms.

Deliverables & Key Projects Design and implementation of production data pipelines enabling automated ingestion and dissemination of mission data across systems. Technical documentation describing data artifacts, including purpose and operational relevance, source systems and ingestion methods, transformation logic, and destination systems and access interfaces Interface documentation supporting integration with external mission partners. RMF technical artifacts supporting security authorization of data interfaces.

Continuous improvement and sustainment of the data pipeline ecosystem to support evolving mission needs.

Responsibilities

Include: Mission-Relevant Data Artifact Identification: Analyze mission workflows and system architecture to identify the data artifacts required to support operational capabilities. Define the structure, semantics, and lifecycle of mission data products within the data architecture. Ensure data artifacts align with architectural standards for interoperability, traceability, and reuse across mission components.

Coordinate with External Stakeholders: Serve as the primary technical liaison for defining data exchange interfaces between mission systems. Collaborate with mission partners to define message schemas, data formats, transport mechanisms, and interface expectations. Document data interface specifications to support both system integration and operational sustainment.

RMF & Security Documentation Support: Support the RMF process by defining technical details for machine-to-machine data interfaces.

Qualifications

9 years of experience and a Bachelor’s degree

Data Engineer, TS/SCI