Senior Databricks Data Engineer, ERP & Logistics Data

About the Role We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. A part is not just a design. It has cost and supplier data in Oracle E-Business Suite, and a logistics record, including maintenance tasks, provisioning, and support requirements, in a logistics support analysis system. The digital thread is only complete when those records connect to the engineering data coming from PLM and system models. You will build that connection. You will bring read-only cost, supplier, and logistics data from Oracle E-Business Suite and SLICwave into Databricks, whether it arrives as database extracts landed in S3 or through direct read access once the client's security approvals are in place, and model it so it links cleanly to parts and revisions across the platform. What You’ll Do Ingest cost and supplier data from Oracle E-Business Suite into Databricks, using file-based ingestion from S3 extracts or direct read access, including session-level init parameter handling to work within row-level security. Ingest SLICwave logistics support analysis data into Databricks, working with its relational backend and file exports. Implement incremental and batch refresh patterns for both sources, starting from representative extracts where direct access is still pending. Configure schema evolution and baseline data quality checks in Databricks declarative pipelines. Model cost, supplier, and logistics data so it links to parts, revisions, and BOM structures from Teamcenter and other engineering sources. Support the architect in presenting the Oracle integration approach to enterprise security reviewers, including documentation of access patterns and controls. Orchestrate pipelines with Databricks Workflows and ensure lineage is captured for every pipeline. Work with logistics and ERP SMEs to understand data structures, business rules, and extraction constraints. What We’re Looking For 6+ years in data engineering, including production experience building ingestion pipelines on Databricks. Working knowledge of Oracle E-Business Suite data structures, including cost, supplier, item, and BOM tables. Experience with relational ingestion into Databricks from Oracle, SQL Server, or comparable databases. Understanding of Oracle E-Business Suite's multi-org security model and how it affects returns. Experience with Auto Loader and file-based ingestion from S3. Experience with Databricks declarative pipelines or Delta Live Tables, including schema evolution configuration. Experience modeling ERP or logistics data so it joins to engineering or product data. Strong PySpark and SQL, and working knowledge of Delta Lake internals such as managed vs. external tables and predictive optimization. Experience with Databricks Workflows for orchestration. Clear written communication, including documenting integration designs for security review. Ability to complete the client's background check and onboarding and to work on client-furnished equipment. US citizenship. Fluent English, both written and spoken. Nice to Have Familiarity with PLM data, such as Teamcenter parts, BOMs, and revisions. Familiarity with logistics support analysis (LSA/LSAR) data, such as GEIA-STD-0007 or MIL-STD-1388-2B structures. SLICwave experience is a plus Experience migrating Oracle or EDW workloads to Databricks. Experience with Lakeflow Connect or other CDC-based ingestion tools. Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data. Databricks Data Engineer Professional certification. Why Lumenalta is an amazing place to work at At Lumenalta, you can expect that you will: Be 100% dedicated to one project at a time so that you can innovate and grow. Be a part of a team of talented and friendly senior-level developers. Work on projects that allow you to use leading tech. For Databricks practitioners specifically, we are a Databricks partner wit…

View the full posting and apply