Senior Data Platform Architect - Palantir Foundry & Databricks Integration

About the role

GoFasti is seeking a Senior Data Platform Architect to design and implement enterprise-scale federated architectures integrating Palantir Foundry and Databricks. The role involves leading the modernization of legacy ETL architectures, defining data governance models, and architecting secure connectivity across cloud environments. The successful candidate will serve as the technical authority for data platform architecture and support AI and machine learning workloads.

Responsibilities

• Design and implement enterprise-scale federated architectures integrating Palantir Foundry and Databricks.
• Establish standards for data sharing across Foundry, Databricks, BigQuery, and Cloud Storage environments.
• Define architecture patterns leveraging Delta Lake, Apache Iceberg, Unity Catalog, Foundry Ontology, Virtual Tables, and Catalog Federation.
• Lead the modernization of legacy ETL architectures toward metadata-driven, cloud-native data products.
• Define enterprise data governance, lineage, metadata, and ownership models across both platforms.
• Create architectural roadmaps supporting AI, machine learning, real-time analytics, and self-service data consumption.
• Design and implement Foundry Databricks Connector solutions, including bulk imports, incremental data synchronization, virtual tables, compute pushdown, and external model integrations.
• Build scalable ingestion, transformation, and enrichment pipelines using PySpark, Spark SQL, Python, Databricks Workflows, Airflow, and Foundry Code Repositories.

Required skills

• Data Engineering
• Data Architecture
• Platform Engineering
• Databricks
• PySpark
• Spark SQL
• Delta Lake
• Python
• Data Modeling
• Unity Catalog
• Apache Iceberg
• Lakehouse Architectures
• Data Governance
• Metadata Management
• Google Cloud Platform

Nice to have

• Palantir Foundry
• Ontology development
• AI/ML infrastructure
• Terraform
• Kubernetes
• GitHub Actions
• CI/CD Pipelines

Qualifications

• 8+ years of experience in Data Engineering, Data Architecture, or Platform Engineering
• 8+ years of experience with Databricks Lakehouse Architecture
• Experience implementing or operating Palantir Foundry data platforms

About the Company

GoFasti is a Talent-as-a-Service company that bridges the gap between world-class developers and designers from Latin America and first-class companies around the globe.