Palantir Foundry Data Engineer
- Python
Palantir Foundry Data Engineer (Data Quality & Reconciliation)
Abu Dhabi, UAE | Fully on-site | Contract / project-based
About:
Hands-on Palantir Foundry experience is required. If you haven’t built in Foundry Code Repositories yourself, this role isn’t the right fit.
What you’ll do
- Build a reusable data quality rules engine in Python and PySpark in Foundry Code Repositories
- Run the rules at scale on cleansed datasets and check the results against reported data quality figures
- Review catalogue metadata, lineage, schemas, row counts and transformation dependencies
- Build automated data quality scoring pipelines and exception reports
- Investigate discrepancies, tune pipeline performance and keep clear documentation
Must have
- 5+ years in data engineering or large-scale data processing
- Hands-on Foundry delivery: Code Repositories, datasets, pipelines
- Strong Python, PySpark/Spark and SQL
- Proven data quality validation, reconciliation and automated testing
- Good knowledge of metadata catalogues, data modelling and lineage
Nice to have (Not must)
- Foundry Ontology or Workshop
- Government, banking or other regulated environments
- Arabic
If you fit the above requirements and are interested, hit the APPLY button!
openqareer не кадровое агентство: вакансия собрана с открытого источника, отклик подаётся на сайте работодателя.