openqareer

Bigdata Engineer -Spark

Marktine Technology Solutions Pvt Ltd · Удалённо · United States

# Bigdata Engineer -Spark **Marktine Technology Solutions Pvt Ltd** · United States · `Remote` · `Full Time` 💼 **Уровень роли:** `Mid-level` 🕒 **Статус:** *Опубликовано: сегодня* · *Источник: Himalayas (JSON API)* --- ### Top Skills & Match 🎯 **Ключевой стек роли:** `[Big-Data-Engineer]` `[Data-Engineer]` `[Spark-Developer]` `[Hadoop-Developer]` `[ETL-Developer]` `[Spark-Engineer]` `[Apache-Spark-Developer]` `[Big-Data-Developer]` `[Developer]` --- ### About the Role Category: Technology Location: Responsibilities: - As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies. - Technical Design and development of ETL/Hadoop and Analytics services /components - Contribute in end to end architecture and process flow - Understand Business requirement and publish reusable designs - Result oriented approach with ability to provide apt solutions. - Proficient in performance improvement & fine-tuning ETL and Hadoop implementations - Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies. - Can work independently with minimum supervision. - Strong analytical and problem solving skills - Experience/Exposure to SQL, advanced SQL skills Requirements Skills Set: - Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies. - Hands on experience with batch data ingestion (Sqoop) - Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch) - Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli) - Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra) - Understanding of Agile methodologies as well as SDLC life-cycles and processes. - Strong Understanding of Data warehousing and lakes Details Originally posted on Himalayas

Наблюдалась 2026-10-16, впервые 2026-10-16, источник — Himalayas (JSON API).

Открыть у работодателя