Senior - Data Engineer
DKATALIS
- Penuh waktu
- On-site • Jakarta
- Negotiable
Deskripsi Pekerjaan
We are seeking a hands-on Senior Data Engineer to help us build out and manage our data infrastructure, which will need to operate reliably at scale using a high degree of automation in setup and maintenance. The role will involve setting up and managing the data infrastructure plus building new systems where required. Responsibilities will extend to building and optimizing key ETL pipelines on both batch and streaming data. The ability to work with the teams from product, engineering, BI/analytics and data science is essential. Ownership needs to be taken of data model design and data quality. The individual will also play active roles in ensuring data governance tooling is implemented and policies thereby adhered to.
The individual will also need to be able to work with technical leadership to make well informed architectural choices when required. A high degree of empathy is required for the needs of the downstream consumers of the data artefacts produced by the data engineering team, i.e. the software engineers, data scientists, business intelligence analysts, etc and the individual needs to be able to produce transparent and easily navigable data pipelines. Value should be assigned to consistently producing high quality metadata to support discoverability and consistency of calculation and interpretation.
Kualifikasi
- Ideally GCP, but strong experience in another platform such as AWS or Azure will suffice
- Event streaming platforms such as Kafka
- Stream analytics frameworks such as Spark, GCP Dataflow, etc
- Workflow scheduler such as Apache Airflow
- Cloud data warehouses such as BigQuery, Redshift or Snowflake
- Fluency in using Kubernetes, Python.
- Comfortable writing detailed design documents
Tips Menjaga Diri
Perusahaan dan Lowongan di Dealls tidak meminta data pribadi, informasi rekening, atau pungutan ketika melamar. Hindari juga lowongan Google Form / Grup Telegram tanpa keabsahan yang jelas.
At DKatalis, we move forward by stimulating and, ultimately, catalyzing growth. To be a catalyst is to be the determinant of change. That's the spirit that we apply to our work culture, that each person—every katalis—has a share in every change they make, be it for the world, or for themselves. DKatalis is collaborating from two hubs at Southeast Asia (Jakarta and Singapore). Our team is led by people with extensive experience in their industries, a willingness to break the norms and try something new.
