Senin, 16 Mei 2022

Work Opportunity at Xendit Indonesia in May 2022 - Loker Startup

Mei 16, 2022



Data Engineer
Responsibilities
  • Create and manage ETL data pipelines using Python, Spark, and Airflow.
  • Create and manage real-time pipelines using Kafka.
  • Improve and maintain the data lake setup (S3, EMR, Presto).
  • Integrate data from 3rd party APIs (e.g. Hubspot, Facebook).
  • Ensure data quality through automated testing.
  • Develop and maintain company metrics and dashboards.
  • Collaborate with analysts, engineers, and business users to design solutions.
  • Research innovative technologies and make continuous improvements.

You may be a good fit if
  • 3+ year as a data engineer developing and maintaining ETL pipelines.
  • Experience in building data lake/warehouse solutions consisting of structured and unstructured data.
  • Hands-on experience with big data technologies (e.g. Spark, Hive)
  • Experience in writing and optimizing SQL queries.
  • Good knowledge of Python.
  • Hands-on experience with BI tools (e.g. Looker, Redash).
  • Bachelor's degree in a technical field or equivalent work experience.
  • Have experience managing and designing data pipelines, debugging data issues.
  • Are familiar with real-time and/or large scale data.
  • You have built data products that have scaled on AWS or another cloud.
  • You thrive on nimble, lean, fast-paced startups, like autonomy, and have proven you can push towards a goal by yourself.
  • Coachable. Able to own mistakes, reflect, and take feedback with maturity and a willingness to improve.
  • You communicate with clarity and precision and you are able to effectively present results

Interested? Apply this vacancy on: