Senior Data Engineer

Job Description

• Design overall architecture for data lake, data warehouse, and data science project on cloud platform.

• Develop data pipelines for data ingestion, data quality, transformation, data integration with 3rd party using agile methodology.

• Develop and test data integration with different systems to ingest data into data lake.

• Review and optimize existing data pipeline/solution.

• Create, maintain, and update data model and data lineage documentation.

• Coach and grow junior data engineer.

• Working with stakeholders including Executive, Operation, Finance, Product, etc team to support their data infrastructure needs while assisting with data-related technical issues.

Job Requirements

• More than 3 years of working experience as data engineer.

• Proficient in design and deliver cloud-based data solution(e.g. AWS, GCP, Azure).

• Proficient in performance tuning for data pipeline/process, SQL/Hive, Spark.

• Proficient in data warehouse modeling and data architect with cloud and big data

  technology.

• Proficient in programming languages (e.g. Scala, Python).

• Proficient in data development framework & data engineering design principles.

• Excellent problem solving and troubleshooting skills.

• Proficient with cloud big data technology (Cloud object storage (S3, GCS, etc), MPP DB, etc).

• Proficient with Agile delivery (e.g. Scrum, Kanban)

• Process oriented with great documentation skills.

• Certification in data engineering is a plus (e.g. AWS, Google Cloud).

• Degree in Computer Science, IT or similar field; Master is a plus.