Search by job, company or skills
Job Description:
As a Bizhare Data Engineer, you are going to build and maintain the organization's data pipeline systems, data lake, data warehouse, and data marts to make data available and accessible to companies to make data driven decisions.
Roles & Responsibility:
- Work within a cross-functional product team, collaborating with multiple stakeholders and engineers.
- Develop data pipeline custom components or analytics applications to ensure data pipeline jobs run smoothly.
- Build, validate and deploy machine learning models.
- Research opportunities for data acquisition and new uses for existing data.
- Contribute to the data warehouse design and data preparation by implementing a solid, robust, extensible design that supports key business flows.
- Performing all of the necessary data transformations to populate data into a warehouse table structure that is optimised for reporting.
- Build data pipeline and ETL orchestration.
- Continuously monitoring data pipeline to meet SLA.
- Ensuring best practices that can be adopted in Big Data stack and share across teams and business units
- Actively participate in specification planning with Back-end and QA engineers.
Qualification:
- A Bachelor's/Master's degree, preferably in Analytics, Statistics or Engineering.
- 1 - 3 years of experience or multiple internships (for Analysts) in Analytics, Business Intelligence or Data Science roles, preferably in an Internet or Direct to Consumer company with large, complex, high-velocity data.
- Deep understanding of Relational Database Management Systems (RDBMS) (e.g. PostgreSQL, MySQL) , No-SQL Databases (e.g. MongoDB, ElasticSearch) and hands-on experience in implementation and performance tuning of MPP databases (e.g. Hadoop, BigQuery).
- Familiar with Python, Ruby or Java, CI/CD & Docker.
- Strong foundation in data query/manipulation using SQL and data visualization using tools like Google Data Studio is a plus.
- Experienced in building data streaming applications using Kafka or Pubsub.
- Experienced in Google Cloud Services and multidimensional modeling is a strong plus.
- Experienced using Big Data technologies (Spark, BigQuery) is a strong plus.
- Experienced in Software Engineering is a strong plus.
- Effective communicator to both technical and business audiences.
- Passionate about solving problems possesses a relentless need for investigation and data exploration.
- Results and detail-oriented, with strong intuitions on how to solve problems creatively and quickly.
Date Posted: 20/10/2024
Job ID: 97024289