Job Purpose

Responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis.

Key Responsibilities

Construct, deploy, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices.

Develop software programs or use tools to bring together large, complex and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data.

Design and implement data tools for analytics and data scientist team members to help them in building, optimizing and tuning of use cases.

Develop and manage data warehouses to ensure the availability, performance, scalability and security of production data warehouse.

Develop software programs or use tools for cleansing and harmonization of data from a variety of data sources

Qualification

Bachelor’s Degree in IT with Minimum 4 years of job-related experience

Hands-on experience in working with big data using Google Cloud, cloud-based data engineering solutions

Hands-on experience with data ingestion tools, data modelling, data visualization, and pipeline design & development

Hands-on experience with BigQuery data warehouse platforms

Strong technical knowledge of performance tuning and query optimization on large data sets.

Experience with ETL tools, data virtualization, and semantic layer tools

Experience with visualization tools – Tableau, Power BI