Technical
- PSQL (postgres SQL) including writing Functions (Mandatory)
- Basic Linux Shell Scripting (Mandatory)
- ETL Tools Informatica/Datastage/Airflow etc (Mandatory)
- Data Analysis/Mining skill to identify the Pattern in Data and investigate the issues
(Mandatory)
- Database Postgres/Greenplum/mySQL knowledge (Advantage)
Functional
- Working in Telco/Finance specially for reconciliation/Audit process (Advantage)
Job Desc
- Need to understand the current ecosystems of ETL
- Need to document all the process executing and data stream coming from various
systems. Along with following details Source type, description, frequency, format, etc
- Need to understand the existing data storage and applications and best practices we
follow
- Develop Data Pipeline for up-stream and down-stream integration for data processing
applications both in real-time and batch.
- Optimize the Pipeline developed or existing pipeline if required to ensure the process is
optimized
- Enhance existing workflows to support the project task
- Support Operation team in case there are bugs in the release and develop fixes
- Automation of Report/Data feed delivery to business for tracking or reconciliation
process
- Develop code which generate alarms in case the data is not in trend or not arrive on
time.
