- Peform the Extract, Transform, and Load (ETL) process for data pipelines
- Construct ETL job pipelines using ETL tools
- Manage ETL job scheduling and optimize data load
- Identify gaps in the ETL pipeline and execute data normalization to enhance data processing
- Gain extensive exposure to various database technologies and automation
- Design, create, document, and implement comprehensive data pipelines and integration processes, encompassing both batch and real-time data processing
- Perform data analysis, profiling, cleansing, lineage, mapping, and transformation
- Develop ETL/ELT jobs, workflows, and deploy data solutions
- Monitor and suggest improvements for data quality, reliability, efficiency, and cleanliness
- Optimize and fine-tune ETL/ELT processes
- Recommend and implement best practices in data management and data lifecycle processes
- Prepare test data and support the creation and execution of test plans.
- Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors, and business stakeholders to comprehend data requirements and implement data solutions
- Provide ongoing support for data issues and change requests, documenting all investigations, findings, recommendations, and resolutions
- Over 2 years of work experience in the insurance or finance industry
- Knowledge of IBM DataStage or equivalent ETL software
- Strong communication skills to effectively communicate and present technical information in a clear and unambiguous manner
- Familiarity with ETL/ELT frameworks, data warehousing concepts, data management frameworks, and data lifecycle processes
- Experienced in handling and processing diverse data types (structured, semi-structured, and unstructured)
- Thorough understanding of various database technologies (RDBMS, NoSQL, and columnar)
- Profound comprehension of programming languages such as Python
- Strong ability to work independently and collaborate with diverse teams in a multi-stakeholder environment
-
Data Tech Lead
发现在: Talent HK A C2 - 1天前
Morgan McKinley Hong Kong, 香港 全职A leading insurance firm is looking for an experienced data tech lead / analyst to join their dynamic team, to work on various new initiatives. · ResponsibilitiesOversee data management requirements gathering, analysis, and clarification for the project. · Review and provide fee ...
-
Data Engineer with Python
发现在: Talent AU C2 - 3小时前
Unison Consulting Pte Ltd Hong Kong, 香港 全职Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. · Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. · Optimize and troubleshoot AWS Glue jobs for performance ...
-
Data Architect
发现在: Talent HK A C2 - 3小时前
KPMG Hong Kong, 香港 全职KPMG China provides multidisciplinary services from audit and tax to advisory, with a strong focus on serving our clients' needs and their industries. Not only do we have an overriding commitment to provide the highest quality services for our clients, but we also strive to becom ...
-
eMPF Team Deployment
发现在: Talent HK C2 - 3小时前
Frankasia Search Limited Hong Kong, 香港Job Description · We are looking for highly skilled and motivated Data Engineers to work on the largest financial project in Hong Kong. As a Data Engineer, you will play a key role in managing and coordinating activities for the ETL processes to perform data migration. Your prima ...
-
eMPF Team Deployment
发现在: Talent HK C2 - 3小时前
Frankasia Search Limited Hong Kong, 香港We are looking for highly skilled and motivated Data Engineers to work on the largest financial project in Hong Kong. As a Data Engineer, you will play a key role in managing and coordinating activities for the ETL processes to perform data migration. Your primary responsibility ...
-
Consulting, Financial Services
发现在: Talent HK C2 - 3小时前
EY Hong Kong, 香港Diversity is a core value at EY. We are passionate about building and sustaining an inclusive and equitable working environment for all of EY people. We believe every member in EY teams enrich our diversity by exposing us to a broad range of ways to understand and engage with the ...
-
Consulting, Financial Services
发现在: Talent HK C2 - 2天前
EY Hong Kong, 香港Diversity is a core value at EY. We are passionate about building and sustaining an inclusive and equitable working environment for all of EY people. We believe every member in EY teams enrich our diversity by exposing us to a broad range of ways to understand and engage with the ...
-
ETL Developer
发现在: Talent HK C2 - 5天前
John Clements Consulting Inc. Hong Kong, 香港 全职JOHN CLEMENTS CONSULTANTS, INC. · Since its inception in 1974, John Clements Consultants, Inc. has grown into one of the largest consulting firms in the Philippines today, with a leadership position in the local market and a strengthening presence in the international scene, nota ...
-
Data Specialist, Data and Analytics
发现在: Talent HK C2 - 3天前
West Kowloon Hong Kong, 香港 全职The West Kowloon Cultural District Authority welcomes exceptional talent with a passion to realise the vision and mission of making the West Kowloon Cultural District a prime local and international destination for arts, culture and entertainment. · You will be responsible for: · ...
-
Solution Analyst
发现在: Talent HK C2 - 1天前
Cathay Pacific Airways Limited Hong Kong, 香港Role Introduction · Reports To: Solution Lead / Senior Solution Lead · To provide technical leadership in implementing end-to-end data warehouse solutions, including Customer Information Data warehouse, ETL and BI components; maintain and continuous enhance the solutions and comp ...
-
Senior Software Engineer
发现在: Talent HK C2 - 19小时前
Prudential plc Hong Kong, 香港 全职Prudential's purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our peop ...
-
Data Engineer
发现在: Talent HK C2 - 4天前
XGATE Hong Kong, 香港KEY RESPONSIBILITIES:Perform daily data operations, data modelling and database related matters · Implement end to end data pipeline (real-time and batches) from collection, transformation, data mapping, data modelling to visualisation · Collaborate with IT and marketing teams to ...
-
Big data
发现在: Talent HK C2 - 3小时前
CLPS Hong Kong, 香港Job Responsibilities: · Evaluate and renew implemented big data architecture solutions to ensure their relevance and effectiveness in supporting business needs and growth. · Design, develop and maintain data pipelines, with a focus on writing scalable, clean, and fault-tolerant c ...
-
Data Engineer, Senior Consultant/Manager, Finance Consulting
发现在: Talent HK C2 - 3天前
KPMG China Hong Kong, 香港KPMG China provides multidisciplinary services from audit and tax to advisory, with a strong focus on serving our clients' needs and their industries. Not only do we have an overriding commitment to provide the highest quality services for our clients, but we also strive to becom ...
-
Junior Data Engineer
发现在: Talent HK C2 - 5天前
Zurich Insurance Company Hong Kong, 香港Job Responsibilities: · Maintain project documentation, including technical specifications and data mappings to enhance the efficient use of data services · Ensure the quality, integrity, and security of data throughout the entire data lifecycle, applying robust database concep ...
-
Senior Analyst Programmer/ Data Analyst
发现在: Talent HK C2 - 3小时前
China Mobile Hong Kong Co. Ltd. Hong Kong, 香港In this position, you will: · 1.Support in-depth quantitative analysis, and communicate business insights to business departments and management · 2.Prepare descriptive and predictive reports for business activities based on past, present and expected operations · 3.Work with bus ...
-
Data Engineer
发现在: Talent HK C2 - 3小时前
CLPS Hong Kong, 香港Job Responsibilities: · Develop & maintain the ETL batch to manipulate the model result data (live logging by Kafka) on Hadoop platform (HDFS), the data is semi-structured and huge (~5TB daily), combine analytical data set with the logging data for model training, investigation & ...
-
Data Engineering Manager
发现在: Talent HK C2 - 2天前
The Bank of East Asia Hong Kong, 香港 全职Responsibilities · Responsible for Data Engineering of Data Lake and Data Warehouse; · Manage all project related budgets and costs (internal and external) and verify the costs spent in project execution as budgeted; · Build enterprise Big Data Analytics and AI blueprint and col ...
-
Junior Data Engineer
发现在: beBee S2 HK - 4天前
Zurich Insurance Company Ltd. HongKong, 香港Job Responsibilities: · Maintain project documentation, including technical specifications and data mappings to enhance the efficient use of data services · Ensure the quality, integrity, and security of data throughout the entire data lifecycle, applying robust database concepts ...
-
Data Engineer
发现在: Talent HK C2 - 1天前
West Kowloon Hong Kong, 香港 全职The West Kowloon Cultural District Authority welcomes exceptional talent with a passion to realise the vision and mission of making the West Kowloon Cultural District a prime local and international destination for arts, culture and entertainment. · You will be responsible for: · ...
ETL Engineer - Hong Kong, 香港 - Morgan McKinley
描述
A renowned insurance firm is looking for a junior data/ ETL engineer with insurance industry background to work on regional projectsResponsibilities: