- Peform the Extract, Transform, and Load (ETL) process for data pipelines
- Construct ETL job pipelines using ETL tools
- Manage ETL job scheduling and optimize data load
- Identify gaps in the ETL pipeline and execute data normalization to enhance data processing
- Gain extensive exposure to various database technologies and automation
- Design, create, document, and implement comprehensive data pipelines and integration processes, encompassing both batch and real-time data processing
- Perform data analysis, profiling, cleansing, lineage, mapping, and transformation
- Develop ETL/ELT jobs, workflows, and deploy data solutions
- Monitor and suggest improvements for data quality, reliability, efficiency, and cleanliness
- Optimize and fine-tune ETL/ELT processes
- Recommend and implement best practices in data management and data lifecycle processes
- Prepare test data and support the creation and execution of test plans.
- Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors, and business stakeholders to comprehend data requirements and implement data solutions
- Provide ongoing support for data issues and change requests, documenting all investigations, findings, recommendations, and resolutions
- Over 2 years of work experience in the insurance or finance industry
- Knowledge of IBM DataStage or equivalent ETL software
- Strong communication skills to effectively communicate and present technical information in a clear and unambiguous manner
- Familiarity with ETL/ELT frameworks, data warehousing concepts, data management frameworks, and data lifecycle processes
- Experienced in handling and processing diverse data types (structured, semi-structured, and unstructured)
- Thorough understanding of various database technologies (RDBMS, NoSQL, and columnar)
- Profound comprehension of programming languages such as Python
- Strong ability to work independently and collaborate with diverse teams in a multi-stakeholder environment
-
Core System Manager
6小时前
Omni Group Asia Ltd. Hong Kong, 香港 全职Core Responsibilities: · Analyze, maintain, and improve core system administration systems · Support users on application systems. · Collaborate with IT Managers to develop and implement the IT strategic plan, aligning with financial targets. · Monitor IT systems, policies, and ...
-
Data Tech Lead
1天前
Morgan McKinley Hong Kong, 香港 全职A leading insurance firm is looking for an experienced data tech lead / analyst to join their dynamic team, to work on various new initiatives. · ResponsibilitiesOversee data management requirements gathering, analysis, and clarification for the project. · Review and provide fee ...
-
ST Partnership Limited Hong Kong, 香港 全职Assistant Manager – Transformation and Architecture (Up to 65K) · Responsibilities: · Assist supervisor to develop IT project pipeline and communicate with stakeholders · Assist supervisor to define and communicate a shared technical and architectural vision to ensure the system ...
-
Frankasia Search Limited Hong Kong, 香港Job Description · We are looking for highly skilled and motivated Data Engineers to work on the largest financial project in Hong Kong. As a Data Engineer, you will play a key role in managing and coordinating activities for the ETL processes to perform data migration. Your prima ...
-
Data Architect
1周前
KPMG Hong Kong, 香港 全职KPMG China provides multidisciplinary services from audit and tax to advisory, with a strong focus on serving our clients' needs and their industries. Not only do we have an overriding commitment to provide the highest quality services for our clients, but we also strive to becom ...
-
Frankasia Search Limited Hong Kong, 香港We are looking for highly skilled and motivated Data Engineers to work on the largest financial project in Hong Kong. As a Data Engineer, you will play a key role in managing and coordinating activities for the ETL processes to perform data migration. Your primary responsibility ...
-
Team Leader
1周前
Bloomberg Hong Kong, 香港 全职Bloomberg runs on data. In Bloomberg Data, we're responsible for on-boarding, standardizing, analyzing and supplying it to our clients for their financial data needs. · The Company Financials team provides our clients with fast and accurate market-moving data so they can stay on ...
-
EY Hong Kong, 香港Diversity is a core value at EY. We are passionate about building and sustaining an inclusive and equitable working environment for all of EY people. We believe every member in EY teams enrich our diversity by exposing us to a broad range of ways to understand and engage with the ...
-
EY Hong Kong, 香港Diversity is a core value at EY. We are passionate about building and sustaining an inclusive and equitable working environment for all of EY people. We believe every member in EY teams enrich our diversity by exposing us to a broad range of ways to understand and engage with the ...
-
HSBC Hong Kong, 香港 Permanent - 全职Some careers have more impact than others. · If you're looking for a career that will give you plenty of opportunities to develop, join HSBC and your future will be rich with potential. Whether you want a career that could take you to the top, or simply take you in an exciting n ...
-
Data Engineer
2天前
Tower Research Capital Hong Kong, 香港Responsibilities Designing, implementing, and maintaining the infrastructure necessary to support the firm's data management processes, including storage, compute, and networking resources · Troubleshooting and resolving infrastructure-related issues, including hardware and soft ...
-
KPMG China Hong Kong, 香港KPMG China provides multidisciplinary services from audit and tax to advisory, with a strong focus on serving our clients' needs and their industries. Not only do we have an overriding commitment to provide the highest quality services for our clients, but we also strive to becom ...
-
Bloomberg Hong Kong, 香港Senior Data Management Professional - Data Engineering - Equity Corporate Actions Data, Hong Kong · Hong Kong · Posted Apr 23, Requisition No · Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for o ...
-
Prudential plc Hong Kong, 香港 全职Prudential's purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our peop ...
-
WomenTech Network Hong Kong, 香港Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock – from around the world. In Data, we are responsible for delivering this data, news and analytics through innovative t ...
-
Big data
1周前
CLPS Hong Kong, 香港Job Responsibilities: · Evaluate and renew implemented big data architecture solutions to ensure their relevance and effectiveness in supporting business needs and growth. · Design, develop and maintain data pipelines, with a focus on writing scalable, clean, and fault-tolerant c ...
-
Data Engineer
3天前
XGATE Hong Kong, 香港KEY RESPONSIBILITIES:Perform daily data operations, data modelling and database related matters · Implement end to end data pipeline (real-time and batches) from collection, transformation, data mapping, data modelling to visualisation · Collaborate with IT and marketing teams to ...
-
KPMG China Hong Kong, 香港KPMG China provides multidisciplinary services from audit and tax to advisory, with a strong focus on serving our clients' needs and their industries. Not only do we have an overriding commitment to provide the highest quality services for our clients, but we also strive to becom ...
-
Data Engineer
1天前
CLPS Hong Kong, 香港Job Responsibilities: · Develop & maintain the ETL batch to manipulate the model result data (live logging by Kafka) on Hadoop platform (HDFS), the data is semi-structured and huge (~5TB daily), combine analytical data set with the logging data for model training, investigation & ...
-
China Mobile Hong Kong Co. Ltd. Hong Kong, 香港In this position, you will: · 1.Support in-depth quantitative analysis, and communicate business insights to business departments and management · 2.Prepare descriptive and predictive reports for business activities based on past, present and expected operations · 3.Work with bus ...
ETL Engineer - Hong Kong, 香港 - Morgan McKinley
描述
A renowned insurance firm is looking for a junior data/ ETL engineer with insurance industry background to work on regional projectsResponsibilities:
