Data Quality Engineer (Big Data), Citi

Citi

Location:

Ireland, Dublin

Category:

IT - Software Development

Contract Type:

Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

This role of Data Quality Lead requires a highly skilled and experienced data quality leader with a strong foundation in Cloudera technologies and a proven track record of success in building and maintaining robust data quality frameworks. The Data quality lead will be responsible for designing, implementing, and overseeing the data quality strategy across the organization, ensuring data accuracy, consistency and reliability within Bigdata and cloud-based data environments. This role involves hands-on involvement in data engineering activities, including the development and maintenance of data pipelines.

Job Responsibility:

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behaviour, conduct and business practices, and escalating, managing and reporting control issues with transparency
Design, Architect, Develop, maintain a comprehensive data quality framework across the big data platform
Define and establish automated data quality standards, policies and best practices
Develop and implement automated data quality check and validation rules
Automate the monitoring and analysis of data quality metrics to identify and address data quality issues proactively
Ensure data accuracy, completeness, consistency and timeliness throughout the data lifecycle
Develop and maintain automated data quality dashboards and reports
Collaborate with data engineering teams to modernize the data platform, incorporating data quality considerations into the design and implementation of new solutions
Continuously evaluate and improve the automated data quality framework based on evolving business needs, industry best practices and platform modernization initiatives
Provide technical guidance and mentorship to team members on implementing requirements, changes, and enhancements to existing data engineering framework
Foster a collaborative and high-performing team environment

Requirements:

Significant relevant experience in data engineering roles
Proven experience in designing, building, and maintaining data pipelines and data warehouses
In-depth knowledge of Cloudera Data Platform, CDP
Strong hands-on experience with Hadoop, Spark, Hive, Kafka and cloud platforms (AWS)
Proven leadership experience in leading and mentoring data engineering teams and driving project execution
Deep expertise in building and maintaining large-scale, complex data quality pipelines
Extensive experience in system analysis and in programming of software applications
Experience in managing and implementing successful projects
Ability to adjust priorities quickly as circumstances dictate
Demonstrated leadership and project management skills
Consistently demonstrates clear and concise written and verbal communication
Bachelor’s degree/University degree or equivalent experience
Master’s degree preferred

Nice to have:

Deep understanding of data quality principles, methodologies and automation best practices
Strong understanding of Python, expertise using Spark for data processing, transformations, and analysis
Ability to write efficient and performant SQL queries for large datasets, including techniques like partitioning, indexing and query tuning
In-depth knowledge of Cloudera Data Platform, CDP
hands-on experience with Hadoop, Hive, Spark, Impala, HBase and other Cloudera components
Knowledge of modern data architectures, cloud technologies and data lake concepts
Basic understanding of data visualization tools for dashboard design and creating meaningful insights
Ability to design, implement and maintain robust CI/CD pipelines for data engineering projects
Strong software engineering principles, object-oriented programming, design patterns and testing methodologies
Excellent communication, collaboration, and problem-solving skills to work effectively with cross-functional teams

Additional Information:

Job Posted:

March 22, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Data Quality Engineer (Big Data)