Job Description

Job Description Data Lineage Engineer

ROLE SUMMARY:
As a Data Lineage Engineer within the Data Governance Execution team, you will collaborate closely with the wider Data Trust team and key divisional stakeholders to develop the data pipeline models and workflows that will improve overall data governance process and deliver data trust objectives. You will be responsible for capturing requirements, delivering automation, and create a sustainable set of complex lineage models for D&A datasets. To be successful in the role you will require a strong background and understanding in building and optimizing data pipelines, architectures, and data sets.

WHAT YOU'LL BE DOING:
• Develop, construct, test, and maintain metadata repositories and data lineage models.
• Design and implement efficient ETL processes for loading metadata into Data Governance tools.
• Integrate different data storage solutions.
• Identify, design, and implement internal process improvements.
• Work with various stakeholders to assist with data-related technical issues.
• Build and maintain reliable data pipelines to move data across systems

WHAT YOU'LL BRING:
• Minimum of 3 years of experience in a similar role
• Strong in Java and Python programming languages

  • Strong understanding and working experience in Solidatus
    • Strong understanding of XML and JSON data formats
    • Knowledge of relational SQL and NoSQL databases(Oracle, MSSQL, Snowflake)
    • Experience with cloud services (AWS, Azure)
    • Familiarity with data visualization tools (Tableau, Power BI, etc.)
    • Strong analytical and problem-solving skills
    • Excellent communication and teamwork abilities

    Education:

    - Bachelor’s degree in Computer Science, Engineering, or a related field

    Preferred Qualifications:
    • Exposure to NLP and LLM technologies and approaches
    • Experience with machine learning and data mining techniques
    • Familiarity with data security and privacy concerns
    • Knowledge of data warehousing and business intelligence concepts
    • Advanced degree in Computer Science, Engineering, or a related field

 

 

Apply