Collibra Data Lineage Automation Engineer

Job Description

Job DescriptionDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining themeaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.

• Jobseeker Video Testimonials
  
• Employee Glassdoor Reviews
  

If you are a Collibra Data Lineage Automation Engineer, looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title: Collibra Data Lineage Automation Engineer
Location: Onsite – 5 days/week in McLean, VA
Work Type: 1099 / C2C / W2
Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD



Requirements

We are seeking a highly experienced Collibra Data Lineage Automation Engineer to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage), a strong foundation in AI/ML-driven metadata intelligence, and proven experience delivering lineage automation in hybrid cloud and legacy environments.

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

• Lead the implementation of automated lineage across diverse systems:
  

  • Cloud platforms (e.g., Snowflake, AWS)
    

  • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle)
    

  • NoSQL databases (e.g., MongoDB)
    

  • BI/reporting tools (e.g., Tableau, Power BI)
    

• Design and extend lineage capture frameworks (Spline, OpenLineage, Marquez) for enterprise-wide adoption.
  

• Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.
  

• Integrate lineage with metadata/governance platforms (Collibra, Alation) to ensure usability and traceability.
  

• Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).
  

• Develop reusable lineage components and promote automation-first, reusable design principles.
  

• Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices.
  

Required Skills & Experience

• Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).
  

• Hands-on experience with Spline, OpenLineage, Marquez, or similar open-source lineage frameworks.
  

• Deep knowledge of metadata capture, ETL tracing, and query execution mapping.
  

• Strong AI/ML background, with experience in:
  

  • Metadata intelligence
    

  • NLP-based code parsing
    

  • Pattern detection in lineage gaps
    

• Programming expertise in Python, Scala, or Java.
  

• Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB, etc.
  

• Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).
  

Nice-to-Have / Big Plus Skills

• Hands-on experience with commercial lineage tools (evaluation or implementation).
  

• Background in regulated industries (finance, healthcare, insurance).
  

• Familiarity with event-driven architectures for real-time lineage propagation.
  

• Exposure to data mesh and domain-driven lineage approaches.
  

Ideal Candidate Profile

• Has successfully delivered automated lineage at enterprise scale.
  

• Operates at the intersection of data engineering, metadata management, and AI innovation.
  

• Acts as a strategic thought partner to architects, governance leads, and business stakeholders.
  

• Brings an automation-first, reusable component mindset to all lineage solutions.
  

BenefitsVisit us at http://alignity.io/careers. Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here
Clients Testimonial: Click Here