Principal Data Engineer

Company: US6469 Sysco Payroll, Division of Sysco Resources
Location: Houston
Posted on: November 20, 2024

Job Description:

Essential Functions:

• Manage all aspects of the data and analytics system from stream configuration to ETL to aggregate tables and cubes for reporting needs. Establish and maintain the data pipeline architecture. Anticipate and understand the impact of technical decisions across the organization.
• Partner with all facets of the business to include development, operations and consumers of data. Form and maintain relationships with stakeholders to understand needs and translate those needs into priorities and executable plans.
• Provide technical guidance to data engineers. Mentor engineers throughout the data and analytics organization. Review and provide feedback on technical deliverables from peer and junior data engineers.
• Write scripts to schedule data ingestion and syncing. Evaluate, lead and form back end logic to create data marts from requirements for the purposes of self-serving stakeholders.
• Oversee the code creation from junior members of the team. Troubleshoot issues and obstacles independently and act as a first level of escalation support for the team.
• Fix and research highly complex or difficult technical problems as a final source of escalation.
• Assist data architects to build the working framework for data search and retrieval.
• Identify required changes to the design and communicate to the architects.
• Other duties as assigned.
  Minimum Qualifications
  
  
  • 10 years experience of hands-on data platform design and development in large-scale and complex environments.
  • Experience with SQL and Python.
  • Experience with Redshift and Postgres.
  • Experience with AWS platform and technologies including Kinesis, Firehose and Glue.
  • Experience with cloud storage such as S3.
  • Experience orchestrating data ingestion and syncing metadata with event data.
  • Experience with ETL for reporting and business users (marketing, finance, product owners).
    Preferred Qualifications
    
    
    • Recognized degree in computer science or certification in technical related field.
    • 12 years experience of hands-on data platform design and development in large-scale and complex environments.
    • Experience with Tableau and Tableau Server.
      

Keywords: US6469 Sysco Payroll, Division of Sysco Resources , Baytown , Principal Data Engineer, Engineering , Houston, Texas