Mike] Senior Data Engineer

FoodChain ID Group, Inc

  • Brasil
  • Permanente
  • Período integral
  • Há 7 horas
  • Aplicar facilmente
Job Duties:· Use Python and SQL to efficiently create, extract, transform, and optimize very large datasets.· Troubleshoot data and data processes and develop solutions for improvement.· Develop and maintain data models, schemas, and documentation.· Contribute as a hands-on engineer while sometimes taking the lead in the technical design and solution.· Collaborate daily with data scientists, food scientists, product owners, team members, API developers, architects, and DevOps engineers.· Advise other developers, both junior and senior, and share best practices.This job description is not intended to be all-inclusive. Employees may be asked to perform additional tasks as required, that may or may not be related to their primary duties.Required Qualifications:· Minimum 7 years’ experience using Python for analyzing, extracting, creating, and transforming large datasets.· Proficiency in Python 3+ and common Python libraries and tools for data engineering, specifically Pandas, NumPy, and Jupyter Notebooks.· Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server.· Solid understanding of database design principles, data modeling, and data warehousing concepts.· Excellent troubleshooting skills and instincts.· Curious, self-motivated, and self-directed; comfortable working within an Agile software development team with short, iterative delivery cycles.· College degree or equivalent experience in computer science, software development, engineering, information systems, math, food science, or other applicable field of study.Preferred Qualifications:· NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.· Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing· Exposure to Terraform or other Infrastructure-as-Code tooling.· Proficient in Azure DevOps for source code and pipeline management.Location: RemoteJob Type: Full TimePowered by JazzHR

FoodChain ID Group, Inc