Data Engineer - Jobs in Nova Scotia

Job Description

ABOUT THE COMPANYMilk Moovement is building a world-class team focused on getting the right milk to the right place at the right time.Our herd of over 65 employees and growing is driven to provide our clients with the data they need to make critical decisions that impact their operations and ultimately your favorite dairy products.Who is Milk Moovement you might ask We are a young VC-backed company with humble roots and massive ambitions to disrupt the dairy supply chain. We think differently, act nimbly, andalways leave things better than we found them.We #39;re adding to our team as we continue significant growth in 2023. Check us out on Twitter, Instagram, LinkedIn (@milkmoovement), and our home page to learn more or hit “apply” below!THE ROLEWe’re hiring a Data Engineer to join our team! As an Engineer working on our Platform value stream you will help develop, implement and maintain systems and processes that will transform raw data so that end users and stakeholders can easily work with it. Here are some examples of things you might do:• Develop and maintain new and existing ETL pipelines• Continuously improve overall performance of all data infrastructure and technology stack• Engage in design sessions to build new data products for the platform• Assist with best practices for development and deploymentYou will be part of a cross-functional team distributed across North America but with offices in Halifax and St. John’s. You should be comfortable coming to our offices if nearby, and not shy on Zoom and Slack if remote.WHAT WE ARE LOOKING FORMilk Moovement seeks to have a diverse, inclusive, team-oriented, and curiosity-driven herd. Our technical team lives to find unique solutions to the challenges inherent to digital supply chains, and we expect you will be excited to do so as well. You must have prior experience with data engineering, but experience working in the dairy industry is not required! We will teach you all there is to know about the industry beginning with our Dairy 101 course. It is definitely more complicated than you think and that is why we do what we do! You will likely have been working with big data to help businesses solve real-world problems. You have an aptitude for engineering, big data architecture, and experience implementing various data engineering patterns including but not limited to Warehousing, Modeling, Analytics and ingestion from multiple data sources. You like getting your hands dirty with data, and are passionate about turning raw data into something useful for business. You are proficient in SQL and Python, and are eager to be part of an area of growth for Milk Moovement.WHAT ELSE• A good understanding of Data Warehousing concepts and cloud ETL/ELT design patterns (real time, batch, event-driven workflows)• Comfortable in designing efficient and robust ETL workflows• Monitoring ( e.g Datadog, AWS CloudWatch,)• Visualization tools (Metabase, Tableau, or similar)• Experience building with AWS, especially using data engineering services such as Athena, Kinesis, DMS• Experience working with Cloud Data Warehousing and Orchestration Tools (such as Snowflake, DBT, Dagster, Airflow)• Experience with Terraform along with other AWS specific IaC Tools (CloudFormation or CDK)• Experience standing up CI/CD pipelines for data infrastructure• Knowledge of API technologies (REST, Authentication and Authorization)A Team Player – collaborative, approachable, • Ability to prioritize and work in a dynamic workplace• Experience using container-based services (Docker, ECS, Kubernetes) is preferred but not required• Real time streaming experience (e.g Kafka) is preferred but not requiredWHAT WE OFFER