L3 Engineer (Dremio, Python) - Jobs in Halifax, Nova Scotia, B3K 3M5

Job Description

L3 Engineer (Dremio, Python)Canada Halifax, Nova ScotiaContract Position.Rate as per the marketClient :: RBCRole Responsibilities

• Engage and partner with data virtualization CTB RTB Dremio Vendor and client applications
• Analyze and resolve production and nonproduction issues analyze product logs and find RCA
• Identify repetitive issues raise problem tickets and work upon tacticalstrategy fixes
• Dremio version upgrade in all nonprod instances standalone as well as containerized
• Enhancements in data virtualization services written in python
• Identify and resolve system vulnerabilities
• Identify opportunities to automate manual work
• Identify long running queries and tune the same
• Partner with the platform engineering teams to ensure technical capabilities and data requirements are well understood identify dependencies and integration points
• Work with upstream to onboard new datasets perform validations to confirm if clients ask is complaint with DVs guidelines
• Able to derive insights from Grafana telemetries monitor clusters health automate SOWSODEOD checks
• Participate in vendor calls sprint ceremonies reviews or inspections in collaboration with the project team to ensure the quality of the deliverables
• Participate in the user acceptance testing implementation planning post implementation validations and L3 production incident analysis as needed

Minimum Requirements

• Strong knowledge of Data Fabric Data Virtualization concepts containers
• 8 years of experience in Dremio Data virtualization product running Dremio in K8 containers
• Ability to work independently apply critical and strategic thinking to issues and manage deadlines while multitasking amongst different priorities
• 8 years of experience working as a Developer L3 in Data engineering field handling large data volume
• Proven experience in Lake databases big data nosql rdbms SQL query tuning able to read analyze query execution plans debug applicationserver logs assist team in analyzing the issues
• Understanding of different infrastructures physical servers containers virtual machines cloud
• Strong tech expertise Dremio Python SQL RestAPI HiveHDFS Kubernetes Helm chart Linux and data formats eg Iceberg Delta format Parquet Avro JSON
• Knowledge of containers kubernetese pods nodes PVPVC Load balancer helm deployment
• Knowledge of application security vault SSL TSL secrets connectivity channels JDBC ODBC Arrowflight
• Knowledge of different Storage classes S3 NAS Trident SSDs
• Understanding of Azure cloud ADLS Shipment pipeline would be plus
• Mode Hybrid two days a week work from office mandatory

SkillsMandatory Skills : ANSI-SQL, Dremio.