Experienced Data Engineer for Etl, Data Management, and Pipeline Development

We are seeking a highly skilled and experienced Data Engineer to join our team. As a custodian of data for our clients, the Data Engineer will leverage their technical expertise in ETL processes to ensure all operational data functions are performing as expected. This comprehensive role involves managing data implementations, integrations, production, quality, and security.

Key Responsibilities:

Create, maintain, and execute intermediate to advanced Spark scripts for robust data management, validation, and integration.
Create, maintain, and execute basic to intermediate SQL scripts for effective data management and validation.
Optimize existing queries to significantly improve the efficiency of daily data tasks.
Perform in-depth data analysis to proactively identify and resolve any potential data-related issues.
Collaborate closely with various internal groups, including the Engineering team, DBA, and Cloud Operations, to troubleshoot and resolve environmental or network issues that may impact data operations. Provide after-hours or weekend support as necessary.
Design, create, and maintain reliable data pipelines to support ongoing data flow and processing needs.
Validate task results meticulously to ensure all project requirements and data integrity standards are met.
Adhere strictly to all industry-level and organizational compliance rules and regulations to uphold the highest standards of data integrity.
Complete individual productivity tracking accurately.
Manage and complete task assignments using the department's ticketing system within established deadlines.
Actively work towards achieving organizational and individual goals as defined in performance reviews and goal-setting exercises.
Undertake all special projects and other duties as assigned.
Must be able to perform duties with or without reasonable accommodation.