8+ years of software engineering experience.
Experience with following technologies - SQL, Airflow, Snowflake, Databricks, Spark, Py-Spark, Kinesis, Kubernetes, Docker
Data Architecture using Parquet, Avro, Star Scheme
Data Ingestion design pattern
Ability to design application components and evolve architecture including ui, api/services, data access, integration, application components etc.
Build tools to automate the monitoring or workload and take proactive measure to scale the platform or to fix the problem.
Research and develop proof of concept on integrations to new platforms.
Develop technical tools and programming that leverage big-data techniques to cleanse, organize and transform data and to maintain and update data structures and integrity on an automated basis.
You have experience leading a high performing team that solved challenging technical problems.
Category: IT & Programming
Subcategory: Data Science
Project size: Medium
Is this a project or a position?: Project
Required availability: As needed