Senior Data Engineer

Lead the design, development, and optimization of a multi-tenant data stack using managed stacks and services like AWS
• Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
• Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
• Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
• Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
• Develop and maintain automated testing frameworks to ensure data quality and accuracy
• Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
• Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
• Continuously improve processes and systems to increase efficiency and scalability
• Lead and mentor a team of data engineers

Requirements
• Bachelor's degree in Computer Science, Mathematics, or a related field
• At least 7 years of experience in data engineering or a related field
• Proven experience leading a team of data engineers
• Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
• Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
• Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
• Experience with data visualization tools such as AWS QuickSight or Tableau Server
• Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
• Familiarity with distributed computing systems such as Hadoop and Spark
• Strong problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent written and verbal communication skills
• Strong attention to detail and ability to multi-task

This job is provided by Shine.com

India
Maharashtra
Mumbai Show on map Get directions