AWS Senior Software Engineer

Job Description

As a Senior Software Engineer, you will work on teams building a variety of big data analytics solutions including big data lakes. More specifically, you will work on:
• Scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data
• High-performance data processing for structured and unstructured data, and data harmonization
• Scheduling, orchestrating and validating pipelines
• Exception handling and log monitoring for debugging
• Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics solutions

Job Requirement

Required Experience, Skills & Competencies
• Hands-on experience with:

Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etc

Spark, Scala, Python, and core/advanced Java

NoSQL databases e.g. Hbase, Cassandra, MongoDB

Relevant AWS components required to build big data solutions

Good to know: Databricks, Snowflake
• Ability to develop and manage scalable Hadoop cluster environments
• Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
• 3+ years of professional experience with at least 2 years in big data engineering

Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry