Senior Scala Developer_Mumbai

Role-Senior Scala Developer

Experience-7-14 Years

Location-Mumbai (Powai)

Skills- Scala, Spark, UNIX
• Minimum 5+ years of experience in development of Spark Scala
• Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop
• Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing.
• Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc
• Experience in debugging the Spark code
• Working knowledge of basic UNIX commands and shell script
• Experience of Autosys, Gradle

Good-to-Have
• Good analytical and debugging skills
• Ability to coordinate with SMEs, stakeholders, manage timelines, escalation & provide on time status
• Write clear and precise documentation / specification
• Work in an agile environment
• Create documentation and document all developed mappings

Responsibility of / Expectations from the Role

Create Scala/Spark jobs for data transformation and aggregation

Produce unit tests for Spark transformations and helper methods

Write Scaladoc-style documentation with all code

Design data processing pipelines