Senior Data Engineer
- Bachelors or master’s degree in computer science or the related field of study.
- Prior experience in building, developing, architect scalable big data applications in AWS cloud environments.
- 3+ years of experience working as Lead Data Engineer implementing data projects at scale involving terabytes of data
- 6+ years of experience in the data and analytics space
- 3+ years working experience with AWS Big Data stack, Hive, Spark, Spark Streaming, kinesis
- Strong experience in Python, PySpark - needs to be an expert in this 4/5 level.
- Strong understanding of Serverless architecture and implementation.
- Expertise with data modeling, data warehousing, and modern largescale data platform components. Snowflake is Plus
- Experience with Scala and/or Java and Python.
- Strong algorithm & data structure knowledge
- Experience with containerization, CI/CD, Kubernetes, etc.
- 5+ years of experience involving developing real-time consumption (Stream processing, Micro Services)
- Solid understanding dealing with variety of data and bigdata Data formats.
- Certification –preferably AWS Certified Big Data or any other cloud data platforms, big data platforms
- 3+ years of Linux OS command-line tools and bash scripting proficiency
- Prior experience operationalizing ML model is a plus
- Experience in NOSQL, preferably Cassandra, DynamoDB, Couchbase
- Confident in communicating with business & technical stakeholders alike.
- Strong customer focus, ownership, urgency, and drive
Important Personal Attributes:
- You are curious about technology & science.
- Team matters.
- Challenging yourself is an intrinsic part of who you are.
- Sharing and debating ideas to get to the right answer is important to you.
- You seek to act and don't wait to be told.
- You like to teach those around you.
- You take pride & ownership in building a product and company that is disrupting an industry.
- You have a passion for technology and data analytics with a strong desire to constantly be learning and honing skills
- Ability to work in a team environment
- Able to collaborate with cross-functional IT teams and global delivery teams
- Flexible to work in matrix reporting structure