Engineer II, Data Engineering
Qualifications:
- BS in Computer Science or related field
- 3+ years of experience in the data and analytics space
- 3+ years of RDBMS concepts with strong data analysis and SQL experience
- Must have strong Python skills, along with lambdas and Airflow Dag processing.
- 2+ years of Linux OS command line tools and bash scripting proficiency
- 3+ years of Python experience. Solid programing experience in Python - needs to be an expert in this 4/5 level.
- Working knowledge using Python, Spark, Airflow, Hive, Snowflake and AWS services.
- Exposure to software engineering such as parallel data processing, data flows, REST APIs, JSON, XML, and micro service architectures
- 1+ year of experience working on Big Data Processing Frameworks and Tools
Nice to have:
- Prior working experience on data science work bench
- Knowledge of data engineering aspects within machine learning pipelines (e.g., train/test splitting, scoring process, etc.)