Data Engineer Cloud
REQUIREMENTS
4 year College degree in Computer Science, Information Technology or equivalent demonstrated experience. Masters degree preferred.
Strong SQL development skills using databases like oracle and Vertica.
Experience in cloud databases like Snowflake or Redshift is a plus
Experience with AWS technologies such as EC2, S3 and other basic AWS technologies
Certification –preferably AWS Certified Big Data or any other cloud data platforms, big data platforms
4+ years of experience in the data and analytics space
Solid Programing experience in Python - needs to be an expert in this 4/5 level.
Experience with workload automation tools such as Airflow, Autosys.
4+ years experience developing and implementing enterprise-level data solutions utilizing Python , Java, Spark, and Scala, Airflow , Hive
3+ years in key aspects of software engineering such as parallel data processing, data flows, REST APIs, JSON, XML, and micro service architectures.
6+ years of RDBMS concepts with Strong Data analysis and SQL experience
3+ years of Linux OS command line tools and bash scripting proficiency
Cloud data warehouse experience - Snowflake is a plus
Must be an EXPERT with ETL Development on Unix Servers.
Must have demonstratable working knowledge of modern information and delivery practices for on-premises and cloud environments.
Must have demonstratable experience delivering robust information delivery and management solutions as part of a fast paced data platform program.
MUST BE AN EXPERT applying business rules/logic using SQL scripts.
Must have working knowledge of various data modeling techniques (3NF, denormalized, STAR Schema).
Position requires a self-starter, capable of quickly turning around vaguely defined projects with minimal supervision or assistance.
Ability to conduct analysis of source data sets to achieve target data set objectives.
STRONG VERBAL/WRITTEN COMMUNICATION is a MUST. Interacting with business community/users is a core requirement of the role.
Must be able to provide specialized support for our Legacy platforms, as well as the new Cloud Based Data Platform.
ADDITIONAL REQUIREMENTS
Candidate MUST possess a STRONG INITIATIVE.
Candidate MUST be able to run with a project on their own, with as little as a few sentences to begin the project with. Candidates requiring design specs will not be successful.
Retail experience is a plus.
Experience in the migration of data from an on premise database to a cloud based data warehouse platform is a strong plus.
Experience with Qlik, Business Objects, or Tableau is a plus.
A candidate with experience working with terabyte sized data warehouses and complex ETL mappings that process 50+ million records per day is strongly preferred.
NICE TO HAVE
Kubernetes and Docker experience a plus
Prior working experience on data science work bench
Cloud data warehouse experience - Snowflake is a plus
Data Modeling experience a plus
LANGUAGE/WRITING SKILLS
Strong, concise and grammatical oral and written communication skills.
MATHEMATICAL SKILLS
Basic math skills
REASONING/ ANALYTICAL ABILITY
Complex problem solving skills
Extensive data analytical skills
Initiative to develop efficiencies and process improvements
Documentation