Sr Data Engineer (Python/Spark)
Published | May 6, 2022 |
Location | Atlanta, GA |
Category | Default |
Job Type | Full-time |
Description
I am actively working with one of the leading financial and economic data firms in the investment banking industry. I am seeking an employee W-2 candidate for a long term contract opportunity that is 100% remote work from home. The requirements are as follows...
Required Skills:
- Must have 3 to 5 years of demonstrated experience in building big data solutions on AWS cloud primarily with PySpark, preferable in Data Analytics space.
- Must have 3 to 5 years in application development using Python
- Must have 3 to 5 years of experience working with Spark
-Must have hands on development experience in developing data engineering solutions in Python using S3, EMR, Glue, Athena, Kafka, and Notebooks.
- Must have hands on development in building Big Data solutions including ingestion, caching, processing, consumption, logging and monitoring.
-Position requires STRONG technical communication skills.
BONUS SKILLS
Big Data and Open Source technical experience
Agile (Scrum) methodology
Experience developing SaaS application backends and APIs using a variety of tools
Experience turning abstract business requirements into concrete technical plans
Proficiency with algorithms (including time and space complexity analysis), data structures, and software architecture
Must be a quick learner and embrace new technologies in the Big data space