Sr Data Engineer (Python/Spark)

at ConsultNet
Published May 6, 2022
Location Atlanta, GA
Category Default  
Job Type Full-time  

Description

I am actively working with one of the leading financial and economic data firms in the investment banking industry. I am seeking an employee W-2 candidate for a long term contract opportunity that is 100% remote work from home. The requirements are as follows...

Required Skills:

- Must have 3 to 5 years of demonstrated experience in building big data solutions on AWS cloud primarily with PySpark, preferable in Data Analytics space.

- Must have 3 to 5 years in application development using Python

- Must have 3 to 5 years of experience working with Spark

-Must have hands on development experience in developing data engineering solutions in Python using S3, EMR, Glue, Athena, Kafka, and Notebooks.

- Must have hands on development in building Big Data solutions including ingestion, caching, processing, consumption, logging and monitoring.

-Position requires STRONG technical communication skills.

BONUS SKILLS

Big Data and Open Source technical experience

Agile (Scrum) methodology

Experience developing SaaS application backends and APIs using a variety of tools

Experience turning abstract business requirements into concrete technical plans

Proficiency with algorithms (including time and space complexity analysis), data structures, and software architecture

Must be a quick learner and embrace new technologies in the Big data space