Requirements

AWS Data Engineer - On-site (Chester, PA / Charlotte, NC)

Malvern,Pennsylvania,USA Posted: Wed, Aug 07 2024

Skills

AWS services on big data platforms,Python experience, particularly in building Dash applications on AWS,Spark expertise for data processing and analyticshon,Shell scripting,Linux knowledge,ETL Development,Excellent Communication

Type

CON_W2

Experience

5-7 Years

Job Description

Overview:
Seeking an AWS Certified Developer to join our client focusing on building scalable, cost-effective data pipelines, data lakes, and analytics systems.

Key Responsibilities:
  • Data Ingestion: Implement processes for collecting data from various sources.
  • Data Transformation: Develop ETL processes to cleanse and structure raw data.
  • Data Storage: Manage and optimize AWS storage solutions (Amazon S3, Redshift).
  • Data Processing: Utilize AWS services (AWS Glue, Amazon EMR, AWS Lambda) for large dataset processing.
  • Data Monitoring & Optimization: Ensure performance, cost-efficiency, and scalability.
  • Integration: Collaborate with stakeholders for AWS-based data analytics solutions.
  • Documentation: Maintain thorough documentation of processes and configurations.
  • Scalability: Design solutions to handle growing data volumes and business needs.
  • Cost Management: Optimize resource usage and recommend cost-saving measures.
  • Troubleshooting: Resolve AWS-related issues promptly.

Must-Have Qualifications:
  • Strong experience with AWS big data services.
  • Proficiency in Python, Spark, shell scripting, and Linux.

Nice to Have:
  • Investment/Finance industry experience.
  • Machine Learning skills.

Educational Background:
  • Bachelor's degree in computer science or related field (Master's preferred, GPA 3.8+).

Skills:
  • Strong problem-solving and analytical abilities.
  • Effective communication and collaboration skills.