AWS Data Engineer - On-site (Chester, PA / Charlotte, NC)
Malvern,Pennsylvania,USA Posted: Wed, Aug 07 2024
Skills
AWS services on big data platforms,Python experience, particularly in building Dash applications on AWS,Spark expertise for data processing and analyticshon,Shell scripting,Linux knowledge,ETL Development,Excellent Communication
Type
CON_W2
Experience
5-7 Years
Job Description
Overview: Seeking an AWS Certified Developer to join our client focusing on building scalable, cost-effective data pipelines, data lakes, and analytics systems.
Key Responsibilities:
Data Ingestion: Implement processes for collecting data from various sources.
Data Transformation: Develop ETL processes to cleanse and structure raw data.
Data Storage: Manage and optimize AWS storage solutions (Amazon S3, Redshift).
Data Processing: Utilize AWS services (AWS Glue, Amazon EMR, AWS Lambda) for large dataset processing.
Data Monitoring & Optimization: Ensure performance, cost-efficiency, and scalability.
Integration: Collaborate with stakeholders for AWS-based data analytics solutions.
Documentation: Maintain thorough documentation of processes and configurations.
Scalability: Design solutions to handle growing data volumes and business needs.
Cost Management: Optimize resource usage and recommend cost-saving measures.