Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation.
Key Responsibilities: Data Pipeline Development: Design, develop, and maintain scalable data pipelines using PySpark to process and transform large datasets. AWS Integration: Utilize AWS services, including Athena and EMR, to manage and optimize data workflows and storage solutions...