Lead Data Engineer
\nLocation : Fort Mill SC
\nSkills : Snowflake, AWS glue, Hive, Python and Pyspark.
\nExperience: +10 years
\n \nWe at Coforge are hiring Lead Data Engineer with the following skill sets.
\nDesign, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
\nUtilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
\nImplement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
\nDevelop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
\nManage containerized applications using Docker and orchestrate them with Amazon EKS.
\nDesign and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
\nWork with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
\nCollaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
\nEnsure data quality, integrity, and security throughout the data lifecycle.
\nStay updated with the latest industry trends and technologies to continuously improve data engineering practices.
\nMandatory Skills
\nStrong experience with AWS services, particularly Glue and Lambda.
\nProficiency in PySpark for data processing.
\nExpertise in Infrastructure as Code (IAC) using Terraform.
\nSolid SQL skills for data manipulation and querying.
\nExperience with containerization using Docker and orchestration with EKS.
\nHands-on experience with data warehousing solutions like Snowflake or Redshift.
\nFamiliarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
\nProven ability to work in a cloud environment.
\nPreferred Skills
\nExperience with data governance and data quality frameworks.
\nKnowledge of data modeling and database design principles.
\nFamiliarity with Agile methodologies and project management tools.
\nStrong analytical and problem-solving skills.
\nExcellent communication and collaboration abilities.
\nQualifications
\nBachelor's degree in Computer Science, Information Technology, or a related field.
\n8-12 years of experience in data engineering or a related role.
\nProven track record of delivering data solutions in a cloud environment.
\nStrong understanding of data architecture and data management best practices.
\n...and results in the retail and foodservice channels. While we welcome people with industry knowledge, there is no prior industry experience required for this position. If you love food, learning, new challenges and are a people person, we would like to talk to you!...
...A leading retail brand in Jacksonville is seeking a part-time Brand Ambassador who is a people person, full of energy, and passionate about AE and Aerie products. You will engage with customers, help them find what they are looking for, and introduce them to the AEO loyalty...
...to gain Forescout certifications as part of a planDoD 8570 IAT II15+ yrs. experience working in a DOD environment (Contractor/Civilian/Military), preferably US Army or DISAForescout Certified Engineer (FSCE)Experience with Network Access ControlsExperience with projects...
...Make a meaningful impact in the lives of students as a dedicated school nurse in a supportive, district-wide environment. This full-time,... ...Qualifications: Active and valid New Jersey School Nursing RN license is required Demonstrated school-based nursing experience...
...Asplundh Tree Expert, LLC is seeking a Trimmer/Climber in Huntersville, NC to trim and remove trees and branches, operate and maintain equipment, and support safe job execution in outdoor environments. The role requires climbing, lifting, and working at heights with...