Lead Data Engineer
\nLocation : Fort Mill SC
\nSkills : Snowflake, AWS glue, Hive, Python and Pyspark.
\nExperience: +10 years
\n \nWe at Coforge are hiring Lead Data Engineer with the following skill sets.
\nDesign, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
\nUtilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
\nImplement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
\nDevelop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
\nManage containerized applications using Docker and orchestrate them with Amazon EKS.
\nDesign and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
\nWork with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
\nCollaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
\nEnsure data quality, integrity, and security throughout the data lifecycle.
\nStay updated with the latest industry trends and technologies to continuously improve data engineering practices.
\nMandatory Skills
\nStrong experience with AWS services, particularly Glue and Lambda.
\nProficiency in PySpark for data processing.
\nExpertise in Infrastructure as Code (IAC) using Terraform.
\nSolid SQL skills for data manipulation and querying.
\nExperience with containerization using Docker and orchestration with EKS.
\nHands-on experience with data warehousing solutions like Snowflake or Redshift.
\nFamiliarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
\nProven ability to work in a cloud environment.
\nPreferred Skills
\nExperience with data governance and data quality frameworks.
\nKnowledge of data modeling and database design principles.
\nFamiliarity with Agile methodologies and project management tools.
\nStrong analytical and problem-solving skills.
\nExcellent communication and collaboration abilities.
\nQualifications
\nBachelor's degree in Computer Science, Information Technology, or a related field.
\n8-12 years of experience in data engineering or a related role.
\nProven track record of delivering data solutions in a cloud environment.
\nStrong understanding of data architecture and data management best practices.
\n...or operating independently, depending on business needs and route structure. Driver-Friendly Equipment: Nearly 50% of our fleet is equipped with lift gates, helping make deliveries more efficient and reducing the physical demands of unloading at customer locations...
...working with server-side languages, databases, and APIs. Full-stack and software development skills, with the ability to... ...JavaScript Web Fullstack More: We are seeking an entry-level Full Stack Developer to support work across the full application stack,...
...Description Bellingham Technical College (BTC) is seeking a Senior Instructional Designer to lead development of Competency-Based Education (CBE)... ...Senior Instructional Designer will conduct research and consult with faculty and staff representatives on the design,...
...Job description We are seeking outgoing individuals for a business opportunity as a Remote Travel Agent. The ideal candidate is passionate about travel and helping others plan their dream vacations. As a Travel Agent, you will work directly with clients, handling inquiries...
Job ID: 384793Company: NTT DATA Americas, Inc.Location: Plano, US-TX, United StatesEmployment type: full timeCategory: OtherPosted: 2... ...capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions...