Lead Data Engineer Job at Purple Hires Inc, Madison, WI

  • Purple Hires Inc
  • Madison, WI

Job Description

Position: Lead Data Engineer Location: Madison WI 53783 - Hybrid - 2-3 Days in Office candidate needs to be within 40 to 45 miles of 3 months contract Job Description Primary Accountabilities Leads an engineering team to meet project deadlines and priorities. Supervises assigned data engineering team members & activities. Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle. Documents critical workflows and operational support aspects of team's responsibilities Develops deep understanding of data sources, granularity, availability, and limitations. Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions. Creates maintainable, scalable code to load and manipulate data in the data warehouse. Facilitates communication upward and across project teams and business stakeholders. Specialized Knowledge & Skills Requirements Demonstrated experience providing customer-driven solutions, support or service. Must have GCP experience for this positon. In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores) Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions. Able to employ design patterns and generalize code to address common use cases. Capable of authoring robust, high quality, reusable code and contributing to the division's inventory of libraries. Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions. Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O. Solid data understanding and business acumen in the data rich industries like insurance or financial Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas). Strong understanding of database internals, such as indexes, binary logging, and transactions. Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.) Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git). Practical experience authoring and consuming web services. #J-18808-Ljbffr

Job Tags

Contract work, Work at office

Similar Jobs

DataJobs.com

Lead Data Engineer Job at DataJobs.com

 ...Capital Technology Group seeks a Lead Data Engineer to build scalable AWS-native data platforms for mission-critical analytics in federal environments.ResponsibilitiesDesign, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python... 

PT Solutions Physical Therapy

Physician Liaison Job at PT Solutions Physical Therapy

 ...Job Overview & Responsibilities The Physician Liaison is responsible for maintaining contact with key customers and interfacing with healthcare providers within the assigned territory. In conjunction with the Sales Director, the Physician Liaison works to understand sales... 

Menzies Aviation

Ramp Agent Job at Menzies Aviation

 ...room and the baggage claim area as well as safe and efficient cleaning of aircraft cabins. Driving and operating small specialized commercial...  ...baggage on and off aircraft and transport it between aircraft, airport terminals and air cargo facilities.Frequent bending, stretching... 

Envirogen Group

Project Manager Job at Envirogen Group

 ...Project ManagerAs a key player in the water and wastewater treatment industry, Envirogen is looking for an experienced Project Manager to join our team. In this role, you will be responsible for leading and managing projects from inception to completion, ensuring that... 

Enterprise Medical Recruiting

Neurology Physician Job at Enterprise Medical Recruiting

Hospitalist - Neurology physician job in Ohio : Enterprise Medical Recruiting is assisting a single-specialty Neuroscience group in Cincinnati to recruit a new Neurologist!They are seeking someone in an all-inpatient-focused opportunity in 1 hospital.Job HighlightsSeeking...