See Job Openings

Data Engineer (Remote)

  • Location: Madison, Wisconsin
  • Type: Direct Hire
  • Job #3469

Our Partner is hiring a Data Engineer to work with their Data Science and Integration team.  This team is made up of different specialists who play multiple roles: data scientists, data architects, data engineers, business analysts, and database administrators. They lend expertise to Integrating data, moving data, and providing insights into data.  From Madison, WI or anywhere remotely, the Data Engineer provides oversight and development around the implementation of a modern data platform solution. You will design, develop, modify and support data solutions in Azure and on-premises environments. You are also a key contributor in modeling, developing, enhancing, and supporting curated data models.

 

The Data Engineer designs, develops, enhances, and supports data solutions with an Azure/cloud-first architecture approach.

 

What you’ll do:

  • Design, develop, modify, and support data solutions in Azure and on-premises environments.
  • Design and develop scalable, efficient (internal and external) data pipeline processes to handle data ingestion, cleansing, transformation, integration, and validation.
  • Model, develop, enhance, and support curated data models.
  • Ensure standards are met so that solutions deployed have technical integrity and stability.
  • Design and develop automated Data Quality solutions that ensures the integrity of a modern data platform.
  • Document production software, runbooks, and solution architectures.
  • Develop, communicate, and present solution architectures to both technology and business stakeholders.
  • Support critical strategic initiatives and architect simple to complex data engineering projects.
  • Collaborate with IT peers to understand the Data Landscape across the organization.
  • Collaborate with Data Scientists, Data Analysts and Business Stakeholders to deliver curated data models.
  • Build cross-functional relationships with Business Stakeholders, Architects, Data Scientists, BI Managers, and Business Partners to understand data needs and help projects and agile teams deliver on those needs.
  • Deliver collaborative products that align with organizational strategies.
  • Mentor junior level engineers and cross team peers in all levels of data engineering.

 

What you’ll bring:

  • Bachelor’s degree in computer science or relevant science discipline.
  • 5+ years’ experience as a Data Engineer or equivalent role.
  • Working knowledge of Data Engineering tools like Databricks, Synapse, Spark, PySpark, Scala, Data Factory, SSIS, Informatica.
  • Comfortable in building effective analytical tools that utilize the data pipeline to provide actionable insights into data synchronization and operational efficiency of the data repositories.
  • Experience in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts.
  • Advanced knowledge in relational databases, like MSSQL, MySQL, Oracle, etc.
  • Knowledge of and ability to implement CI/CD best practices especially as they relate to data engineering.
  • Experience in defining and setting up data architecture to support data warehousing and business intelligence.
  • Working knowledge on enterprise data lakes, data analytics, reporting, in-memory data handling, enterprise integration tools, etc.
  • Having an owner's mindset and experience working in a fast-paced and demanding environment.
  • Ability to work in an Agile development environment.

 

  • Microsoft Azure experience, especially in the data engineering space.
  • Knowledge of no-SQL databases, Azure cosmos DB, MongoDB, Elastic Search, etc.
  • Knowledge on enterprise data lakes, delta lake, data analytics, in-memory data handling, enterprise integration tools, etc.
  • Knowledge of open source tools like NiFi, Kafka, Airflow, etc. specifically on the Azure cloud platform.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Proven ability in working in an agile team environment, anticipating, and meeting team needs, working with little direction, and gaining cooperation from others.
  • Experience and/or training in designing, developing, supporting, and maintaining business application software, including extensive end-user contact.
  • Ability to work in a fast-paced, environment with frequent changes in priorities and assignments.

#LI-TB1

Attach a resume file. Accepted file types are DOC, DOCX, PDF, HTML, and TXT.

We are uploading your application. It may take a few moments to read your resume. Please wait!