Data Engineer US
Company: Astral Insights
Location: Raleigh
Posted on: May 8, 2024
|
|
Job Description:
We are seeking a highly skilled and motivated Senior Data
Engineer with a strong focus on the Microsoft Azure tech stack. The
ideal candidate will have a deep understanding of data
architecture, data modeling, and data processing, with a proven
track record of leveraging Azure services to build robust, scalable
data & analytics solutions for the purpose of delivering AI,
machine learning, and data visualization solutions for mid-market
and enterprise organizations.
Responsibilities
1. Design, build, and maintain data pipelines in Azure, using
services such as Azure Data Factory, Azure Databricks, Azure
Synapse Analytics, and Azure SQL Database.
2. Implement data storage solutions using Azure Blob Storage, Azure
Data Lake, and Azure Cosmos DB.
3. Develop and optimize data processing algorithms and data sets to
support data analytics and machine learning initiatives.
4. Work closely with data scientists, analysts, and other
stakeholders to understand data needs and implement solutions.
5. Ensure data quality and integrity using Azure Purview and other
data governance tools.
6. Monitor and troubleshoot data pipelines, implementing fixes and
improvements as needed.
7. Stay up to date with the latest Azure services and technologies,
and advocate for their adoption where appropriate.
Qualifications
1. Bachelor's degree in Computer Science, Information Systems, or a
related field. Advanced degree preferred.
2. 5+ years of experience in data engineering using the Azure tech
stack.
3. Proficiency in SQL and experience with Python and/or another
scripting language.
4. Experience with Azure Data Factory, Azure Databricks, Azure
Synapse Analytics, and other Azure data services.
5. Knowledge of data warehousing concepts and best practices.
6. Strong problem-solving skills and the ability to work
independently and in a team.
7. Excellent English communication skills, with the ability to
explain complex technical concepts to non-technical
stakeholders.
Keywords: Astral Insights, Wilson , Data Engineer US, Engineering , Raleigh, North Carolina
Click
here to apply!
|