We are looking for a savvy Data Engineer to join our growing team of analytics experts. The ideal candidate is an experienced data pipeline builder and
data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data
needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data
architecture to support our next generation of products and data initiatives.
Responsibilities:
Create and maintain optimal data pipeline architecture,
Evaluate business needs and objectives
Combine raw information from different sources
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing
infrastructure for greater scalability, etc.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry
leader.
Identify opportunities for data acquisition
Qualifications:
Previous experience as a data engineer or in a similar role
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with Kubernetes and containers
Familiar with customer data platform concepts
Great numerical and analytical skills
Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Degree in Computer Science, IT, or similar field; a Master’s is a plus
Data engineering certification (e.g IBM Certified Data Engineer) is a plus