Principal Engineer, Data

Verint Systems, Inc.; Salem (OR); On-site; USD 135,000 - 190,000; Full time

Job summary

A technology solutions company in Salem, Oregon, seeks a Principal Data Engineer to design and develop scalable data architectures and pipelines. The ideal candidate has 8+ years of backend development experience, strong knowledge of cloud services like AWS, and proficiency in Java and Spark. This role offers a salary range of $135K to $190K, reflecting the depth of expertise required.

Qualifications

• 8+ years developing backend services with Java/Scala/Python.
• Strong knowledge of modern data stores including data warehouses and data lakes.
• 5+ years working experience using cloud services in AWS or other cloud provider.

Responsibilities

• Design and develop overall data architecture for effective data storage and analysis.
• Build and maintain scalable data pipelines from various sources to data warehouse or data lake.
• Optimize data processing performance through indexing, partitioning, and caching.

Skills

Java

Spark

CI/CD

AWS

Communication skills

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

Maven

Jenkins

Git

JUnit

Docker

Kubernetes

Job description

Overview of Job Function

The Principal Data Engineer will be a part of Big Data team and responsible for developing batch or event-driven data pipelines in the cloud (AWS) while improving the reliability, security, resilience, and performance of the Big Data pipeline. The Principal Engineer will bring knowledge of software development using Java and Spark technologies and contribute to daily operations including CI/CD.

Principal Duties and Essential Responsibilities

• Design and develop overall data architecture to ensure the effective storage, retrieval, and analysis of large-scale data sets
• Build and maintain scalable data pipelines for ingesting, processing, and transforming data from various sources into our data warehouse or data lake. Ensure data quality and data consistency throughout the pipeline
• Optimize data storage, retrieval, and processing performance through indexing, partitioning, and caching techniques
• Evaluate and select appropriate technologies, tools, and platforms for data processing
• Improve availability and reliability of data streaming pipeline
• Evaluate the scalability of data architecture to accommodate future growth and changing business needs
• Develop build and deployment automation for microservices using CI/CD

Minimum Requirements

• Bachelor's degree in Computer Science, Engineering or related field
• 8+ years developing backend services with Java/ Scala/Python
• Strong modern data store knowledge including traditional data warehouse and data lake
• Experience on solution design with microservices dealing large scale datasets
• Experience in automating operational tasks through development and coding.
• Hands-on experience using Maven, Jenkins, Git, JUnit
• 5+ years working experience using cloud services in AWS or other cloud provider
• Excellent communication skill

Preferred Requirements

• Knowledge of Spark (Java, Scala)
• Knowledge of Databrick
• Hands-on experience with Docker and Kubernetes
• Experience working in cloud environments: AWS and/or Azure
• Familiarity with performance monitoring using Datadog
• Understanding of asynchronous Java programming

MIN: $135K

MAX: $190K

Verint Systems Inc. is an equal opportunity employer and is committed to maintaining a workplace free from discrimination, retaliation, and harassment. Verint has a zero-tolerance policy against discrimination, retaliation, or harassment including sexual harassment or any other form of harassment based on race, color, religion, sex, age, national origin, genetic information, disability, veteran status, and any other classification or characteristic protected by applicable federal, state or local laws. Verint operates in accordance with all anti-discrimination laws and affords equal opportunities to employees and applicants without regard to any characteristic or protected class in our hiring, promotion and termination practices.