Senior/Staff Software Engineer, Data Platform

About Sovrn Every interesting company solves essential problems for other people. Sovrn is a Software and Data business that helps Open Web businesses remain independent. We help them understand their business better, operate more efficiently, and make and keep more money.

We believe in the freedom and free flow of information. We believe the Open Web is the largest source of this information. We believe in helping Open Web businesses be and remain Independent.

Through Software products and Data solutions, we help our customers: Understand their business better, so they can make better decisions. Operate their business more efficiently, so they can invest in what matters most. Make (and Keep) more money, so they control their own destiny.

About the Job As a Senior or Staff Software Engineer , on the Data Platform team, you will collaborate with cross-functional teams to enhance our data architecture, troubleshoot data processing issues, and implement solutions to ensure the integrity, efficiency, and governance of our data ecosystem. The role requires strong problem-solving skills and expertise in managing and optimizing data pipelines (ELT). The ideal candidate is passionate about building and maintaining key datasets and data infrastructure, and has a proven track record in managing data platforms.

Languages / components / tools in our stack: Python, Redpanda/Kafka, Databricks/Spark, AWS/S3, Terraform, Datadog, GitHub What You’ll Be Doing: Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications. Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies. Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.

Architect components and configurations required for data pipeline implementation in AWS and Databricks. Architect data pipeline metrics to monitor performance, accuracy, and availability. Enable a team to research, implement, and evolve methods to process our data.

Optimize data processing and data access to business intelligence tools. Work across the organization to enable business growth and development through data services and data models. Spot and diagnose stability issues and author improvements.

Lead the developers with the security team to implement and maintain robust data security measures. Ensure compliance with relevant data governance and privacy regulations. The successful candidate will have: 5+ years of software engineering experience and a passion for learning Strong scala and python skills with an expert understanding of backend and data engineering design patterns A deep understanding of big data processing environments such as Spark and Databricks.

Demonstrated experience with data processing using Spark in a production environment. Proven experience with orchestration tools such as Airflow and MWAA. Experience working in the Cloud Computing ecosystem.

We use AWS heavily, but we are open to GCP, Azure, etc. Experience with infrastructure as code tools like Terraform and AWS CloudFormation. Deep understanding of relational databases, big data tables, and noSQL databases.

Able to triage, debug, and permanently fix complex and convoluted data processing issues. Possesses a mature understanding of the product domain and architecture. A strong individual contributor that can define and architect features required by the business and product.

Learning to apply industry best practices, design principles, and design patterns. Executes on defined features of scope to achieve team goals and commitments. Sets standards and best practices around team conventions and precedent for solving recurring problems.

Demonstrates an aptitude for writing clean, testable, readable, maintainable, quality code.