Job Description
Vericast is seeking a Manager of Software Engineering for our Big Data Platform Team. Our amazing big data platform was designed in-house, and built from the ground up around Hadoop, Spark, Jupyter, PySpark, and Kafka. It spans multiple computer clusters with many thousands of cores and multiple petabytes of data. Our platform software team:
develops features on top of the open-source hadoop/spark stack
produces java services to implement security, data access, scheduling, optimization, and many other features
owns the reliability, productivity, roadmap, and capital planning for our platform infrastructure
delivers foundational infrastructure and tools to our data engineering and science teams
has contributed code back to Apache open-source projects (not log4j)
participates in the department's greenfield, strategic, and transformational software and platform projects
If you want work with a great team, have high-level input to your own roadmap, and low-level control of delivering a top-notch PaaS product, we want to talk to you. If you want leverage great ideas across many teams of developers to improve digital marketing product delivery, value, and profit, we want to talk to you. If you ever worked on data science, data engineering, or other product teams and thought "we could make this easier", we want to talk to you.
Responsibilities
Managing and leading a team of engineers responsible for the maintenance, performance optimization, and scaling of Hadoop/Kafka clusters.
Monitoring and troubleshooting Hadoop/Kafka clusters to ensure high availability, performance, and security of data and applications.
Develop and maintain custom Platform tool kits using Java, Springboot, Python and other programming languages and frameworks.
Ensuring compliance with security and regulatory standards and implementing best practices for data governance and management.
Own the quality metrics and operations of our PaaS
Mentor our engineers and develop their talent
Contribute to the roadmap for our PaaS
Be an interface for platform users throughout the company