Software Engineer - Database Integrations

 Posted 4 days ago
  
 Worldwide
  
5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design and develop high-throughput data integrations between various databases, data lakes, and ClickHouse. Ensure end-to-end system reliability by debugging complex production issues and collaborating with customers to drive product innovation.

Note:. We are hiring for this role remotely in any country ClickHouse has a hiring presence.

About the Team

The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.

As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB, an open-source CDC platform we actively maintain and contribute to.

See some of our recent work:

What You’ll Do:

  • Build data-intensive systems

    • Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).

    • Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.

    • Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.

    Own end-to-end reliability

    • Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).

    • Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.

    • Write clear documentation, both publicly and internally.

    • Participate in on-call rotation.

    Drive product innovation

    • Work directly with customers to understand integration requirements and discover gaps in existing product.

    • Collaborate cross-functionally with internal teams to ensure operational efficiency.

    • Lead technical discussions and influence product roadmaps.

About You:

  • 5+ years of industry experience building data-intensive software solutions.

  • Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.

  • Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).

  • Practical experience with Kubernetes.

  • Strong problem solver and solid production debugging skills.

  • Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response).

Bonus Points

  • Experience with database replication technologies (CDC, logical replication).

  • Experience with durable execution frameworks (Temporal).

  • Experience with data formats and protocols (Avro, Parquet, Protobuf).

  • Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).

  • Experience with maintaining/contributing to open-source software.

Why Join Us

  • Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.

  • Work on a team that builds software in the open (PeerDB), and that cares about the craft of engineering, documentations, and continuous learning.

  • Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment.

#LI-remote

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Software Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified