Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewQuestions interviewers often ask for this role, with sample answers.
One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
The Senior Data Engineer will own and optimize API ingestion pipelines and the Snowflake platform to ensure reliable, fast, and cost-efficient data processing. They will collaborate directly with business users to gather requirements and iterate on data solutions to support reporting and billing.
Sightly is a growing technology company leading the revolution in real-time marketing and brand intelligence. Join us as we pursue our disruptive mission to empower businesses everywhere to make the most authentic + profitable decisions in real time.
Our AI-driven Brand Mentality® platform enables any brand (or agency) to leverage an ever-changing ocean of news, social, media and audience data to make more intelligent decisions at the speed of culture. At Sightly, we're passionate about our product, our customers, our impact on the world, and most importantly, our team.
We are a small company with a strong collaborative ethic, so there will be opportunities to get involved with projects that will help expand your skillset and knowledge. Professionals who take the initiative, can work without a lot of supervision, can begin projects independently, and have good communication skills will excel in this position.
Everything Sightly sells runs on data our pipelines collect every day: YouTube videos and channels, TikTok trends, social posts, news, and campaign performance from the ad platforms our clients buy on. That data lands in Snowflake and powers Brand Mentality, SmartLists, client reporting and automated billing. We need a senior data engineer to own those ingestion pipelines and the Snowflake platform underneath them, and to keep them reliable, fast and cost-efficient as volume grows.
Just as important, this person works directly with the people who use our data (account managers, sales, strategy and clients) to gather requirements and iterate quickly. AI has raised the bar for what one engineer can do, and we want someone who uses it to move fast and stretch beyond a traditional data engineering lane.
Note: This is a full-time position based remotely, reporting to our Director of Data.
Own API ingestion pipelines: build and run Python pipelines and Airflow DAGs that pull from YouTube, TikTok, Meta, Google Ads, DV360, social and news sources, handling quotas, rate limits, retries and credential rotation.
Run our Snowflake platform: manage warehouses, roles and access, partner data sharing, and cost. Tune schedules and storage (including our Iceberg migration) so we pay only for what we use.
Keep reporting and billing data trustworthy: maintain the ad-platform performance pipelines that feed client reports, our Reporting API and automated billing.
Lead on reliability and design: own alerting, data freshness and pipeline health, lead the response when something breaks, and shape how our data platform evolves as volume and use cases grow.
Work directly with users: sit with account managers, sales and strategy to understand what they need, turn requests into clear requirements, and ship iterations in days, not weeks. Partner with analytics and product engineers on dbt models and on serving data to the app (Postgres, OpenSearch).
Make it easy for others to contribute: document pipelines, tables and runbooks, and help build safe, AI-assisted paths (sandboxed environments, tests, CI/CD guardrails) so PMs and account managers can contribute to production data workflows.
5+ years of data engineering experience running production pipelines, including owning systems end to end and making architecture decisions.
Experience working directly with business users or clients: gathering requirements, explaining tradeoffs, and iterating quickly on feedback.
Strong Python and SQL.
Deep experience with Airflow (or a similar orchestrator) in production.
Experience with Snowflake (or BigQuery or Redshift), including administration: warehouses, access control, cost management.
A track record of integrating third-party REST APIs at volume, with their quotas, pagination and failures.
Experience on a major cloud platform, ideally GCP.
At least working familiarity with Elasticsearch or OpenSearch; deep expertise is a big plus.
Uses AI coding tools (such as Claude) as a core part of how you build, not an afterthought.
Comfortable with Git, code review and CI/CD.
Hands-on dbt experience, ideally on Snowflake: building and testing models, and keeping build times and warehouse costs down.
GCP data services: Cloud Composer, Dataflow, Cloud Storage.
Apache Iceberg.
Experience with ad platform APIs (Google Ads, DV360, Meta, TikTok) or YouTube data.
High-performance data processing in Python.
Python, Airflow on Cloud Composer, Snowflake, dbt, Apache Iceberg, Dataflow, Cloud Storage, Postgres, OpenSearch, GitLab, all on Google Cloud.
Knowledge of or experience in the digital advertising and/or marketing field
Self-starter who seeks out unfamiliar, uncomfortable problems and learns fast
Client-minded communicator who enjoys working with non-technical people and can explain data in plain terms
Collaborative mentality, with a habit of mentoring teammates and raising the bar on code and design
Comfortable working in a fast-paced and dynamic environment
This is a remote position.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 218,863+ Jobs in Data Engineer
Answer easy questions
218,863+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”