Sr Data Engineer (Bangalore candidates only)

 Posted 11 days ago
     
5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design, develop, and maintain data warehouse and data lake applications to support reporting and machine learning models. Responsible for creating optimal data pipelines, automating manual processes, and ensuring data accuracy and integrity.


What You'll Do :

A successful Sr Data Engineer will be working for Data as An Asset Team which delivers and support all First Advantage need for data, reporting, analytics and intelligence to recommend business solutions (geared by machine learning models) The Developer work side by side with product owners and project leads to ensure expected quality software is built to serve our FA customers. The Developer is expected to learn the business and technical components of an application and work with their peers to follow Agile software development methodologies. Grow your career in our dynamic and fast paced environment of diverse software platforms and challenging projects that shape the future of the banking industry.

Roles and Responsibilities:

  • This role is for an Sr Data Engineer to design, develop, maintain, and test Data warehouse and Data Lake applications collaborating with the development team, testing team and business partners to ensure successful delivery and implementation of application Requirements.

  • Responsible for reviewing and understanding requirements and translating them into high-level including source to target mappings

  • Create and maintain optimal data pipeline for data warehouse and data lake

  • Identify, design and implement internal process improvements applicable both for On-Premises and Cloud Migrations: Automating manual processes, Optimizing data delivery, re-designing infrastructure for greater scalability.

  • Responsible for unit testing, debugging, and performance testing, with key focus on data accuracy and integrity

  • Responsible for development of job schedules that integrate with upstream and downstream systems

  • Accountable for on-time delivery of all documentation that include data mapping, design, build, testing, and deployment

What You Will Need to be Successful

  • B.E., B.Tech. or Masters in Computer Science or related field – or equivalent experience.

  • 5+yrs of experience development experience in planning & delivery of robust enterprise-grade data engineering pipelines using with relational database, Azure Databricks with Pyspark , Python, Apache Spark, ETL

What You May Need to be Successful :

  • Minimum of 5+ years of development experience in planning & delivery of robust enterprise-grade data engineering pipelines using with relational database, Azure Databricks with Pyspark , Python, Apache Spark, ETL

  • Familiar with source code control version such as GIT

  • Experience in Creating high-level Design Artifacts.

  • Ability to present technical concepts to senior level business stakeholders.

  • Analytical and problem-solving skills.

  • Impeccable Communication skills – verbal and written.

  • Should be a self-motivated worker.

  • Excellent interpersonal skills, positive attitude, team-player.

  • Willingness to learn and adapt to changes.

  • Strong time management and task prioritization

Desired Skills:

  • Experience with Data warehouse, Data Mart and Data Lake Technologies.

  • Experience with cloud technology - Azure Databricks, Azure Synapse, Azure Data Explorer, Azure SQL Database, Azure Data Factory, Azure Logic Apps, and Azure Delta Lake.

  • Familiar with distributed data (structured, semi-structured, unstructured, streaming) processing techniques using Apache Spark, Hadoop, Hive, Kafka, and big data ecosystem technologies.

  • Experience integrating with API's

  • Minimum of 2+ years of Linux / shell scripting complementary

  • Prior experience of working with globally distributed teams

  • Agile driven development

We have great people here and are looking for more. Come join us!
 

Follow us:

Equal Employment Opportunities at First Advantage
First Advantage is an equal opportunity employer. We are committed to providing a workplace and recruitment process that is free from unlawful discrimination, harassment, and retaliation. Employment decisions at First Advantage are based solely on qualifications, merit, and business needs. We do not discriminate in any aspect of employment on the basis of race, color, national origin, ancestry, citizenship, religion, creed, sex, gender identity, gender expression, sexual orientation, marital or family status, pregnancy, age, physical or mental disability, medical condition, genetic information, veteran or military status, or any other characteristic protected by applicable law.

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Data Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified