Design, code, and maintain data processing solutions and applications using Java, Kotlin, Scala, and Apache Spark. Optimize Spark applications and implement data loading and transformation for large-scale datasets.
We are looking for candidates with the following skills. Please let me know if this interests you and want to discuss it further. Thanks for your time and have a great week ahead!!!
Role: Senior Java/Spark Developer - Remote (Should be inside US to apply for this role)
Need US CITIZENSHIP because of the nature of the client and job plus undergo security clearance
Senior Java/Spark Developer:
Responsibilities:
- Design, code, and maintain applications and data processing solutions using Java, Kotlin, Scala, and Apache Spark.
- Design and implement data loading and transformation for large datasets. Process data in various formats and compression codecs.
- Use Spark SQL, DataFrames, and Datasets for efficient data manipulation and querying within Spark applications.
- Optimize Spark applications, including tuning configurations, managing memory, and fine-tuning data serialization and task partitioning.
Required Experience and Skills:
- 5+ years of professional software engineering experience, with a strong focus on JVM-based development and large-scale data processing solutions.
- Hands-on experience developing applications using Java and Kotlin, with a solid understanding of object-oriented and functional programming concepts.
- Practical working knowledge of Scala, including familiarity with commonly used Scala libraries, frameworks, and development practices.
- Strong experience designing, developing, and maintaining Apache Spark-based data pipelines and processing jobs.
- Proficiency with Spark SQL, DataFrames, distributed data processing, and performance optimization for high-volume data workloads.
- Solid understanding of big data engineering principles, distributed computing models, and scalable application design.
- Strong SQL skills and experience working with relational database systems.
- Experience building or supporting cloud-based data solutions within AWS environments.
- Familiarity with version control and collaborative development workflows using Git or similar tools.