Scala/Spark Engineer

San Francisco, CA 94105

Posted: 07/08/2019 Employment Type: Contract to Perm Job Category: Engineering Job Number: 13409

Blackstone Technology Group, an award-winning technology consulting and talent agency is seeking a Scala/Spark Engineer to join our team at our client s site in San Francisco, California.

Senior Software Engineer: Back-end focused

Looking for driven individuals to join our team of passionate engineers in creating our next generation of risk management products. The client believes that data and cloud is changing the nature of financial risk management.

In this role:

You will join the early stage of projects and participate in defining the platform for the next generation products

You will build API and processing pipeline for multi-tenant, high-volume, and real-time system on Spark and Hadoop platform

You will transform complex analytical models into scalable, production-ready solutions

You will continuously integrate and ship code into the cloud environment

You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular 2, Play, and NoSQL

You will participate in defining the architecture of modern tools and runtime for operating your code such as AWS, Docker, Puppet, and Terraform

You will work directly with Product Owners to deliver products in a collaborative and agile environment

Who you are:

You are passionate to be part of cutting edge projects and are motivated by delivering world-class products with great architecture on an aggressive schedule

You are not intimidated by challenges; thrives even under pressure; is passionate about your craft; and hyper focused on delivering exceptional results

You love to learn new technologies and mentor junior engineers to raise the bar on your team

You use, or are passionate about learning, functional programming, AWS, Docker, Spark, Alluxio, Scala, Akka, Kafka, Cassandra, ElasticSearch, Hadoop, Yarn, and Mesos and anything else that will help you solve big, messy problems

Basic Qualifications:

Bachelors or higher in Computer Science, Mathematics, or other relevant field

Expert level knowledge of JVM and OOP

2+ years of experience in Scala or other functional languages

Experience in Hadoop stack: HDFS, Spark, NoSQL

Experience in designing API and documenting through Open API/Swagger

Experience in Unix/Linux including basic commands and scripting

Strong knowledge of source control systems and best practices (Git, Merging, Branching, Pull Requests, etc.)

Strong knowledge and understanding of algorithm optimization and distributed systems

Solid understanding of continuous integration, deployment and monitoring

Excellent communication skills

Additional Qualifications

Designing mission-critical system using AWS, Docker, microservices architecture

Knowledge of Statistics

Experience in Fintech

Our Stack

The client believes in using the right tool for the right job, and we are eager to use the best that the open source world has to offer. We practice agile development with fast iterations, continuous integration, automated testing and build process.

Scala, SBT, Play, Swagger

Angular 2, Typescript

Spark, HDFS, Yarn, Postgres, Cassandra, Redshift

Node, Wepback and NPM

ScalaTest, Karma/Jasmine for Unit Testing

Robot and Selenium for Integration Testing


Puppet, Terraform, Packer

AWS, Docker

Blackstone is a global IT services and solutions firm that implements digital transformation solutions across commercial industry verticals and the US Federal Government. Blackstone was founded in 1998, and has offices in San Francisco, Denver, Houston, Colorado Springs, and Washington, DC. We specialize in IT staffing and place both technical and creative talent across a variety of industries and sectors.

EOE of Minorities/Females/Veterans/Disabilities

Apply Online

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.