Senior Big Data Software Engineer
Job Description
Are you a Senior Software Engineer that has spent several years working with Big Data technologies? Have you created streaming analytics algorithms to process terabytes of real-time data and deployed Hadoop or Cassandra clusters over dozens of VMs? Have you been part of an organization driven by a DevOps culture, where the engineer has end to end responsibility for the product, from development to operating it in production? Are you willing to join a team of elite engineers working on a fast growing analytics business? Then this role is for you!
Job Description
The Software and DevOps engineer will help build the analytics platform for Bazaarvoice data that will power our client-facing reporting, product performance reporting, and financial reporting. You will also help us operationalize our Hadoop clusters, Kafka and Storm services, high volume event collectors, and build out improvements to our custom analytics job portal in support of Map/Reduce and Spark jobs. The Analytics Platform is used to aggregate data sets to build out known new product offerings related to analytics and media as well as a number of pilot initiatives based on this data. You will need to understand the business cases of the various products and build a common platform and set of services that help all of our products move fast and iterate quickly. You will help us pick and choose the right technologies for this platform.
Key Responsibilities
In your first 90 days you can expect the following:
- An overview of our Big Data platform code base and development model
- A tour of the products and technologies leveraging the Big Data Analytics Platform
- 4 days of Cloudera training to provide a quick ramp up of the technologies involved
- By the end of the 90 days, you will be able to complete basic enhancements to code supporting large-scale analytics using Map/Reduce as well as contribute to the operational maintenance of a high volume event collection pipeline.
Within the first year you will:
- Own design, implementation, and support of major components of platform development. This includes working with the various stakeholders for the platform team to understand their requirements and delivery high leverage capabilities.
- Have a complete grasp of the technology stack, and help guide where we go next.
Skills Requirements
Required Skills and Experience
- 3-5 years of experience with highly scalable systems using open source tools.
- In-depth knowledge of the software development lifecycle (design, build, test, deploy, support).
- Deep knowledge of Linux, networking and security.
- High familiarity with AWS and the tools and services it offers.
- An ability to demonstrate software engineering fundamentals such as OO design, unit testing, code reuse, code reviews.
- Nice to have experience building large-scale data processing platforms. This includes developing prototypes and proof-of-concepts for the selected solutions.
- Extensive knowledge in different programming/scripting languages such as Java, C++, PHP, Ruby, Python, bash, etc.
- Familiarity with one or more big-data infrastructures such as Hbase, Hadoop, Spark, or, Casandra.
- Willingness to rotate on-call for the platform supporting the next generation of Bazaarvoice’s business - we’re depending on you.
- Knowledge of modern build tools such as Maven, Jenkins, Github, etc
- Familiarity with Agile development methodologies.
About Crossover
Crossover is redefining the way people work. Brick and mortar offices are history. The future of our global workforce will be built from teams collaborating from every corner of the world. We have embarked on an expedition to find and engage with that talent. Crossover has developed a unique method of finding, curating, and managing remote contractors. Our platform connects customers to the worlds best talent for both technical and non-technical employment. But we don’t just find the best, we also provide the tools, training, and relationship building support to ensure success for long term growth.
Visit the Crossover company page
view all job listings view all Crossover job listings
Leave a Reply
You must be logged in to post a comment.