Senior Data Engineer at Wikimedia Foundation (San Francisco, CA) (allows remote)
Skills Requirements
We are looking for someone that is in love with building scalable systems for handling large amounts of data. You enjoy working with a team using data to understand and improve complex social systems. Wikipedia and its sister projects seem like a very exciting potential playground to you, and you enjoy the reward of discovery as a result of hard work. You are resourceful, inquisitive, collaborative, self-sufficient, self-driven, focused, and organized, but above all a quick learner and problem-solver.
Responsibilities
- Design, develop, test, and deploy new features, improvements and upgrades to Wikimedia's statistics and analytics infrastructure in cooperation with other Wikimedia Foundation engineering staff
- Collaborate with the Analytics development and analyst teams on implementation of algorithms, systems and data products
- Identify and implement best practices in engineering processes across the team
- Work with volunteers to augment our analytics capabilities
- Recommend new methods for collection and documentation of data, and establish procedures for procurement of data
- Assist end users and other developers in identifying and resolving issues with the software and configuration of Wikimedia's analytics infrastructure
- Interface with the open source web analytics development community and other outside developers
Requirements
- Production experience with Hadoop and ecosystem (Pig, Hive, Streaming) technologies
- 2+ years experience with large database storage systems (MySQL, DB2, Cassandra) with previous experience working with MySQL or similar database
- Experience working in a Linux/Unix server environment.
- Experience with Java, Scala or C++, preferably in a web-scale production environment
- Able to work collaboratively and discuss methodology and conclusions within the analytics engineering team, project team, and the greater Wikimedia community
- Ability to solicit ideas and discuss methodology and conclusions beyond direct contacts, notably the Wikimedia community
- Creative, highly motivated, and able to operate effectively in multicultural and technical contexts
- You are comfortable using a wide variety of communications/collaboration tools including wikis, mailing lists and IRC
- You are a proficient English speaker
- Bachelor's degree in related field or equivalent experience
Pluses
- Experience with scripting languages, such as PHP, Perl, Ruby, Python or shell scripting
- Any other free/open source software development experience is highly welcome
- Experience with high traffic web site architectures and operations is a plus
- Experience with wikis and participatory production environments is a plus
- Understanding of the free culture movement is a plus
- Active participation as a Wikimedia volunteer would be an asset, though not a prerequisite
About Wikimedia Foundation
How to apply
Click a href="http://hire.jobvite.com/j/?cj=oLdOXfwts=Stack_Overflow"here/agt; to apply.
view all job listings view all Wikimedia Foundation job listings
October 23, 2013
• Posted in: Technology
Leave a Reply
You must be logged in to post a comment.