MongoDB Expert at MadBits (New York, NY) (allows remote)
Job Description
We are looking for a talented database expert, who is willing to tackle challenging scallability problems. The product we are building is an innovative cloud-based image management platform. Our database is used to store user profiles, their relations (socilal), bust most importantly, images, videos and all their meta-descriptors. Our algorithms produce a lot of meta-descriptors (scene type, geolocation, people, visual descriptors, similarity matrices, ...), which have to be queried in complex ways. All of these queries need to run seamlessly, on a database that could potentiially be sharded on lots of machines.
We are looking for a contractor, who is ideally available full-time, and if not at least 20h a week. Remote is ok.
Key elements of the job:
- Database monitoring, analysis
- Database scalability (database sharding)
- Query optimization (proper indexing of our top queries)
- Parallelization / Optimization of our compute daemon dispatcher (compute daemons need to run on 10s of servers, without locking the DB)
Skills Requirements
Our current backend infrastructure relies on MongoDB as its main data store, so expertise in MongoDB is best, but someone who has a strong knowledge of databases in general is equally good.
Our schemas, models, DB driver and algorithms are all written in LuaJIT (for performance). Knowledge of Lua is a plus but not necessary: most of the database mantenance, analysis, optimization, ... can be done in JS, using the builtin MongoDB driver.
Summary of skills:
- MongoDB expert: extensive knowledge of the way MongoDB works (B-trees, indexing, aggregation framework, setting up sharded DBs...)
- Previous experience with sharding databases is crucial
- Knowledge of Lua(JIT) is a plus, as it is our main compute/model framework
About MadBits
MadBits is a new startup, funded, and based in NYC (lower-east side). We are building next generation image management software, based on state-of-the-art computer vision technology.
Madbits’ long term goal is to develop world-class machine visual intelligence, by continually developing and improving our in-house deep-learning based technology, and leveraging our end-users to crowd-source the production of huge, terabyte scale labeled datasets of images.
view all job listings view all MadBits job listings
Leave a Reply
You must be logged in to post a comment.