Machine Learning Researcher (PhD)

Build the Future of Ocean Conservation

OnDeck is defining new ways for humans to interact with petabytes of imagery & video.

We are pioneering novel AI research and building it into products that make a difference. Backed by National Geographic, the Environmental Defense Fund, Canada’s Ocean Supercluster and many more, we stand at the forefront of AI for conservation and protection of global marine resources.

Our team thrives in fast-paced, innovative environments. We are continuously pushing the boundaries of what is possible, collaborating with users around the world, and developing cutting-edge AI methods that genuinely change the course of the world's fisheries and oceans.

We are seeking standout team players who want to use their skills to make a dent in the universe. If you love tackling complex challenges and you’re keen to scale with a startup reaching new heights, apply to join our team.

What you'll be doing

We’re excited to be pushing the boundaries of what is possible in computer vision: creating grounded visual reasoning & fine-grained classification, and searching for anything in thousands of hours of video footage with natural language search. What you’ll be doing is extending our NeurIPS workshop paper across several domains, scaling it to thousands of classes, and bridging the gap between video understanding models and our methods. We’ll provide the dedicated cloud GPUs and research autonomy for you to keep pushing the boundaries of visual reasoning.

You’ll have the opportunity to work alongside our engineering team to bring this applied research into reality, watching as your research turns into real products in just a few weeks. And we’ll be collecting all of the original research that is produced, submitting even more papers to conferences and journals.

Impact and scope of work

You will have ownership over mission-critical research, propelling us towards the frontier of ocean tech and our goal of end-to-end visual automation. In this mix of machine learning research and research engineering, you will:

• Develop state-of-the-art machine learning models that can reason about visual data and retrieve relevant answers from external knowledge sources.
• Research, implement, and optimize for various tasks, including object detection, species classification, and multi-object tracking for scalable ocean vision systems and environmental monitoring.
• Devise better data-driven models for information retrieval, hierarchical classification, multi-modal fusion, generation and media understanding (CV & NLP).
• Collaborate with engineers to translate research into products, as well as communicating research plans, progress, results, and impact to the whole organization and in conference/journal papers.
• Collaborate and work across teams to develop concepts that advance the entire product pipeline, all the way to production (infrastructure, software, data collection, machine learning, etc.).
• Conduct research that enables learning the semantics of data across multiple modalities (images, video, text, physical sensors, and other modalities).

You will also get visibility of the business and product side, and see how OnDeck is commercializing machine learning systems and infrastructure to deliver recurring value to customers and real change to ocean sustainability.

Qualifications

• Master’s or Ph.D. degree in Computer Science, Machine Learning, Artificial Intelligence, or relevant technical field.
• Experience as a machine learning researcher, including internships and full-time.
• Proficiency in programming and implementing machine learning workflows using Python (experience with C, C++, and JavaScript/TypeScript is an asset)
• Research experience with vision language models/large vision models, multi-modal encoder-decoder design, domain adaptation of open-vocabulary models, information retrieval problems, or other areas related to NLP and CV.
• Proven track record of achieving significant results as demonstrated by awards, fellowships, patents, as well as first-authored publications at leading journals or conferences such as NeurIPS, ICLR, ICML, JMLR, AAAI, KDD, CVPR, ECCV, ICCV, ACL, NAACL, EACL, or similar.
• Experience communicating research for public audiences of peers.
• Experience manipulating and analyzing complex, large scale, potentially high-dimensionality data from varying sources.
• Experience in utilizing theoretical and empirical research to solve problems.
• Authorized to work in Canada (work permit or other).
• Strong technical communication skills in English, both written and verbal
• Enthusiasm for research that revolutionizes ocean tech and visual reasoning

Preferred qualifications

• Ph.D. degree in Computer Science, Machine Learning, Artificial Intelligence, or relevant technical field.
• Previous work experience designing and implementing ML models in production environments
• Extensive experience in machine learning products, computer vision-as-a-service, serving ML models, and/or optimizing model performance
• Experience in software engineering including cloud/edge development, Unix/Linux environments, distributed and parallel systems, and data engineering
• Proficiency with PyTorch, TensorFlow, and multiple machine learning frameworks/tools

Benefits

OnDeck rewards extraordinary work with extraordinary benefits. Get unparalleled career development and exposure with ownership of critical projects. We balance our commitment to excellence with VIP events, hybrid work, travel, and days on the water. We encourage flexible vacation and schedules.

Specific benefits to help everyone work at their best include:

• Health benefits: Health and Wellness spending accounts for any medical expenses or personal wellness expenses in your life.
• Unlimited vacation
• Hybrid work, remote flexible: Want to work from a surf beach for a week? Go for it.
• Team lunches & happy hours, office pastries, snacks, coffees and beers.
• Team sailing days + offsites to remote Pacific beaches & rainforests.
• Startup events and dinners such as NeurIPS and more.
• Base salary of $120,000 - $180,000

Apply here