Seasons Of Code

Machine Learning in Browser    • Soumya Chatterjee   

WnCC - Seasons of Code

Seasons of Code is a programme launched by WnCC along the lines of the Google Summer of Code. It provides one with an opprtunity to learn and participate in a variety of interesting projects under the mentorship of the very best in our institute.

List of Running Projects

Machine Learning in Browser

Machine Learning in Browser

Traditionally, machine learning models have required huge amounts of computation power and could only be run on specialized hardware (GPU etc). Thanks to the efforts to many researchers and developers, it is now possible to run these models right in your browser.

No. of mentees: 2


AI Experiments with Google( have some impressive tools and games which run in the browser. Some examples:

  • Teachable Machine ( A fun tool to train an image classifier using image captured from your webcam.
  • Emoji Scavenger Hunt ( A game where you have to find real-world objects representing a shown emoji.

In this project, we will start by deploying pre-trained models in the browser using tensorflow.js. Depending on the interest on the mentee, we can then implement fine-tuning (adapting a pre-trained model to new images) like in Teachable Machines. Or we can develop a gallery app which groups images into different categories (like in Google Photos).

Proposal: Mention you familiarity with Machine Learning, Python and JavaScript. Due to the relatively short duration, I expect you to have some knowledge of ML and Python. Knowledge of JS is not a hard requirement and you pick it up as you go along. Also mention your motivation to do the project, which of the two choices above you would want to work on and your familiarity/experience with the topics mentioned. Some web development experience will also be helpful.

Tentative Project Timeline

Week Number Tasks to be Completed
Week 1-2 Recap of ML, Python and JS.
Week 3 Deploy a pretrained MobileNet model in browser. Add support for uploading images and taking images from webcam.
Week 4-5 Add machinery for fine-tuning the models. Or make a simple gallery webapp.