🚀

7:0 What is machine learning

Machine learning is a big subject, lets look at it in relation to creative coding to keep things simple.

How do i use machine learning in my code

Before we dive into what Machine Lerning (ML) is you might want to look at some of the great resources out there. They have examples you can try and allow you to use their tools for free:

ML5JS: https://learn.ml5js.org/
"ml5.js aims to make machine learning approachable for a broad audience of artists, creative coders, and students."

Google MediaPipe: https://developers.google.com/mediapipe
Googles solution to use machine learning on any device with many different coding languages.

Handsfree JS: https://handsfreejs.netlify.app/
"Build handsfree User Experiences and add face, hand, and pose tracking to your projects in a snap ✨👌"

What is machine learning

Machine learning (ML) is one of the ways that artificial intelligence (AI) algorithms are created.

Most of the AI stuff you will see on the internet or in applications you might experience are using machine learning. We don't need to know how it works - though this subject is really interesting. (if you want to know more perhaps check out this site https://www.3blue1brown.com/topics/neural-networks

Machine learning in creative code

Machine learning can enable us to do things that were previously really difficult, or expensive in creative code. For instance this image shows PoseNet at work, a machine learning model that can identify human body poses: i.e. identify and get the positions for people using a webcam.

This kind of thing used to require expensive equipment and very tricky code, now we can do it on any device with a camera (e.g. your laptop or phone)

posenet machine learning examples
image via: https://pdm.com.co/tag/posenet/

Machine learning models

Machine learning models are individual algorithms that help with a particular task.

For instance PoseNet is a model that identifies and positions human body parts in an image. There are similar models that focus in on the position of your hand and fingers...

...There are models that deal with classifying and naming objects in a picture (or webcam). There are models that deal with sound, text, language, data and much much more.

image showing handpose machine learning algorithm
amcc.io/handpose-pinch/