- 1 Machine Learning
- 1.1 K–Nearest Neighbour
- 1.2 Linear models
- 1.3 Decision Tree
- 1.4 Neural Networks
- 1.5 Frameworks
- 1.6 Resources
Machine Learning is a term used to describe certain algorithms that »learn«. But learning can be seen as a quite broad term, for some applications it really comes down to a statistical calculation
- means how well the algorithm performs on unknown data, meaning how well can the algorithm generalise?
- To many features, so the algorithms will only work on the sample data
- To less features, so the algorithms will apply to any data.
- Mostly the input data. Certain aspects of the investigated object that is specific about the problem.
- How wrong the algorithm is, connected to:
- function that calculates the error
- One run through the network
- adjusting the weights of the network according to the derivative function of the estimated and the actual output.
K = Variable
Plots Features as Vectors and sorts them in space > Clusters them
The new datapoint is also put in this space and the K nearest points are used to categorise the new point.
Draw a linear border between 2 or more classes
Cain of if / else statements
Also known as Deeplearning
Uses different Layers and a networked structure to find the best values for the wanted result. It is working in »loops« using Feedforward -> Backpropagation -> FFD -> BPG … in x many epochs.
It consists of a lot of so called neurons. Each neuron holds a value, that is being calculated according to the activation function.
There are different kind of neurons:
- Perceptron: outputs 0 or 1
- Sigmoid: outputs a value between 0 and 1: f(x) = 1/1+e^(-x)
- ReLU: same as Sigmoid but cuts values: -1<x>1
- … other functions, that basically map a value to -1 to +1 (tanh)
the calculation of the neuron:
- taking all input–weights and multiple with the input
- take the sum of that (add bias)
- take that sum and run it through the activation function
- Take the current output of the network and substract from wished value (from dataset)
- calculate the derivative of the sumfunction (see FFD) and the expected value
- map that to the values of the weights of the previous layer and substract the difference (delta)
- do the same for all the previous layers
So if you take different or multiple of those networks you end up with one of the following popular concepts:
Feed forward networks
Simple implementation of a neural network, see above.
Recurrent Neural Networks
Connects different neurons to implement some sort of memory.
LSTM: Long Short-Term Memory
Stores last results in a neural network itself. Good for text-generation (prevents repeating)
CNN: Convolutional Neural Networks
Especially for images. Divides the data in smaller bits to recognise patterns in different contexts.
GAN: Generative Adversarial Network
Uses two neural networks that oppose each other. One generates random data, the other one figures if it is fake or real. So the first one is trained to fool the discriminator.
- https://www.youtube.com/watch?v=aircAruvnKk Learning NN
- https://twitter.com/DrBeef_/status/1055285640420483073 (copied from)
- https://superrare.co/market Market for selling digital art
- Introduction to Machine Learning with Python: A Guide for Data Scientists