Linear Algebra Cheat Sheet

 

Common Convolutional Neural Networks

1. LeNet - 5 - 1998

2. AlexNet - 2012

3. VGG - 16 - 2015

4.  ResNet

Adam Algorithm

1. Adam Algorithm

2. Parameters

Convolution Layer

1. The idea of convolution layer

# of parameter dimensions:

# dimension reduction by 1 convolution operation:

2. The idea of ConvNet

some notes:

1. the shape of the layers go smaller and smaller.

2. the number of channels go larger and larger.

3. the final results of ConvNet will be flatten and then feed into a NN layer. 

3. The idea of Pooling Layer (Max Pooling)

4. Putting it together

Neural Network Forward and Backward Compute (N layers)

1. Forward Propagation

2. Backward Propagation

3. Put it together

Neural Network Forward and Backward Compute (2 layers)

1: Forward Compute with One Example

2: Forward Compute with Vectorizing across multiple examples

3. Gradient for Backward Compute

4. Formula for Backward Compute

5. To understand why the partial derivatives are calculated, check out the book here: http://www.deeplearningbook.org/  

or check the video here:

https://www.coursera.org/learn/neural-networks-deep-learning/lecture/6dDj7/backpropagation-intuition-optional

ImageNet

1. What it is?

More than 14 million[1][2] images have been hand-annotated by the project to indicate what objects are pictured and in at least one million of the images, bounding boxes are also provided.[3] ImageNet contains more than 20,000 categories[2] with a typical category, such as "balloon" or "strawberry", consisting of several hundred images.

2. History

AI researcher Fei-Fei Li presented their database for the first time as a poster at the 2009 CVPR.

3. ImageNet Large Scale Visual Recognition Challenge (ILSVRC)

GoogleLeNet-v4 is the winner until now: https://www.google.com/search?q=imagenet+accuracy+over+time&tbm=isch&source=univ&sa=X&ved=2ahUKEwiI_7yQ3tLmAhVFSX0KHdjICC8QsAR6BAgFEAE&biw=1920&bih=897#   

https://machinelearningmastery.com/introduction-to-the-imagenet-large-scale-visual-recognition-challenge-ilsvrc/

Google Spreadsheet API

https://medium.com/@ashokyogi5/a-beginners-guide-to-google-oauth-and-google-apis-450f36389184

Docker Notes

1. What is a Dockerfile?

• Docker can build images automatically by reading the instructions from a Dockerfile. A Dockerfile is a text document that contains all the commands a user could call on the command line to assemble an image. 

2. What are the most common Docker command? 

Build commands:

• docker build -t name:version:
  Build an image from the Dockerfile in the current directory and tag the image
• docker images:
  List all images that are locally stored with the Docker engine
• docker rmi imagename (REPOSITORY:TAG)
  remove an image from local

Ship commands:

• docker pull
• docker push

Run commands:

• docker run 

--rm remove container automatically after it exits 

--it connect the container to terminal

--name name the container 

-p 5000:80 expose port 5000 externally and map to port 80 

-v create a host mapped volume inside the container the image from which the container is instantiated the command to run inside the container

• docker stop
• docker kill 
• docker ps
  List all containers
• docker exec --it container bash
  create a process inside a container and connect to the terminal

https://www.docker.com/sites/default/files/Docker_CheatSheet_08.09.2016_0.pdf

3. Image vs Container 

Image vs Container is like Class vs Object

4. Where to check out some example Dockerfile?

https://github.com/docker-library/python/blob/8601079d1f70b03c01408377716a3243ce75cec9/3.7/stretch/Dockerfile

https://github.com/Quantisan/docker-clojure/blob/e04878d311653b89714e15d8fa8d6081f2c2d773/debian/lein/Dockerfile

5. How to clean local docker file? images, contains and volumes? 

docker system prune - removing dangling images
docker rmi
docker rm
docker run --rm


https://www.digitalocean.com/community/tutorials/how-to-remove-docker-images-containers-and-volumes

6. What are most common dockerfile command?

• FROM
  The FROM instruction initializes a new build stage and sets the Base Image for subsequent instructions. As such, a valid Dockerfile must start with a FROM instruction
• RUN
  RUN <command>
  
  • RUN lein test && \
  • lein uberjar
  RUN ["executable", "param1", "param2"]
• CMD
• ENTRYPOINT
• EXPOSE
  
  • EXPOSE 80/tcp
  • Regardless of the EXPOSE settings, you can override them at runtime by using the -p flag. 
• ENV
• ENV myName="John Doe"  \
•     myCat=fluffy
• ADD
• The ADD instruction copies new files, directories or remote file URLs from <src> and adds them to the filesystem of the image at the path <dest>
• ADD files* /somedir/
• COPY
• WORKDIR
• ARG
• LABEL
• The LABEL instruction adds metadata to an image. A LABEL is a key-value pair. To include spaces within a LABEL value, use quotes and backslashes as you would in command-line parsing. 

7. The Process:

Find the Docker Base Image
Build my own Docker Image
Run the docker image

how things work

The most important part of the object is a strip of two different metals, one on top of another. As they heat up, both metals expand, but one does it faster than the other. The strip bends and connects with a switch, which turns off the power supply. When the strip cools down, the metals contract and the switch is disconnected.

The object has several component parts, most of which are made of plastic. A disc inserted into the object spins quickly. At the same time a thin beam of light strikes the disc and converts digital symbols into sounds. The sounds can be increased and decreased in volume by means of a button or dial.

Liquid and gas are compressed in a hard metal tube. This can be released by pushing or squeezing a button which opens a valve. When the liquid-gas combination leaves the tube and is mixed with oxygen, it rapidly expands.

The object is mainly made of aluminium. As it moves forward, air flows over two horizontal sections. As it accelerates, a vacuum is formed over the horizontal sections and the object is pulled into the air by the force of this vacuum.

This object consists of two main parts: one is made mainly of plastic and metal, the other is made mainly of glass. Light enters the glass section and a small door in the device opens up when a button is pressed. At the same time,  smaller window called an aperture adjusts itself to control the amount of light. The light is then adsorbed and a sheet of plastic coated in a special chemical. An image is formed and this can then be processed and developed into a two-dimensional paper-based object.

A sharp blade inside a plastic container rotates very quickly. It chops or grinds anything it touches, which we can then use to produce soup, sauces and dressing.

This is a very simple object which originates from China. A small piece of paper is lit with a match. It burns away until the flame ignites the chemical compound inside a cardboard tube. The result is a display of light and colour.

describing & analysing tables

considerable discrepancy (or conflict)
- something not right.

sudden and noticeable difference

rise dramatically

increase slightly

go up sharply

sharp drop

remain constant

verb related with changes

we need to adapt these cars so disabled people can drive them. 

the country found it hard to adapt to the new government

To make sure your car is safe to drive, you should check and adjust the brakes on a regular basis.

He found it hard to adjust to a tropical country.

You must transform the voltage or the system will blow up.

He decided to transform his appearance by having plastic surgery.

Our bills will be less if we switch from gas to electricity.

They had to switch flights at Heathrow Airport.

You cannot alter the terms of the contract once it has been signed.

He wants to alter his appearance.

It will help your digestion if you vary your diet.

Prices of flats vary from a few thousands to millions of pounds.

We need to exchange our pounds for dollars.

You can usually exchange goods which are faulty if you show the receipt.

We have had to expand our sales force to cope with the extra demand.

Water will expand when it is frozen. 

The price of oil will increase next year.

Most bosses refuses to increase salaries when they are asked.

The management decide to dissolve the company and sell the offices.

Dissolve the sugar in boiling water.

More and more people are moving to cities to swell the population there.

The swap sting caused his leg to swell up.

The market for typewriters will probably disappear completely in the next few years.

The police are confused by the increasing number of people who disappear this year.

The old contract ran out and we had to renew it.

Many people argue that it's futile to renew old hostilities. 

They have received funds to renovate the old building.

The house is in good condition, but we need to renovate the central heating system.

The boss offered to promote him from salesman to manager.

Our main aim is to promote tourism in the country.

If you washed it too much, the colour will fade.

We watched the islands fade away into the distance. 

The company decided to replace the permanent staff with freelancers.

You must replace the books on the shelf when you have finished with them.

The doctors were unable to cure her illness.

Preserve the meat in salt water for between three and five days.

Governments are trying to reduce pollution. 

The best way to save money is to reduce the number of staff.

Conditional Statements

Part I:

You can borrow my dictionary providing that you return it before you go home.

You cannot go to university unless you have good grades.

Pollution will get worse as long as we continue to live in a throw away society.

Many developed countries are willing to waive the Third World Debt on condition that the money is invested in education and medicine.

Some countries will never be able to rectify their deficits no matter how hard they work.

Computers are difficult things to understand, however many books you read about them.

Crime is a problem, wherever country you go to.

Part II:

Providing that you can return it before you go home, you can borrow my dictionary.

Unless you have good grades, you cannot go to university.

As long as we continue to live in a throw away society, pollution will get worse.

On condition that the money is invested in education and medicine, many developed countries are willing to waive the Third World Debt.

No matter how hard they work, some countries will never be able to rectify their deficits.

However many books you read about them, computers are difficult to understand.

Wherever country you go to, crime is a problem.

Part III:

Being able to drive is one of the prerequisites of the job of salesman.

Before you accept a job, it is important that you agree with the conditions of the contract.

It is a requirement of the university that you attend an interview.

Mac Shortcuts

MariaDB : Should I use it to replace MySQL?

1. What is MariaDB?

• It is designed as a replacement of MySQL. The user of MySQL should be able to switch to MariaDB without change the data in the database.
• MariaDB is open-source. GNU.

2.

English Study 1

Some notes from MySQL

1. Command Line:
https://www.digitalocean.com/community/tutorials/a-basic-mysql-tutorial

Self Reflection

1. Career Strength: T-shape skill sets
    Horizontal skills: Product skills.
    Vertical skills: Data modelling skills.

2. 1 Day Reaction Rule
    If I like it, I will do it in that day.
    If I like it but I did not do it that day, it means I do not like it that much.
    If I did not do anything I like in a week, it means a failure week.

Elastic · Revealing Insights from Data (Formerly Elasticsearch)

How to Design App Store

1. Scenario

1) List Apps
2) Search Apps
3) View an App
4) Install & Remove App

2. Numbers


3. Applications


4. Framework


5. Used Libs

(source: bittiger.io)