Chapter 1: AI Fundamentals and History
Learning goals
- Distinguish rule-based systems from machine learning, and the types of learning (supervised, unsupervised, reinforcement) with examples
- Explain how neural networks learn by adjusting weights, and overfitting and its countermeasures
- Explain CNN, RNN, LSTM, VAE and GAN, and the difference between discriminative and generative AI
- Explain the features of the three AI booms and the path that led to generative AI
Key points
- Rule-based systems run on rules written by people and are weak against unexpected input. Machine learning learns rules (a model) from data.
- Supervised learning does classification and regression on labeled data; unsupervised learning does clustering and dimensionality reduction without labels; reinforcement learning learns a policy from actions and rewards. Semi-supervised learning combines a little labeled data with a lot of unlabeled data.
- No free lunch theorem: no single algorithm is always best for every problem.
- A neural network consists of input, hidden and output layers, and adjusts weights with backpropagation and gradient descent so that the loss function value becomes smaller.
- Overfitting means fitting the training data too closely so performance drops on unseen data. Countermeasures include regularization, dropout, early stopping and more data.
- CNNs capture image features with convolution; RNNs handle sequence data but suffer from vanishing gradients; LSTMs keep long dependencies with gates. Attention and Transformers later became mainstream.
- A VAE compresses input into a latent vector with an encoder and generates with a decoder; a GAN generates by pitting a generator against a discriminator.
- The first boom was search and inference, the second knowledge representation and expert systems, the third machine learning, deep learning and big data. Generative AI based on Transformers, LLMs and diffusion models extends from it.
Workplace uses
- General AffairsSwitch inquiry routing from keyword rules (rule-based) to a model trained on past routing results (supervised learning), making it easier to handle new phrasings.
- SalesCluster customer purchase data without labels and change proposals for each group of similar customers.
Exam objectives (from the exam guide)
- AIの基本的な仕組み(ルールベースと機械学習)
- 機械学習(教師あり・教師なし・強化・半教師あり学習、ノーフリーランチ定理)
- ニューラルネットワーク(学習の仕組み、過学習と対策、転移学習、CNN・RNN・LSTM・VAE・GAN、識別系AIと生成系AI)
- AIの歴史(ダートマス会議から第三次AIブーム、生成AI、シンギュラリティ)