$$heading_1$$ 深度学习实践：从零开始做电影评论文本情感分析

http://ai.stanford.edu/~amaas/data/sentiment/aclImdb_v1.tar.gz

tree aclImdb -L 2

vim 1234_10.txt

I grew up watching this movie ,and I still love it just as much today as when i was a kid. Don't listen to the critic reviews. They are not accurate on this film.Eddie Murphy really shines in his roll.You can sit down with your whole family and everybody will enjoy it.I recommend this movie to everybody to see. It is a comedy with a touch of fantasy.With demons ,dragons,and a little bald kid with God like powers.This movie takes you from L.A. to Tibet , of into the amazing view of the wondrous temples of the mountains in Tibet.Just a beautiful view! So go do your self a favor and snatch this one up! You wont regret it!

$$heading_1$$ Coursera上博弈论相关课程（公开课）汇总推荐

1. 斯坦福大学的 博弈论（Game Theory）

This course is aimed at students, researchers, and practitioners who wish to understand more about strategic interactions. You must be comfortable with mathematical thinking and rigorous arguments. Relatively little specific math is required; but you should be familiar with basic probability theory $$extract_itex$$for example, you should know what a conditional probability is$$/extract_itex$$, and some very light calculus would be helpful.

Popularized by movies such as "A Beautiful Mind", game theory is the mathematical modeling of strategic interaction among rational $$extract_itex$$and irrational$$/extract_itex$$ agents. Over four weeks of lectures, this advanced course considers how to design interactions between agents in order to achieve good social outcomes. Three main topics are covered: social choice theory $$extract_itex$$i.e., collective decision making and voting systems$$/extract_itex$$, mechanism design, and auctions. In the first week we consider the problem of aggregating different agents' preferences, discussing voting rules and the challenges faced in collective decision making. We present some of the most important theoretical results in the area: notably, Arrow's Theorem, which proves that there is no "perfect" voting system, and also the Gibbard-Satterthwaite and Muller-Satterthwaite Theorems. We move on to consider the problem of making collective decisions when agents are self interested and can strategically misreport their preferences. We explain "mechanism design" -- a broad framework for designing interactions between self-interested agents -- and give some key theoretical results. Our third week focuses on the problem of designing mechanisms to maximize aggregate happiness across agents, and presents the powerful family of Vickrey-Clarke-Groves mechanisms. The course wraps up with a fourth week that considers the problem of allocating scarce resources among self-interested agents, and that provides an introduction to auction theory.

3. 东京大学的 博弈论入门课程（Welcome to Game Theory）

This course provides a brief introduction to game theory. Our main goal is to understand the basic ideas behind the key concepts in game theory, such as equilibrium, rationality, and cooperation. The course uses very little mathematics, and it is ideal for those who are looking for a conceptual introduction to game theory. Business competition, political campaigns, the struggle for existence by animals and plants, and so on, can all be regarded as a kind of “game,” in which individuals try to do their best against others. Game theory provides a general framework to describe and analyze how individuals behave in such “strategic” situations. This course focuses on the key concepts in game theory, and attempts to outline the informal basic ideas that are often hidden behind mathematical definitions. Game theory has been applied to a number of disciplines, including economics, political science, psychology, sociology, biology, and computer science. Therefore, a warm welcome is extended to audiences from all fields who are interested in what game theory is all about.

$$heading_1$$ 斯坦福大学深度学习与自然语言处理第四讲：词窗口分类和神经网络

1. $$UFLDL tutorial$$
2. $$Learning Representations by Backpropogating Errors$$
3. 第四讲Slides $$slides$$
4. 第四讲视频 $$video$$

$$heading_1$$ 斯坦福大学深度学习与自然语言处理第三讲：高级的词向量表示

1. Paper1：$$GloVe: Global Vectors for Word Representation$$
2. Paper2：$$Improving Word Representations via Global Context and Multiple Word Prototypes$$
3. Notes：$$Lecture Notes 2$$
4. 第三讲Slides $$slides$$
5. 第三讲视频 $$video$$

$$heading_1$$ 斯坦福大学深度学习与自然语言处理第二讲：词向量

1. Paper1：$$Distributed Representations of Words and Phrases and their Compositionality$$]
2. Paper2：$$Efficient Estimation of Word Representations in Vector Space$$
3. 第二讲Slides $$slides$$
4. 第二讲视频 $$video$$

$$heading_1$$ 斯坦福大学机器学习第八课“神经网络的表示$$extract_itex$$Neural Networks: Representation$$/extract_itex$$”

1)  Non-linear hypotheses $$extract_itex$$非线性hypotheses$$/extract_itex$$

2)  Neurons and the brain $$extract_itex$$神经元和大脑$$/extract_itex$$

3)  Model representation I $$extract_itex$$模型表示一$$/extract_itex$$

4)  Model representation II $$extract_itex$$模型表示二$$/extract_itex$$

5)  Examples and intuitions I $$extract_itex$$例子和直观解释一$$/extract_itex$$

6)  Examples and intuitions II $$extract_itex$$例子和直观解释二$$/extract_itex$$

7)  Multi-class classification $$extract_itex$$多类分类问题$$/extract_itex$$

1)  Non-linear hypotheses $$extract_itex$$非线性hypotheses$$/extract_itex$$

2)  Neurons and the brain $$extract_itex$$神经元和大脑$$/extract_itex$$

• 起源于尝试让机器模仿大脑的算法；
• 在80年代和90年代早期非常流行，慢慢在90年代后期衰落；
• 最近得益于计算机硬件能力，又开始流行起来：对于很多应用，神经网络算法是一种“时髦”的技术；

3)  Model representation I $$extract_itex$$模型表示一$$/extract_itex$$

$$extract_itex$$a^{j}_i$$/extract_itex$$ = j层第i个单元的激活函数

$$extract_itex$$Theta^{$$extract_itex$$j$$/extract_itex$$}$$/extract_itex$$ = 从第j层映射到第j+1层的控制函数的权重矩阵

4)  Model representation II $$extract_itex$$模型表示二$$/extract_itex$$

5)  Examples and intuitions I $$extract_itex$$例子和直观解释一$$/extract_itex$$

6)  Examples and intuitions II $$extract_itex$$例子和直观解释二$$/extract_itex$$

7)  Multi-class classification $$extract_itex$$多类分类问题$$/extract_itex$$

http://en.wikipedia.org/wiki/Neural_network

http://en.wikipedia.org/wiki/Artificial_neural_network

$$heading_2$$ 神经网络编程入门

$$heading_3$$ 神经网络入门连载

http://library.thinkquest.org/29483/neural_index.shtml

http://home.agh.edu.pl/~vlsi/AI/xor_t/en/main.htm

http://en.wikipedia.org/wiki/NOR_logic

http://en.wikipedia.org/wiki/Logic_gate

$$heading_1$$ Coursera公开课笔记: 斯坦福大学机器学习第七课“正则化$$extract_itex$$Regularization$$/extract_itex$$”

1)  The Problem of Overfitting$$extract_itex$$过拟合问题$$/extract_itex$$

2)  Cost Function$$extract_itex$$成本函数$$/extract_itex$$

3)  Regularized Linear Regression$$extract_itex$$线性回归的正则化$$/extract_itex$$

4)  Regularized Logistic Regression$$extract_itex$$逻辑回归的正则化$$/extract_itex$$

1)  The Problem of Overfitting$$extract_itex$$过拟合问题$$/extract_itex$$

a) 欠拟合$$extract_itex$$underfit, 也称High-bias$$/extract_itex$$

b) 合适的拟合：

c) 过拟合$$extract_itex$$overfit,也称High variance$$/extract_itex$$

a) 欠拟合

b) 合适的拟合

c) 过拟合

a) 减少特征的数量：

-人工的选择保留哪些特征；

-模型选择算法（之后的课程会介绍）

b) 正则化

-保留所有的特征，但是降低参数$$extract_itex$$theta_j$$/extract_itex$$的量/值；

-正则化的好处是当特征很多时，每一个特征都会对预测y贡献一份合适的力量；

2)  Cost Function$$extract_itex$$成本函数$$/extract_itex$$

a) 合适的拟合：

b) 过拟合

-“简化”的hypothesis；

-不容易过拟合；

-特征包括：$$extract_itex$$x_1, x_2, ... , x_{100}$$/extract_itex$$

-参数包括：$$extract_itex$$theta_0, theta_1, ..., theta_n$$/extract_itex$$

-算法依然会正常的工作, 将 $$extract_itex$$lambda$$/extract_itex$$设置的很大不会影响算法本身；

-算法在去除过拟合问题上会失败；

-算法的结构将是欠拟合（underfitting),即使训练数据非常好也会失败；

-梯度下降算法不一定会收敛；

88集团赠送38彩金正则化，以下引自李航博士《统计学习方法》1.5节88集团赠送38彩金正则化的一些描述：

3)  Regularized Linear Regression$$extract_itex$$线性回归的正则化$$/extract_itex$$

X 是m * $$extract_itex$$n+1$$/extract_itex$$矩阵

y是m维向量：

4)  Regularized Logistic Regression$$extract_itex$$逻辑回归的正则化$$/extract_itex$$

??Hypothesis?????

?????????Cost Function???

?????????

??" />$$extract_itex$$theta).

??????????????????????????

??Hypothesis?????

?????????Cost Function???

?????????

??$$/extract_itex$$

h_theta$$extract_itex$$x$$/extract_itex$$ = frac{1}{1+e^{-theta^Tx}}.

http://en.wikipedia.org/wiki/Regularization_%28mathematics%29

http://en.wikipedia.org/wiki/Overfitting

$$heading_1$$ Coursera公开课笔记: 斯坦福大学机器学习第四课“多变量线性回归$$extract_itex$$Linear Regression with Multiple Variables$$/extract_itex$$”

1) Multiple features$$extract_itex$$多维特征$$/extract_itex$$

2) Gradient descent for multiple variables$$extract_itex$$梯度下降在多变量线性回归中的应用$$/extract_itex$$

3) Gradient descent in practice I: Feature Scaling$$extract_itex$$梯度下降实践1：特征归一化$$/extract_itex$$

4) Gradient descent in practice II: Learning rate$$extract_itex$$梯度下降实践2：步长的选择$$/extract_itex$$

5) Features and polynomial regression$$extract_itex$$特征及多项式回归$$/extract_itex$$

6) Normal equation$$extract_itex$$正规方程-区别于迭代方法的直接解法$$/extract_itex$$

7) Normal equation and non-invertibility $$extract_itex$$optional$$/extract_itex$$$$extract_itex$$正规方程在矩阵不可逆情况下的解决方法$$/extract_itex$$

$$heading_1$$ Coursera公开课笔记: 斯坦福大学机器学习第二课“单变量线性回归$$extract_itex$$Linear regression with one variable$$/extract_itex$$”

1) Model representation$$extract_itex$$模型表示$$/extract_itex$$

2) Cost function$$extract_itex$$代价函数，成本函数$$/extract_itex$$

3) Cost function intuition I$$extract_itex$$直观解释1$$/extract_itex$$

4) Cost function intuition II$$extract_itex$$直观解释2$$/extract_itex$$

5) Gradient descent$$extract_itex$$梯度下降$$/extract_itex$$

6) Gradient descent intuition$$extract_itex$$梯度下降直观解释$$/extract_itex$$

7) Gradient descent for linear regression$$extract_itex$$应用于线性回归的的梯度下降算法$$/extract_itex$$