René's URL Explorer Experiment

Title: GitHub - ChunyeLi/MachineLearning_Python: 机器学习算法python实现

Open Graph Title: GitHub - ChunyeLi/MachineLearning_Python: 机器学习算法python实现

X Title: GitHub - ChunyeLi/MachineLearning_Python: 机器学习算法python实现

Description: 机器学习算法python实现. Contribute to ChunyeLi/MachineLearning_Python development by creating an account on GitHub.

Open Graph Description: 机器学习算法python实现. Contribute to ChunyeLi/MachineLearning_Python development by creating an account on GitHub.

X Description: 机器学习算法python实现. Contribute to ChunyeLi/MachineLearning_Python development by creating an account on GitHub.

Opengraph URL: https://github.com/ChunyeLi/MachineLearning_Python

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern	/:user_id/:repository
route-controller	files
route-action	disambiguate
fetch-nonce	v2:4eb55769-093f-b775-ed9c-e2dae1e60b15
current-catalog-service-hash	f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id	BCFE:3E5370:DCD34D:1227C05:697712C2
html-safe-nonce	c5c9dc549cc3107b0b017da815d892d261e5fc305ed5378fc4f8d40aae8f561e
visitor-payload	eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCQ0ZFOjNFNTM3MDpEQ0QzNEQ6MTIyN0MwNTo2OTc3MTJDMiIsInZpc2l0b3JfaWQiOiI4MzA1ODE2Mzg2ODEwNjE0NDY2IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac	b8b8575a7e0cc662128802e2d8057fea2c93b97af48a087819083e04606f6ea6
hovercard-subject-tag	repository:112732503
github-keyboard-shortcuts	repository,copilot
google-site-verification	Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-url	https://collector.github.com/github/collect
analytics-location	//
fb:app_id	1401488693436528
apple-itunes-app	app-id=1477376905, app-argument=https://github.com/ChunyeLi/MachineLearning_Python
twitter:image	https://opengraph.githubassets.com/77fa4a78a2671b3562abe962cbdf96f5db358a04aa8db1b17ffc06f41f6870f4/ChunyeLi/MachineLearning_Python
twitter:card	summary_large_image
og:image	https://opengraph.githubassets.com/77fa4a78a2671b3562abe962cbdf96f5db358a04aa8db1b17ffc06f41f6870f4/ChunyeLi/MachineLearning_Python
og:image:alt	机器学习算法python实现. Contribute to ChunyeLi/MachineLearning_Python development by creating an account on GitHub.
og:image:width	1200
og:image:height	600
og:site_name	GitHub
og:type	object
hostname	github.com
expected-hostname	github.com
None	01d198479908d09a841b2febe8eb105a81af2af7d81830960fe0971e1f4adc09
turbo-cache-control	no-preview
go-import	github.com/ChunyeLi/MachineLearning_Python git https://github.com/ChunyeLi/MachineLearning_Python.git
octolytics-dimension-user_id	32614184
octolytics-dimension-user_login	ChunyeLi
octolytics-dimension-repository_id	112732503
octolytics-dimension-repository_nwo	ChunyeLi/MachineLearning_Python
octolytics-dimension-repository_public	true
octolytics-dimension-repository_is_fork	true
octolytics-dimension-repository_parent_id	71154529
octolytics-dimension-repository_parent_nwo	lawlite19/MachineLearning_Python
octolytics-dimension-repository_network_root_id	71154529
octolytics-dimension-repository_network_root_nwo	lawlite19/MachineLearning_Python
turbo-body-classes	logged-out env-production page-responsive
disable-turbo	false
browser-stats-url	https://api.github.com/_private/browser/stats
browser-errors-url	https://api.github.com/_private/browser/errors
release	f752335dbbea672610081196a1998e39aec5e14b
ui-target	full
theme-color	#1e2327
color-scheme	light dark

Links:

Skip to content	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#start-of-content
	https://patch-diff.githubusercontent.com/
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FChunyeLi%2FMachineLearning_Python
GitHub CopilotWrite better code with AI	https://github.com/features/copilot
GitHub SparkBuild and deploy intelligent apps	https://github.com/features/spark
GitHub ModelsManage and compare prompts	https://github.com/features/models
MCP RegistryNewIntegrate external tools	https://github.com/mcp
ActionsAutomate any workflow	https://github.com/features/actions
CodespacesInstant dev environments	https://github.com/features/codespaces
IssuesPlan and track work	https://github.com/features/issues
Code ReviewManage code changes	https://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilities	https://github.com/security/advanced-security
Code securitySecure your code as you build	https://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they start	https://github.com/security/advanced-security/secret-protection
Why GitHub	https://github.com/why-github
Documentation	https://docs.github.com
Blog	https://github.blog
Changelog	https://github.blog/changelog
Marketplace	https://github.com/marketplace
View all features	https://github.com/features
Enterprises	https://github.com/enterprise
Small and medium teams	https://github.com/team
Startups	https://github.com/enterprise/startups
Nonprofits	https://github.com/solutions/industry/nonprofits
App Modernization	https://github.com/solutions/use-case/app-modernization
DevSecOps	https://github.com/solutions/use-case/devsecops
DevOps	https://github.com/solutions/use-case/devops
CI/CD	https://github.com/solutions/use-case/ci-cd
View all use cases	https://github.com/solutions/use-case
Healthcare	https://github.com/solutions/industry/healthcare
Financial services	https://github.com/solutions/industry/financial-services
Manufacturing	https://github.com/solutions/industry/manufacturing
Government	https://github.com/solutions/industry/government
View all industries	https://github.com/solutions/industry
View all solutions	https://github.com/solutions
AI	https://github.com/resources/articles?topic=ai
Software Development	https://github.com/resources/articles?topic=software-development
DevOps	https://github.com/resources/articles?topic=devops
Security	https://github.com/resources/articles?topic=security
View all topics	https://github.com/resources/articles
Customer stories	https://github.com/customer-stories
Events & webinars	https://github.com/resources/events
Ebooks & reports	https://github.com/resources/whitepapers
Business insights	https://github.com/solutions/executive-insights
GitHub Skills	https://skills.github.com
Documentation	https://docs.github.com
Customer support	https://support.github.com
Community forum	https://github.com/orgs/community/discussions
Trust center	https://github.com/trust-center
Partners	https://github.com/partners
GitHub SponsorsFund open source developers	https://github.com/sponsors
Security Lab	https://securitylab.github.com
Maintainer Community	https://maintainers.github.com
Accelerator	https://github.com/accelerator
Archive Program	https://archiveprogram.github.com
Topics	https://github.com/topics
Trending	https://github.com/trending
Collections	https://github.com/collections
Enterprise platformAI-powered developer platform	https://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security features	https://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI features	https://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 support	https://github.com/premium-support
Pricing	https://github.com/pricing
Search syntax tips	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentation	https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in	https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FChunyeLi%2FMachineLearning_Python
Sign up	https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=ChunyeLi%2FMachineLearning_Python
Reload	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
Reload	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
Reload	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
ChunyeLi	https://patch-diff.githubusercontent.com/ChunyeLi
MachineLearning_Python	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
lawlite19/MachineLearning_Python	https://patch-diff.githubusercontent.com/lawlite19/MachineLearning_Python
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FChunyeLi%2FMachineLearning_Python
Fork 0	https://patch-diff.githubusercontent.com/login?return_to=%2FChunyeLi%2FMachineLearning_Python
Star 0	https://patch-diff.githubusercontent.com/login?return_to=%2FChunyeLi%2FMachineLearning_Python
MIT license	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LICENSE
0 stars	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/stargazers
2.5k forks	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/forks
Branches	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/branches
Tags	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tags
Activity	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/activity
Star	https://patch-diff.githubusercontent.com/login?return_to=%2FChunyeLi%2FMachineLearning_Python
Notifications	https://patch-diff.githubusercontent.com/login?return_to=%2FChunyeLi%2FMachineLearning_Python
Code	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
Pull requests 0	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/pulls
Actions	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/actions
Projects 0	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/projects
Wiki	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/wiki
Security 0	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/security
Insights	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/pulse
Code	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
Pull requests	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/pulls
Actions	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/actions
Projects	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/projects
Wiki	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/wiki
Security	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/security
Insights	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/pulse
Branches	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/branches
Tags	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tags
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/branches
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tags
106 Commits	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/commits/master/
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/commits/master/
AnomalyDetection	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/AnomalyDetection
AnomalyDetection	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/AnomalyDetection
K-Means	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/K-Means
K-Means	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/K-Means
LinearRegression	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/LinearRegression
LinearRegression	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/LinearRegression
LogisticRegression	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/LogisticRegression
LogisticRegression	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/LogisticRegression
NeuralNetwok	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/NeuralNetwok
NeuralNetwok	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/NeuralNetwok
PCA	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/PCA
PCA	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/PCA
SVM	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/SVM
SVM	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/SVM
formula	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/formula
formula	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/formula
images	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/images
images	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/tree/master/images
LICENSE	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LICENSE
LICENSE	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LICENSE
readme.md	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/readme.md
readme.md	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/readme.md
README	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
MIT license	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#机器学习算法python实现
	https://github.com/lawlite19/MachineLearning_Python/blob/master/LICENSE
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#目录
机器学习算法Python实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E7%AE%97%E6%B3%95python%E5%AE%9E%E7%8E%B0
一、线性回归	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E4%B8%80-%E7%BA%BF%E6%80%A7%E5%9B%9E%E5%BD%92
1、代价函数	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E4%BB%A3%E4%BB%B7%E5%87%BD%E6%95%B0
2、梯度下降算法	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-%E6%A2%AF%E5%BA%A6%E4%B8%8B%E9%99%8D%E7%AE%97%E6%B3%95
3、均值归一化	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E5%9D%87%E5%80%BC%E5%BD%92%E4%B8%80%E5%8C%96
4、最终运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E6%9C%80%E7%BB%88%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
5、使用scikit-learn库中的线性模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E4%BD%BF%E7%94%A8scikit-learn%E5%BA%93%E4%B8%AD%E7%9A%84%E7%BA%BF%E6%80%A7%E6%A8%A1%E5%9E%8B%E5%AE%9E%E7%8E%B0
二、逻辑回归	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E4%BA%8C-%E9%80%BB%E8%BE%91%E5%9B%9E%E5%BD%92
1、代价函数	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E4%BB%A3%E4%BB%B7%E5%87%BD%E6%95%B0
2、梯度	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-%E6%A2%AF%E5%BA%A6
3、正则化	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E6%AD%A3%E5%88%99%E5%8C%96
4、S型函数（即）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-s%E5%9E%8B%E5%87%BD%E6%95%B0%E5%8D%B3
5、映射为多项式	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E6%98%A0%E5%B0%84%E4%B8%BA%E5%A4%9A%E9%A1%B9%E5%BC%8F
6、使用的优化方法	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E4%BD%BF%E7%94%A8%E7%9A%84%E4%BC%98%E5%8C%96%E6%96%B9%E6%B3%95
7、运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7-%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
8、使用scikit-learn库中的逻辑回归模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8-%E4%BD%BF%E7%94%A8scikit-learn%E5%BA%93%E4%B8%AD%E7%9A%84%E9%80%BB%E8%BE%91%E5%9B%9E%E5%BD%92%E6%A8%A1%E5%9E%8B%E5%AE%9E%E7%8E%B0
逻辑回归_手写数字识别_OneVsAll	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E9%80%BB%E8%BE%91%E5%9B%9E%E5%BD%92_%E6%89%8B%E5%86%99%E6%95%B0%E5%AD%97%E8%AF%86%E5%88%AB_onevsall
1、随机显示100个数字	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E9%9A%8F%E6%9C%BA%E6%98%BE%E7%A4%BA100%E4%B8%AA%E6%95%B0%E5%AD%97
2、OneVsAll	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-onevsall
3、手写数字识别	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E6%89%8B%E5%86%99%E6%95%B0%E5%AD%97%E8%AF%86%E5%88%AB
4、预测	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E9%A2%84%E6%B5%8B
5、运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
6、使用scikit-learn库中的逻辑回归模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E4%BD%BF%E7%94%A8scikit-learn%E5%BA%93%E4%B8%AD%E7%9A%84%E9%80%BB%E8%BE%91%E5%9B%9E%E5%BD%92%E6%A8%A1%E5%9E%8B%E5%AE%9E%E7%8E%B0
三、BP神经网络	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E4%B8%89-bp%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C
1、神经网络model	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9Cmodel
2、代价函数	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-%E4%BB%A3%E4%BB%B7%E5%87%BD%E6%95%B0
3、正则化	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E6%AD%A3%E5%88%99%E5%8C%96
4、反向传播BP	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E5%8F%8D%E5%90%91%E4%BC%A0%E6%92%ADbp
5、BP可以求梯度的原因	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-bp%E5%8F%AF%E4%BB%A5%E6%B1%82%E6%A2%AF%E5%BA%A6%E7%9A%84%E5%8E%9F%E5%9B%A0
6、梯度检查	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E6%A2%AF%E5%BA%A6%E6%A3%80%E6%9F%A5
7、权重的随机初始化	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7-%E6%9D%83%E9%87%8D%E7%9A%84%E9%9A%8F%E6%9C%BA%E5%88%9D%E5%A7%8B%E5%8C%96
8、预测	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8-%E9%A2%84%E6%B5%8B
9、输出结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#9-%E8%BE%93%E5%87%BA%E7%BB%93%E6%9E%9C
四、SVM支持向量机	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E5%9B%9B-svm%E6%94%AF%E6%8C%81%E5%90%91%E9%87%8F%E6%9C%BA
1、代价函数	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E4%BB%A3%E4%BB%B7%E5%87%BD%E6%95%B0
2、Large Margin	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-large-margin
3、SVM Kernel（核函数）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-svm-kernel%E6%A0%B8%E5%87%BD%E6%95%B0
4、使用中的模型代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E4%BD%BF%E7%94%A8%E4%B8%AD%E7%9A%84%E6%A8%A1%E5%9E%8B%E4%BB%A3%E7%A0%81
5、运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
五、K-Means聚类算法	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E4%BA%94-k-means%E8%81%9A%E7%B1%BB%E7%AE%97%E6%B3%95
1、聚类过程	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E8%81%9A%E7%B1%BB%E8%BF%87%E7%A8%8B
2、目标函数	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-%E7%9B%AE%E6%A0%87%E5%87%BD%E6%95%B0
3、聚类中心的选择	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E8%81%9A%E7%B1%BB%E4%B8%AD%E5%BF%83%E7%9A%84%E9%80%89%E6%8B%A9
4、聚类个数K的选择	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E8%81%9A%E7%B1%BB%E4%B8%AA%E6%95%B0k%E7%9A%84%E9%80%89%E6%8B%A9
5、应用——图片压缩	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E5%BA%94%E7%94%A8%E5%9B%BE%E7%89%87%E5%8E%8B%E7%BC%A9
6、使用scikit-learn库中的线性模型实现聚类	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E4%BD%BF%E7%94%A8scikit-learn%E5%BA%93%E4%B8%AD%E7%9A%84%E7%BA%BF%E6%80%A7%E6%A8%A1%E5%9E%8B%E5%AE%9E%E7%8E%B0%E8%81%9A%E7%B1%BB
7、运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7-%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
六、PCA主成分分析（降维）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E5%85%AD-pca%E4%B8%BB%E6%88%90%E5%88%86%E5%88%86%E6%9E%90%E9%99%8D%E7%BB%B4
1、用处	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E7%94%A8%E5%A4%84
2、2D-->1D，nD-->kD	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-2d-1dnd-kd
3、主成分分析PCA与线性回归的区别	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E4%B8%BB%E6%88%90%E5%88%86%E5%88%86%E6%9E%90pca%E4%B8%8E%E7%BA%BF%E6%80%A7%E5%9B%9E%E5%BD%92%E7%9A%84%E5%8C%BA%E5%88%AB
4、PCA降维过程	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-pca%E9%99%8D%E7%BB%B4%E8%BF%87%E7%A8%8B
5、数据恢复	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E6%95%B0%E6%8D%AE%E6%81%A2%E5%A4%8D
6、主成分个数的选择（即要降的维度）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E4%B8%BB%E6%88%90%E5%88%86%E4%B8%AA%E6%95%B0%E7%9A%84%E9%80%89%E6%8B%A9%E5%8D%B3%E8%A6%81%E9%99%8D%E7%9A%84%E7%BB%B4%E5%BA%A6
7、使用建议	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7-%E4%BD%BF%E7%94%A8%E5%BB%BA%E8%AE%AE
8、运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8-%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
9、使用scikit-learn库中的PCA实现降维	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#9-%E4%BD%BF%E7%94%A8scikit-learn%E5%BA%93%E4%B8%AD%E7%9A%84pca%E5%AE%9E%E7%8E%B0%E9%99%8D%E7%BB%B4
七、异常检测 Anomaly Detection	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#%E4%B8%83-%E5%BC%82%E5%B8%B8%E6%A3%80%E6%B5%8B-anomaly-detection
1、高斯分布（正态分布）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1-%E9%AB%98%E6%96%AF%E5%88%86%E5%B8%83%E6%AD%A3%E6%80%81%E5%88%86%E5%B8%83
2、异常检测算法	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2-%E5%BC%82%E5%B8%B8%E6%A3%80%E6%B5%8B%E7%AE%97%E6%B3%95
3、评价的好坏，以及的选取	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3-%E8%AF%84%E4%BB%B7%E7%9A%84%E5%A5%BD%E5%9D%8F%E4%BB%A5%E5%8F%8A%E7%9A%84%E9%80%89%E5%8F%96
4、选择使用什么样的feature（单元高斯分布）	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4-%E9%80%89%E6%8B%A9%E4%BD%BF%E7%94%A8%E4%BB%80%E4%B9%88%E6%A0%B7%E7%9A%84feature%E5%8D%95%E5%85%83%E9%AB%98%E6%96%AF%E5%88%86%E5%B8%83
5、多元高斯分布	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5-%E5%A4%9A%E5%85%83%E9%AB%98%E6%96%AF%E5%88%86%E5%B8%83
6、单元和多元高斯分布特点	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6-%E5%8D%95%E5%85%83%E5%92%8C%E5%A4%9A%E5%85%83%E9%AB%98%E6%96%AF%E5%88%86%E5%B8%83%E7%89%B9%E7%82%B9
7、程序运行结果	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7-%E7%A8%8B%E5%BA%8F%E8%BF%90%E8%A1%8C%E7%BB%93%E6%9E%9C
线性回归	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LinearRegression
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#一线性回归
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LinearRegression/LinearRegression.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1代价函数
	https://camo.githubusercontent.com/4c31a90ef7d5a94b36a26f6ca594cbd95a4d9893b419cc30d3b86092d2ba3e04/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a2532382535437468657461253230253239253230253344253230253543667261632537423125374425374225374232253742253543746578742537426d25374425374425374425374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253742253742253238253742685f253543746865746125323025374425323825374278253545253742253238692532392537442537442532392532302d253230253742792535452537422532386925323925374425374425323925374425354532253744253744253230
	https://camo.githubusercontent.com/0eb6fa9e71155c6608019f7c11202c1aa1bc9f4a903915992451595c5fb81844/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742685f25354374686574612532302537442532387825323925323025334425323025374225354374686574612532305f3025374425323025324225323025374225354374686574612532305f31253744253742785f3125374425323025324225323025374225354374686574612532305f32253744253742785f322537442532302532422532302e2e2e
	https://camo.githubusercontent.com/57f1522524cbdab28ea2d7b064b37ab6dfd3880121571dc150a8526ecfdf8fba/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742253742253238253742685f253543746865746125323025374425323825374278253545253742253238692532392537442537442532392532302d253230253742792535452537422532386925323925374425374425323925374425354532253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2梯度下降算法
	https://camo.githubusercontent.com/b02007afc938ffd408a4a8bee48428c7bc0b32b179f48e91dc0344f99d26d333/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225374225354374686574612532305f6a253744253744
	https://camo.githubusercontent.com/b4c704104dbc22b23f487f159ef20f29a99de6214668e0f428609a7901a4af9c/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543667261632537422537422535437061727469616c2532304a25323825354374686574612532302532392537442537442537422537422535437061727469616c25323025374225354374686574612532305f6a25374425374425374425323025334425323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253542253238253742685f253543746865746125323025374425323825374278253545253742253238692532392537442537442532392532302d2532302537427925354525374225323869253239253744253744253239785f6a25354525374225323869253239253744253544253744253230
	https://camo.githubusercontent.com/d8e21e3b492667ba66ef67943cc24bc32a4691399e333c96165f905ff2345e9a/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354374686574612532305f6a25374425323025334425323025374225354374686574612532305f6a2537442532302d253230253543616c70686125323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253542253238253742685f253543746865746125323025374425323825374278253545253742253238692532392537442537442532392532302d2532302537427925354525374225323869253239253744253744253239785f6a25354525374225323869253239253744253544253744253230
	https://camo.githubusercontent.com/e017c2de88067341fb5630fc1163322cee3bfa4d2e10666b503bd0148898c917/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543616c706861253230
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3均值归一化
	https://camo.githubusercontent.com/97cd58e6c475b3b6e74f9d8e3dbd5c876efb14c656a583c30bc776356db83359/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742785f6925374425323025334425323025354366726163253742253742253742785f692537442532302d2532302537422535436d752532305f69253744253744253744253742253742253742735f69253744253744253744
	https://camo.githubusercontent.com/9cf2ac7beeb1e05ea3e09aadff2216d363c4d6aba66ff3cc2c8f7f117c24f3ba/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537422537422535436d752532305f69253744253744
	https://camo.githubusercontent.com/c9c7eb2a377c0a4616a6d130895731a14105f28c1e1a10d83840d7a758d4634a/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742735f69253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4最终运行结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LinearRegression_01.png
使用scikit-learn库中的线性模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LinearRegression/LinearRegression_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5使用scikit-learn库中的线性模型实现
逻辑回归	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#二逻辑回归
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression/LogisticRegression.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1代价函数-1
	https://camo.githubusercontent.com/3ba25d174662bc6f4f490e41436b42a6ff383430b3267ce0d5cc1905e6c86bac/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532302535436c656674253543253742253230253543626567696e25374267617468657265642537442532304a253238253543746865746125323025323925323025334425323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253543636f7325323074253238253742685f2535437468657461253230253744253238253742782535452537422532386925323925374425374425323925324325374279253545253742253238692532392537442537442532392537442532302535436866696c6c253230253543253543253230253543636f7325323074253238253742685f253543746865746125323025374425323878253239253243792532392532302533442532302535436c656674253543253742253230253742253543626567696e2537426172726179253744253742632537442532302537422532302d2532302535436c6f67253230253238253742685f2535437468657461253230253744253238782532392532392537442532302535432535432532302537422532302d2532302535436c6f67253230253238312532302d253230253742685f253543746865746125323025374425323878253239253239253744253230253543656e642537426172726179253744253230253543626567696e25374261727261792537442537426325374425323025374279253230253344253230312537442532302535432535432532302537427925323025334425323030253744253230253543656e64253742617272617925374425323025374425323025354372696768742e2532302535436866696c6c253230253543253543253230253543656e64253742676174686572656425374425323025354372696768742e
	https://camo.githubusercontent.com/04906df7515891bfc89814d3d5c03430ade17373c1c460c86d9665ead608dfd9/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532302532302d25323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225354225374279253545253742253238692532392537442537442535436c6f67253230253238253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253230253242253230253238312532302d25323025374425323025374279253545253742253238692532392537442537442532392535436c6f67253230253238312532302d253230253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253544
	https://camo.githubusercontent.com/2ce4f65e4f7a92390367fe2783a322cfe14cc4ae4617ed4ffd58d5647e071594/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742685f253543746865746125323025374425323878253239253230253344253230253543667261632537423125374425374225374231253230253242253230253742652535452537422532302d25323078253744253744253744253744
	https://camo.githubusercontent.com/17d4d18b2575cfc08f228c765aa6a0e5b39f79ee34a3df1c5cc58e13a7d15bf5/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537422532302d2532302535436c6f67253230253238253742685f253543746865746125323025374425323878253239253239253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_01.png
	https://camo.githubusercontent.com/553e837c6635683f520d7e824445d1daae62ad56e3cf8a832253d92a0522fba7/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742685f253543746865746125323025374425323878253239253744
	https://camo.githubusercontent.com/553e837c6635683f520d7e824445d1daae62ad56e3cf8a832253d92a0522fba7/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742685f253543746865746125323025374425323878253239253744
	https://camo.githubusercontent.com/c537da7aea9f66b31a8c479ffa964f051cd683b4115716d84937037a41e76540/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537422532302d2532302535436c6f67253230253238312532302d253230253742685f253543746865746125323025374425323878253239253239253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_02.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2梯度
	https://camo.githubusercontent.com/b4c704104dbc22b23f487f159ef20f29a99de6214668e0f428609a7901a4af9c/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543667261632537422537422535437061727469616c2532304a25323825354374686574612532302532392537442537442537422537422535437061727469616c25323025374225354374686574612532305f6a25374425374425374425323025334425323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253542253238253742685f253543746865746125323025374425323825374278253545253742253238692532392537442537442532392532302d2532302537427925354525374225323869253239253744253744253239785f6a25354525374225323869253239253744253544253744253230
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_03.jpg
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3正则化
	https://camo.githubusercontent.com/b8584d987717f64f58a44a61e437e0af63a13c6a3bc7511d7b56b9f118b0b938/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532302532302d25323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225354225374279253545253742253238692532392537442537442535436c6f67253230253238253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253230253242253230253238312532302d25323025374425323025374279253545253742253238692532392537442537442532392535436c6f67253230253238312532302d253230253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253544253230253242253230253543667261632537422535436c616d626461253230253744253742253742326d25374425374425354373756d2535436c696d6974735f2537426a253230253344253230312537442535456e25323025374225354374686574612532305f6a25354532253744253230
	https://camo.githubusercontent.com/553e837c6635683f520d7e824445d1daae62ad56e3cf8a832253d92a0522fba7/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742685f253543746865746125323025374425323878253239253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4s型函数即
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5映射为多项式
	https://camo.githubusercontent.com/c13817ab54a19a19c1d5ab73af10fd7e059ddf150f07af5d90bd8c6f66bfb656/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d31253230253242253230253742785f31253744253230253242253230253742785f32253744253230253242253230785f3125354532253230253242253230253742785f31253744253742785f32253744253230253242253230785f3225354532
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6使用scipy的优化方法
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7运行结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_04.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_06.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_07.png
使用scikit-learn库中的逻辑回归模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression/LogisticRegression_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8使用scikit-learn库中的逻辑回归模型实现
逻辑回归_手写数字识别_OneVsAll	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#逻辑回归_手写数字识别_onevsall
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression/LogisticRegression_OneVsAll.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1随机显示100个数字
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_08.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_09.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2onevsall
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_11.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3手写数字识别
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_10.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4预测
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5运行结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_12.png
使用scikit-learn库中的逻辑回归模型实现	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/LogisticRegression/LogisticRegression_OneVsAll_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6使用scikit-learn库中的逻辑回归模型实现
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/LogisticRegression_13.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#三bp神经网络
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/NeuralNetwok/NeuralNetwork.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1神经网络model
	https://camo.githubusercontent.com/1aed011979975984fe5b92a7a229020181009df9a9c1bed06eefd00fe5b81254/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742785f30253744
	https://camo.githubusercontent.com/c6932dcdcfb0a3083de1bc71c8252184d7647b3079c93f6311ce325d09ca11ff/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d615f692535452537422532386a253239253744
	https://camo.githubusercontent.com/a473a5ff8491bf78c70b4d5cc85f1f830ddabe9bd2941660ef2af968f094fb56/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354374686574612532302535452537422532386a253239253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_01.png
	https://camo.githubusercontent.com/aef9b845aaaf8599b0c9642baef91331974adddc078f5f8213ac46070d8e6566/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d615f31253545253742253238322532392537442532302533442532306725323825354374686574612532305f253742313025374425354525374225323831253239253744253742785f3025374425323025324225323025354374686574612532305f253742313125374425354525374225323831253239253744253742785f3125374425323025324225323025354374686574612532305f253742313225374425354525374225323831253239253744253742785f3225374425323025324225323025354374686574612532305f253742313325374425354525374225323831253239253744253742785f33253744253239
	https://camo.githubusercontent.com/eae232027694b14120c16f8c8959b47949cdcb76a4b24de3398e42fbf93bbf92/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d615f32253545253742253238322532392537442532302533442532306725323825354374686574612532305f253742323025374425354525374225323831253239253744253742785f3025374425323025324225323025354374686574612532305f253742323125374425354525374225323831253239253744253742785f3125374425323025324225323025354374686574612532305f253742323225374425354525374225323831253239253744253742785f3225374425323025324225323025354374686574612532305f253742323325374425354525374225323831253239253744253742785f33253744253239
	https://camo.githubusercontent.com/a5673b2e1bc3da4ee144538353ff369df95f644839610038c59418cc40e9383b/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d615f33253545253742253238322532392537442532302533442532306725323825354374686574612532305f253742333025374425354525374225323831253239253744253742785f3025374425323025324225323025354374686574612532305f253742333125374425354525374225323831253239253744253742785f3125374425323025324225323025354374686574612532305f253742333225374425354525374225323831253239253744253742785f3225374425323025324225323025354374686574612532305f253742333325374425354525374225323831253239253744253742785f33253744253239
	https://camo.githubusercontent.com/8891b3f6c279cdb9bd398c2bfdeaf0023916d0e6e74f00518359b1535db55e0a/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742685f253543746865746125323025374425323878253239253230253344253230615f31253545253742253238332532392537442532302533442532306725323825354374686574612532305f253742313025374425354525374225323832253239253744615f302535452537422532383225323925374425323025324225323025354374686574612532305f253742313125374425354525374225323832253239253744615f312535452537422532383225323925374425323025324225323025354374686574612532305f253742313225374425354525374225323832253239253744615f322535452537422532383225323925374425323025324225323025354374686574612532305f253742313325374425354525374225323832253239253744615f3325354525374225323832253239253744253239
	https://camo.githubusercontent.com/e2321422e0cf2a9421b6156f76b561b53464891686b40ff75323e340696ac088/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d672532387a253239253230253344253230253543667261632537423125374425374225374231253230253242253230253742652535452537422532302d2532307a253744253744253744253744
	https://camo.githubusercontent.com/de0300a7e4b3a9bad2caa70c4e2ac65b613dfa7041c1be8121af7568aa4ee8b5/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253543746865746125323025354525374225323831253239253744253744
	https://camo.githubusercontent.com/526d4578da84af99359938e018fd727fb9c73ad9843d22a599bf2bf00bad54c7/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253543746865746125323025354525374225323832253239253744253744
	https://camo.githubusercontent.com/a473a5ff8491bf78c70b4d5cc85f1f830ddabe9bd2941660ef2af968f094fb56/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354374686574612532302535452537422532386a253239253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2代价函数
	https://camo.githubusercontent.com/98f3b32149642b9264b66d55a8c4ff42252990e5d245adf2e51178935e6d589d/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742685f253543546865746125323025374425323878253239253230253543696e253230253742522535454b253744
	https://camo.githubusercontent.com/14dd444b52edb3bcfa21095081ac344d2b1d5ccef0a8ff2f8d78c48aa93cba6c/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354354686574612532302532392532302533442532302532302d25323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225354373756d2535436c696d6974735f2537426b253230253344253230312537442535454b253230253742253542795f6b253545253742253238692532392537442535436c6f67253230253742253742253238253742685f253543546865746125323025374425323825374278253545253742253238692532392537442537442532392532392537445f6b253744253744253230253744253230253230253242253230253238312532302d253230795f6b253545253742253238692532392537442532392535436c6f67253230253742253238312532302d253230253742685f253543546865746125323025374425323825374278253545253742253238692532392537442537442532392532395f6b253744253544
	https://camo.githubusercontent.com/0985d73d20aa266f65ac85815ee08cd9e53b5457c896d6f31904a6f23792dc8b/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253238253742685f2535435468657461253230253744253238782532392532395f69253744
	https://camo.githubusercontent.com/04906df7515891bfc89814d3d5c03430ade17373c1c460c86d9665ead608dfd9/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532302532302d25323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225354225374279253545253742253238692532392537442537442535436c6f67253230253238253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253230253242253230253238312532302d25323025374425323025374279253545253742253238692532392537442537442532392535436c6f67253230253238312532302d253230253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253544
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3正则化-1
	https://camo.githubusercontent.com/d3b4fb3a241e8c20bf1b253739e5af705126e41c8ef428ea72f76b34884de3a5/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742535f6c253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_02.png
	https://camo.githubusercontent.com/e9616fa445b578e957ca1613a0b0b1dd8e5ca54f94c3978314c96755042c0a9c/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2535437468657461253230
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4反向传播bp
	https://camo.githubusercontent.com/71e63bdc7ced136e3354ec623e4532cf4d5b93643805d3dec0aa0dd1649483aa/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354364656c74612532305f253742253543746578742537426a2537442537442535452537422532386c253239253744
	https://camo.githubusercontent.com/3fb62aed13f6746db2fd293346ddd9ffdbe0f062f00636272673c8588339b3b6/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354364656c74612532305f253742253543746578742537426a25374425374425354525374225323834253239253744253230253344253230615f6a253545253742253238342532392537442532302d253230253742795f69253744
	https://camo.githubusercontent.com/caf1b2db8746f3c5bfa38357b8ee7f42914d01ad5ed536061dd8c12897c7aa07/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c74612532302535452537422532383425323925374425374425323025334425323025374261253545253742253238342532392537442537442532302d25323079
	https://camo.githubusercontent.com/4e88e7e7e14b8046fb57c65cfbf75988cbdae701ce6b065f9c921c5ab639ad54/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c7461253230253545253742253238332532392537442537442532302533442532302537422532382537422535437468657461253230253545253742253238332532392537442537442532392535455425374425374225354364656c7461253230253545253742253238342532392537442537442e253241253742672535452537442532382537426125354525374225323833253239253744253744253239
	https://camo.githubusercontent.com/fdf112ce888bb63dbd3eb8de689b3b245a0ad4d9df0978f4184c00f299d5d372/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c7461253230253545253742253238322532392537442537442532302533442532302537422532382537422535437468657461253230253545253742253238322532392537442537442532392535455425374425374225354364656c7461253230253545253742253238332532392537442537442e253241253742672535452537442532382537426125354525374225323832253239253744253744253239
	https://camo.githubusercontent.com/e9aba68b2db1fb922d1116e425c0e056cdbffe347a07e4906264f0a70a0e793e/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c746125323025354525374225323831253239253744253744
	https://camo.githubusercontent.com/0bae9a1fa79c8f89522f4f5644c36dc5339d4b905baeeac4d7964c9c01ec200d/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354374657874253742672532387a253239253744253744
	https://camo.githubusercontent.com/a964c44ec184949fe0053347033781c572dd83f88541f020a80414ae707840cf/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742672535452537442532387a25323925374225354374657874253742253230253344253230672532387a253239253238312532302d253230672532387a253239253239253744253744
	https://camo.githubusercontent.com/44e6cfc7cf8f205c2b637b20e6166ffcb9ac96fbca8d11e16c78fff62b26d9a1/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742672535452537442532382537426125354525374225323833253239253744253744253239
	https://camo.githubusercontent.com/9407fbe726927ed99232337fdb13af11e9a918d4e44f90d2adf87d6acf02313a/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742672535452537442532382537426125354525374225323832253239253744253744253239
	https://camo.githubusercontent.com/b2123442c4c84c51efb331191b5b649ce88ba40cdd41a3bd48a99114bf38edfb/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354344656c74612532305f253742696a2537442535452537422532386c25323925374425323025334425323030
	https://camo.githubusercontent.com/3865d4e00130f1feb04ce742c46875aebbaac8a4cc561dbc7fda5e705696cb37/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354344656c7461253230
	https://camo.githubusercontent.com/9720b550a46cac6a533e7279c82b988480c59fa964d3c8c224318c3a31611a64/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354364656c7461253230
	https://camo.githubusercontent.com/e2bed8b780290a452a32dc3fca192c5f6220ac530ca291f261bec4abc0d8a881/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374261253545253742253238312532392537442537442532302533442532302537427825354525374225323869253239253744253744
	https://camo.githubusercontent.com/ab3f56613fea9fe08f330f5bc16549d1554565045a36465f7d803e30d8d05c94/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742612535452537422532386c253239253744253744
	https://camo.githubusercontent.com/0ba22dd10a611f670684f88319d6d975e3879441a39a266b757a4eeb33debd92/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c74612532302535452537422532384c253239253744253744
	https://camo.githubusercontent.com/03b988b03104b166a172c9310da6e056dc99c6147c4c0db3d02ab1a8e5377756/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c74612532302535452537422532384c2532302d25323031253239253744253744
	https://camo.githubusercontent.com/028616873e839cf0a52c9da0bbbd9bddc40f81b1a95d4e725dd734a2ca0aa4d8/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374225354364656c746125323025354525374225323832253239253744253744
	https://camo.githubusercontent.com/d1cf504a6c2efb0dbaafcff817f4667d803f0afb9a76c9313175410d231415ed/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354344656c74612532305f253742696a2537442535452537422532386c25323925374425323025334425323025354344656c74612532305f253742696a2537442535452537422532386c253239253744253230253242253230615f6a2535452537422532386c25323925374425374225354364656c74612532302535452537422532386c25323025324225323031253239253744253744
	https://camo.githubusercontent.com/82d94226a36c65f429d3f040060c2cbc70a1b6dee9f6477bd69bae4e28e393b1/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d445f253742696a2537442535452537422532386c25323925374425323025334425323025354366726163253742312537442537426d25374425354344656c74612532305f253742696a2537442535452537422532386c2532392537442532302532422532302535436c616d62646125323025354374686574612532305f253742696a2537442535456c253543626567696e2537426172726179253744253742632537442532302532302532302532302537422537442532362532302537422532386a2532302535436e6525323030253239253744253230253230253543656e642537426172726179253744253230
	https://camo.githubusercontent.com/cc94e7a5ef0e68313b88405457d8763c6f5cd4f329bbb6db7f9b379784a47f82/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d445f253742696a2537442535452537422532386c25323925374425323025334425323025354366726163253742312537442537426d25374425354344656c74612532305f253742696a2537442535452537422532386c2532392537442532302532422532302535436c616d62646125323025354374686574612532305f253742696a2537442535456c6a25323025334425323030253543626567696e2537426172726179253744253742632537442532302532302532302532302537422537442532362532302537426a25323025334425323030253744253230253230253543656e642537426172726179253744253230
	https://camo.githubusercontent.com/5ed51b9db0d20b277a16da42c6955986d2bbff74048bd16d9758a9b4ce8c63c3/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543667261632537422537422535437061727469616c2532304a25323825354354686574612532302532392537442537442537422537422535437061727469616c25323025354354686574612532305f253742696a2537442535452537422532386c253239253744253744253744253230253344253230445f253742696a2537442535452537422532386c253239253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5bp可以求梯度的原因
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_03.jpg
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_04.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6梯度检查
	https://camo.githubusercontent.com/dd93629946f8969ee1398fe71b925e5a6e2ebdc38ea6542baf07e2f3b150f8e6/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354366726163253742253742644a2532382535437468657461253230253239253744253744253742253742642535437468657461253230253744253744253230253543617070726f78253230253543667261632537422537424a2532382535437468657461253230253230253242253230253543766172657073696c6f6e2532302532392532302d2532304a25323825354374686574612532302532302d253230253543766172657073696c6f6e25323025323925374425374425374225374232253543766172657073696c6f6e253230253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7权重的随机初始化
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8预测
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#9输出结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_06.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_07.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_08.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/NeuralNetwork_09.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#四svm支持向量机
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1代价函数-2
	https://camo.githubusercontent.com/4745d633b096aa3ed7757f97caff57312d757edc46045adbc063a97ae2108fe9/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543636f7325323074253238253742685f253543746865746125323025374425323878253239253243792532392532302533442532302535436c656674253543253742253230253742253543626567696e2537426172726179253744253742632537442532302532302532302532302537422532302d2532302535436c6f67253230253238253742685f2535437468657461253230253744253238782532392532392537442532302535432535432532302532302532302532302537422532302d2532302535436c6f67253230253238312532302d253230253742685f253543746865746125323025374425323878253239253239253744253230253230253543656e642537426172726179253744253230253543626567696e25374261727261792537442537426325374425323025323025323025323025374279253230253344253230312537442532302535432535432532302532302532302532302537427925323025334425323030253744253230253230253543656e64253742617272617925374425323025374425323025354372696768742e
	https://camo.githubusercontent.com/1eaada2cd842f22f5d6cd5588d6e01ef903b917baf1fd654a52f74c211234840/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742685f2535437468657461253230253744253238253742253543746578742537427a253744253744253239253230253344253230253543667261632537423125374425374225374231253230253242253230253742652535452537422532302d2532307a253744253744253744253744
	https://camo.githubusercontent.com/f808bbe806b856509708b8e969eb797764bc555f5ab8346a51a630731cd6fef4/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d7a25323025334425323025374225354374686574612532302535455425374478
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_01.png
	https://camo.githubusercontent.com/9ac297455ab2ad8eb973f2217bbddee3f52d390b087fdb8171779ec7e1476b61/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537422535437468657461253230253545542537447825323025334525323025323025334525323030
	https://camo.githubusercontent.com/d6c3bedee61ecec7a0a159ac66dbadecdbf9d33af0f825786b77e948b03ce7b4/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543636f73253230253742745f312537442532387a253239
	https://camo.githubusercontent.com/0b053833c65bd2248aab3d4de8c5d681da3d8e8d2ef2cb08900d7c53f604aca0/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253543636f73253230253742745f302537442532387a253239
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_02.png
	https://camo.githubusercontent.com/473d1b60f39b093ddb54e9139de1d26f2223e2a554da1e7a8fc513905c4f4f2c/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532304325354373756d2535436c696d6974735f25374269253230253344253230312537442535456d2532302537422535422537427925354525374225323869253239253744253744253543636f73253230253742745f312537442532382537422535437468657461253230253545542537442537427825354525374225323869253239253744253744253239253230253242253230253238312532302d2532302537427925354525374225323869253239253744253744253239253543636f73253230253742745f30253744253238253742253543746865746125323025354554253744253742782535452537422532386925323925374425374425323925374425323025354425323025324225323025354366726163253742312537442537423225374425354373756d2535436c696d6974735f2537426a25323025334425323031253744253545253742253543746578742537426e25374425374425323025374225354374686574612532305f6a25354532253744253230
	https://camo.githubusercontent.com/f776ce019b0df28f7a3ae9d563b59a2a1da604493ff3a226dcc883e5c045631e/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532302535436d6174686f702532302537422535436d696e2532302537442535436c696d6974735f25354374686574612532304a2532382535437468657461253230253239
	https://camo.githubusercontent.com/b8584d987717f64f58a44a61e437e0af63a13c6a3bc7511d7b56b9f118b0b938/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532302532302d25323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225354225374279253545253742253238692532392537442537442535436c6f67253230253238253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253230253242253230253238312532302d25323025374425323025374279253545253742253238692532392537442537442532392535436c6f67253230253238312532302d253230253742685f25354374686574612532302537442532382537427825354525374225323869253239253744253744253239253544253230253242253230253543667261632537422535436c616d626461253230253744253742253742326d25374425374425354373756d2535436c696d6974735f2537426a253230253344253230312537442535456e25323025374225354374686574612532305f6a25354532253744253230
	https://camo.githubusercontent.com/50a73a509f01a4274c62571085d2ecff15c53fbace7fe641d356d89f5c24e13e/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d43253230253344253230253543667261632537426d2537442537422535436c616d626461253230253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2large-margin
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_03.png
	https://camo.githubusercontent.com/2e4c2ceca75aa0af8af74b3a62f003a8c5a63de06045dd4bbf930e5201c43176/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d752532302533442532302535436c656674253542253230253742253543626567696e253742617272617925374425374263253744253230253230253230253230253742253742755f31253744253744253230253543253543253230253230253230253230253742253742755f32253744253744253230253230253543656e6425374261727261792537442532302537442532302535437269676874253544
	https://camo.githubusercontent.com/7feaedfa48e24397b6b89845f445d72ec63e8d928a7793959daf9206f3d32bb3/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d762532302533442532302535436c656674253542253230253742253543626567696e253742617272617925374425374263253744253230253230253230253230253742253742765f31253744253744253230253543253543253230253230253230253230253742253742765f32253744253744253230253230253543656e6425374261727261792537442532302537442532302535437269676874253544
	https://camo.githubusercontent.com/552de3c234fedd5a64e5884ace8b3d4206a1e30b738159255100ecdd5cd32234/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374325374375253743253743
	https://camo.githubusercontent.com/a5fddc1e7c4b583e8f20d229ddec618f855f6c8d8a06c50ba2a30d0c81541419/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25374325374375253743253743253742253543746578742537422532302533442532302537442537442535437371727425323025374225374225354374657874253742752537442537445f3125354532253230253242253230755f3225354532253744253230
	https://camo.githubusercontent.com/659c09e5c271b0274f650e7131421653f4423fad03b5a86be156dd4720abe514/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742253742253543746578742537427525374425374425354554253744762532302533442532307025374325374375253743253743253230253344253230253742755f31253744253742765f31253744253230253242253230253742755f32253744253742765f32253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_04.png
	https://camo.githubusercontent.com/ca8ee3104936bbce3e48b5ef117ef8d5bea3765d9662b8db45d1a3a61fbac69e/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c61726765253230253543636f732532302535437468657461253230253344253230253543667261632537422537422535436f76657272696768746172726f7725323025374225354374657874253742752537442537442532302535436f76657272696768746172726f77253230762532302537442537442537422537422537432535436f76657272696768746172726f7725323025374225354374657874253742752537442537442532302537432537432535436f76657272696768746172726f7725323076253230253743253744253744
	https://camo.githubusercontent.com/afa4ee4af7fb221f2e49273636440425de3593e3b902b2202a06328db7c7ffd1/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25354373756d2535436c696d6974735f25374269253230253344253230312537442535456d2532302537422535422537427925354525374225323869253239253744253744253543636f73253230253742745f312537442532382537422535437468657461253230253545542537442537427825354525374225323869253239253744253744253239253230253242253230253238312532302d2532302537427925354525374225323869253239253744253744253239253543636f73253230253742745f302537442532382537422535437468657461253230253545542537442537427825354525374225323869253239253744253744253239253744253230253544
	https://camo.githubusercontent.com/378780d76ff41a41dc791d4509742fcc7b126f28faa08edad9eb677e66ae1026/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532304a253238253543746865746125323025323925323025334425323043302532302b25323025354366726163253742312537442537423225374425354373756d2535436c696d6974735f2537426a25323025334425323031253744253545253742253543746578742537426e25374425374425323025374225354374686574612532305f6a2535453225374425323025334425323025354366726163253742312537442537423225374425354373756d2535436c696d6974735f2537426a25323025334425323031253744253545253742253543746578742537426e25374425374425323025374225354374686574612532305f6a2535453225374425323025334425323025354366726163253742312537442537423225374425323825354374686574612532305f31253545322532302b25323025354374686574612532305f32253545322532392532302533442532302535436672616325374231253744253742322537442537422535437371727425323025374225354374686574612532305f31253545322532302b25323025354374686574612532305f322535453225374425323025354532253744
	https://camo.githubusercontent.com/d24b8cdfe47ddbd38320cab16c3f010673eadb9d9d12db110318b9037d0b111c/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532302535436c656674253543253742253230253742253543626567696e2537426172726179253744253742632537442532302537422537422535437468657461253230253545542537442537427825354525374225323869253239253744253744253230253543676571736c616e742532303125374425323025354325354325323025374225374225354374686574612532302535455425374425374278253545253742253238692532392537442537442532302535436c6571736c616e742532302d25323031253744253230253543656e64253742617272617925374425323025374425323025354372696768742e253543626567696e253742617272617925374425374263253744253230253742253238253742792535452537422532386925323925374425374425323025334425323031253239253744253230253543253543253230253742253238253742792535452537422532386925323925374425374425323025334425323030253239253744253230253543656e642537426172726179253744
	https://camo.githubusercontent.com/8b1db4bd9f0360a36faa16c8a031195487536d45b74b569b844c1526ac790a34/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532302535436c656674253543253742253230253742253543626567696e25374261727261792537442537426325374425323025374225374270253545253742253238692532392537442537442537432537432535437468657461253230253743253743253230253543676571736c616e7425323031253744253230253543253543253230253742253742702535452537422532386925323925374425374425374325374325354374686574612532302537432537432532302535436c6571736c616e742532302d25323031253744253230253543656e64253742617272617925374425323025374425323025354372696768742e253543626567696e253742617272617925374425374263253744253230253742253238253742792535452537422532386925323925374425374425323025334425323031253239253744253230253543253543253230253742253238253742792535452537422532386925323925374425374425323025334425323030253239253744253230253543656e642537426172726179253744
	https://camo.githubusercontent.com/fd6cfc13bd912680a104fad390a7b1fca4899bed957886080e56ff3d7744d12c/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c61726765253230702537432537432535437468657461253230253743253743253230253543676571736c616e7425323031
	https://camo.githubusercontent.com/8461ecabe7ff3bafb6df276cb56afd1104a29084533c69bbcd1fc85cfa87b1e4/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c617267652532307025374325374325354374686574612532302537432537432532302535436c6571736c616e742532302d25323031
	https://camo.githubusercontent.com/ec571d94a5febff0c3f8f0dbe53ceb9395ba817bdd0520bb5ab24a0ae42d2853/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537432537432535437468657461253230253743253743
	https://camo.githubusercontent.com/67469dbdcfaa663b73a0e1c525e7a7a433ecf3f81ca6409d88d2e851fe494eac/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c6172676525323025374325374325354374686574612532302537432537432532302533442532302535436672616325374231253744253742322537442535437371727425323025374225354374686574612532305f31253545322532302b25323025354374686574612532305f3225354532253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3svm-kernel核函数
	https://camo.githubusercontent.com/c13817ab54a19a19c1d5ab73af10fd7e059ddf150f07af5d90bd8c6f66bfb656/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d31253230253242253230253742785f31253744253230253242253230253742785f32253744253230253242253230785f3125354532253230253242253230253742785f31253744253742785f32253744253230253242253230785f3225354532
	https://camo.githubusercontent.com/e735343b1ab0372041fa0af54053f19583f8ff0d252ff15e29eb944469f6d9d9/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d6625323878253239253230253344253230253742652535452537422532302d25323025354366726163253742253742253743253743782532302d2532307525374325374225374325354532253744253744253744253742253742322537422535437369676d6125323025354532253744253744253744253744253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_06.png
	https://camo.githubusercontent.com/b2d4f8759eb6ea2a2893300cf04ed8ef6f49569d4054709a5af012469a5fc5ac/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742665f3125374425323025334425323073696d696c6172697479253238782532432537426c25354525374225323831253239253744253744253239253230253344253230253742652535452537422532302d25323025354366726163253742253742253743253743782532302d2532302537426c2535452537422532383125323925374425374425374325374225374325354532253744253744253744253742253742322537422535437369676d6125323025354532253744253744253744253744253744
	https://camo.githubusercontent.com/c7a0783fefcf24669eb8df4541ddd86756feac8c7e05c549beaf4de43e4ba533/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742665f3225374425323025334425323073696d696c6172697479253238782532432537426c25354525374225323832253239253744253744253239253230253344253230253742652535452537422532302d25323025354366726163253742253742253743253743782532302d2532302537426c2535452537422532383225323925374425374425374325374225374325354532253744253744253744253742253742322537422535437369676d6125323025354532253744253744253744253744253744
	https://camo.githubusercontent.com/33d79550c43380401b56c12996ffcff2552aa5b451ce835febb11dda9469cbe5/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426c25354525374225323831253239253744253744
	https://camo.githubusercontent.com/354d7ca18e1c825b8dc34a3c9de8ad360e2dc770bbe86a3a37d442476e561cf8/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742665f31253744253230253543617070726f78253230253742652535453025374425323025334425323031
	https://camo.githubusercontent.com/33d79550c43380401b56c12996ffcff2552aa5b451ce835febb11dda9469cbe5/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426c25354525374225323831253239253744253744
	https://camo.githubusercontent.com/a2e8f3c32a21bc9578a188c53e18a6192ae31921ec0cd62ac63cb93facbf1742/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742665f32253744253230253543617070726f78253230253742652535452537422532302d253230253543696e66747925323025374425374425323025334425323030
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_07.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_08.png
	https://camo.githubusercontent.com/e174a384cf1c56e89b5de8fcdbacc6c07ff4eee8a0f0a7185c6ba8f18365e683/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426c253545253742253238312532392537442537442537426c253545253742253238322532392537442537442537426c253545253742253238332532392537442537442e2e2e
	https://camo.githubusercontent.com/74f13a36fd5111f6ada37bac75e99803ba9bd7824da5530b6ec867bdc590cd05/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d25323825323825374278253545253742253238312532392537442537442532432537427925354525374225323831253239253744253744253239253243253238253742782535452537422532383225323925374425374425324325374279253545253742253238322532392537442537442532392532432e2e2e253238253742782535452537422532386d253239253744253744253243253742792535452537422532386d253239253744253744253239253239
	https://camo.githubusercontent.com/8b6ca873287d610f3dcc2c7a3c35dc8e7c7983695c3fad91881a99c2e3c6b427/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426c2535452537422532383125323925374425374425323025334425323025374278253545253742253238312532392537442537442532432537426c2535452537422532383225323925374425374425323025334425323025374278253545253742253238322532392537442537442e2e2e2537426c2535452537422532386d253239253744253744253230253344253230253742782535452537422532386d253239253744253744
	https://camo.githubusercontent.com/65184921ed49bf7bcd2c8fc0fcbcf40ea08197d5a9cd697f11625aa3e98e7008/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d665f302535452537422532386925323925374425323025334425323031
	https://camo.githubusercontent.com/224367134e014bc30f4ae7322e76d6ff182abc7f53c4b8b5013a0f5a8d8349a7/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426625354525374225323869253239253744253744253230253543696e253230253742522535452537426d25323025324225323031253744253744
	https://camo.githubusercontent.com/7bbca0f333e96c26233e1ee846053a723dd9d586a53cd0d8f8c7cb411303cc47/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a25323825354374686574612532302532392532302533442532304325354373756d2535436c696d6974735f25374269253230253344253230312537442535456d2532302537422535422537427925354525374225323869253239253744253744253543636f73253230253742745f312537442532382537422535437468657461253230253545542537442537426625354525374225323869253239253744253744253239253230253242253230253238312532302d2532302537427925354525374225323869253239253744253744253239253543636f73253230253742745f30253744253238253742253543746865746125323025354554253744253742662535452537422532386925323925374425374425323925374425323025354425323025324225323025354366726163253742312537442537423225374425354373756d2535436c696d6974735f2537426a25323025334425323031253744253545253742253543746578742537426e25374425374425323025374225354374686574612532305f6a25354532253744253230
	https://camo.githubusercontent.com/fe2812f951586732f633f856a93a465a87743c76a47657348ec206c2a648d0a4/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2535436c6172676525323025374225354374686574612532302535455425374466253230253543676571736c616e7425323030
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4使用scikit-learn中的svm模型代码
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/SVM/SVM_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5运行结果-1
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_09.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/SVM_10.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#五k-means聚类算法
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/K-Means/K-Menas.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1聚类过程
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_01.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_02.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_03.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2目标函数
	https://camo.githubusercontent.com/953c5f0a06ce3f5a7bd592a4dfbf3a3759343f0299c88b7bdead6d88481bab32/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d4a253238253742632535452537422532383125323925374425374425324325323025354363646f7473253230253243253742632535452537422532386d253239253744253744253243253742755f3125374425324325323025354363646f7473253230253243253742755f6b25374425323925323025334425323025354366726163253742312537442537426d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225374325374325374278253545253742253238692532392537442537442532302d253230253742755f253742253742632535452537422532386925323925374425374425374425374425374325374225374325354532253744253744253230
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_07.png
	https://camo.githubusercontent.com/adfd8af7566c70530283de7ce0eae9564fbfb7aea85797ea53925bd44d41692d/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d2537426325354525374225323869253239253744253744
	https://camo.githubusercontent.com/bab62cd41e2de99f132796d387b7275c4d95df955e57f1435b43d6a110dd0a51/687474703a2f2f63686172742e617069732e676f6f676c652e636f6d2f63686172743f6368743d7478266368733d317830266368663d62672c732c4646464646463030266368636f3d3030303030302663686c3d253742755f69253744
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3聚类中心的选择
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4聚类个数k的选择
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_04.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5应用图片压缩
使用scikit-learn库中的线性模型实现聚类	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/K-Means/K-Means_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6使用scikit-learn库中的线性模型实现聚类
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7运行结果-1
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/K-Means_06.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#六pca主成分分析降维
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/PCA/PCA.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1用处
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#22d--1dnd--kd
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_01.png
	https://camo.githubusercontent.com/9d7fb819f5a864db20e89fb0591b20fef330019f8b4ad1f37651a1afb2ed049d/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253234253234253742752535452537422532383125323925374425374425324325374275253545253742253238322532392537442537442532302535436c646f7473253230253742752535452537422532386b253239253744253744253234253234
	https://camo.githubusercontent.com/a35b1a63e17375530a609b6195393461f7cf2aae12e74a60d695aa633669cea5/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f25323425323425374275253545253742253238312532392537442537442532432537427525354525374225323832253239253744253744253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3主成分分析pca与线性回归的区别
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4pca降维过程
	https://camo.githubusercontent.com/24c2003379ff16ddca7f830b60e361e5b9fd0c6e90c4b19eae9fbc078845be2c/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253234253234253742253543726d253742782537442537445f6a25354525374225323869253239253744253230253344253230253742253742253742253543726d253742782537442537445f6a253545253742253238692532392537442532302d253230253742755f6a2537442537442532302535436f766572253230253742253742735f6a253744253744253744253234253234
	https://camo.githubusercontent.com/4c99e65c78cbea32e345fc240cdf6f2593bdc65e09047522d8257872b1b2fc81/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2532342532342535435369676d61253230253344253230253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456e2532302537422537427825354525374225323869253239253744253744253742253742253238253742782535452537422532386925323925374425374425323925374425354554253744253744253230253234253234
	https://camo.githubusercontent.com/1d76edad1e9c4be443f5e98916b20170a780c1d4f92f4d912cc8fe5ca73ad613/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f2532342532342535435369676d6125323025334425323055532537425625354554253744253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_02.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_03.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5数据恢复
	https://camo.githubusercontent.com/133403f742334ae1c860164abe971cd06e0f5c1a341e0ecd31de6057f795520b/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d2532302532342532342537425a25354525374225323869253239253744253744253230253344253230555f253742726564756365253744253545542a2537425825354525374225323869253239253744253744253234253234
	https://camo.githubusercontent.com/7eb78574c052f6f2ec388f2546fb645f37cfab4b7dc5228d03823ce4a0c7854e/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742585f253742617070726f78253744253744253230253344253230253742253238555f253742726564756365253744253545542532392535452537422532302d253230312537442537445a253234253234
	https://camo.githubusercontent.com/b054cf5530fab561e0e82cf12b2c04644591f13af7c2cb6211af08e4de292492/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d25323025323425323441253742412535455425374425323025334425323025374241253545542537444125323025334425323045253234253234
	https://camo.githubusercontent.com/03eeb4de26ccae3e6e757e1ff8b56cb08d8b7d62c42c2902e7ce9b8e1e6f5034/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742412535452537422532302d253230312537442537442532302533442532302537424125354554253744253234253234
	https://camo.githubusercontent.com/8a393ee6fb003176381f7ecc99e1d2a1ed616d698549521c0d7bfc58678d4a86/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742585f253742617070726f78253744253744253230253344253230253742253238555f2537427265647563652537442535452537422532302d253230312537442532392535452537422532302d253230312537442537445a253230253344253230253742555f2537427265647563652537442537445a253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6主成分个数的选择即要降的维度
	https://camo.githubusercontent.com/337d1c8f982b460042dee624077c6779c490a11529f27fbf81ec15bc30e7c0b9/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225374325374325374278253545253742253238692532392537442537442532302d253230785f253742617070726f782537442535452537422532386925323925374425374325374225374325354532253744253744253230253234253234
	https://camo.githubusercontent.com/09ce06f4f0d56ab9690e9a4b677b9c1bdef2dc77f5f83d10e72ca097a21eb61c/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d253230253742253743253743253742782535452537422532386925323925374425374425374325374225374325354532253744253744253230253234253234
	https://camo.githubusercontent.com/b3881cee512c32154d7a6559dbddb94c674c29cb6735a9ff87d7d87f75b54081/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d253230253234253234253742253742253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225374325374325374278253545253742253238692532392537442537442532302d253230785f253742617070726f7825374425354525374225323869253239253744253743253742253743253545322537442537442532302537442532302535436f766572253230253742253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d2532302537422537432537432537427825354525374225323869253239253744253744253743253742253743253545322537442537442532302537442537442532302535436c65253230302e3031253234253234
	https://camo.githubusercontent.com/7acb924786f46bec0466d8ce2b0d80db00343540aea1f04a21210707fe33b2db/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f6769662e6c617465783f253543666e5f636d2532302532342532346572726f722537422535436b65726e253230317074253744253230253543253342726174696f253230253344253230312532302d25323025374225374225354373756d2535436c696d6974735f25374269253230253344253230312537442535456b253230253742253742535f25374269692537442537442537442532302537442532302535436f76657225323025374225354373756d2535436c696d6974735f25374269253230253344253230312537442535456e253230253742253742535f25374269692537442537442537442532302537442537442532302535436c652532307468726573686f6c64253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7使用建议
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#8运行结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_04.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_06.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_07.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/PCA_08.png
使用scikit-learn库中的PCA实现降维	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/PCA/PCA.py_scikit-learn.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#9使用scikit-learn库中的pca实现降维
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#七异常检测-anomaly-detection
全部代码	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/AnomalyDetection/AnomalyDetection.py
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#1高斯分布正态分布gaussian-distribution
	https://camo.githubusercontent.com/271e086af38ca74716a26e382ab30b1587640c68d13c10aeec4dd2c3e3993b7d/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532347025323878253239253230253344253230253742312532302535436f766572253230253742253543737172742532302537423225354370692532302537442532302535437369676d61253230253744253744253742652535452537422532302d253230253742253742253742253742253238782532302d25323075253239253744253545322537442537442532302535436f766572253230253742322537422535437369676d6125323025354532253744253744253744253744253744253234253234
	https://camo.githubusercontent.com/9dae386ace9ef14729d511b5c43cb4ba9e6173625ad0acd7372937da2c44a2a3/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d25323025323425323475253230253344253230253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d2532302537422537427825354525374225323869253239253744253744253744253230253234253234
	https://camo.githubusercontent.com/0047712ecdfaaf1ffe1e4b67dbd83f994b40a4601af598fce1fe640f6e2c5828/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532342537422535437369676d6125323025354532253744253230253344253230253742312532302535436f7665722532306d25374425354373756d2535436c696d6974735f25374269253230253344253230312537442535456d25323025374225374225374225323825374278253545253742253238692532392537442537442532302d2532307525323925374425354532253744253744253230253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#2异常检测算法
	https://camo.githubusercontent.com/49c23c2fe3ead190757ced32050f7ca219c3f027a730bff8defe7ad3fee5f59e/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532342535432537422532302537427825354525374225323831253239253744253744253243253742782535452537422532383225323925374425374425324325323025354363646f7473253230253742782535452537422532386d253239253744253744253543253744253230253234253234
	https://camo.githubusercontent.com/e4eeece966ac8ebce46a67a856e75feb53e7dec247f14a4aec8b8295d04533c4/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d25323025323425323478253230253543696e253230253742522535456e253744253234253234
	https://camo.githubusercontent.com/8f8c43ac13e091f152bf13139adfab4e4008fcf04b3668b5c008a837089c39ae/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d253230253234253234253742785f31253744253243253742785f3225374425323025354363646f7473253230253742785f6e253744253234253234
	https://camo.githubusercontent.com/8b3d57f10b0c853a6753eb5c56bf22cf470483846abff97212ecd9ee1061427c/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d253230253234253234702532387825323925323025334425323070253238253742785f31253744253342253742755f312537442532432535437369676d612532305f312535453225323970253238253742785f32253744253342253742755f322537442532432535437369676d612532305f322535453225323925323025354363646f747325323070253238253742785f6e253744253342253742755f6e2537442532432535437369676d612532305f6e2535453225323925323025334425323025354370726f642535436c696d6974735f2537426a253230253344253230312537442535456e25323025374270253238253742785f6a253744253342253742755f6a2537442532432535437369676d612532305f6a25354532253239253744253230253234253234
	https://camo.githubusercontent.com/2cec5f033c5a3481217adca97c278bb8795ad60398de9677b794e26b0ab01290/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d253230253234253234253742755f31253744253243253742755f3225374425324325323025354363646f7473253230253243253742755f6e2537442533422535437369676d612532305f31253545322532432535437369676d612532305f322535453225323025354363646f74732532302532432535437369676d612532305f6e25354532253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#3评价px的好坏以及ε的选取
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_01.png
	https://camo.githubusercontent.com/2149513ea048b3bd97b94c76c98c28a6df59106ac81f79f612a1c85f9ee026bb/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d253230253234253234253543507225323065636973696f6e25323025334425323025374225374254502537442532302535436f76657225323025374254502532302b2532304650253744253744253234253234
	https://camo.githubusercontent.com/58688c42615d2f84f56c20fbbf422d631695c4033864a0f713e149df31ece1cf/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532342537422535436d6174686f70253742253543726d25323052652537442535436e6f6c696d697473253744253230253742253543726d25374263616c6c25374425374425323025334425323025374225374254502537442532302535436f76657225323025374254502532302b253230464e253744253744253234253234
	https://camo.githubusercontent.com/8e0e05646b743c15f076b4811991ad6f35c9d43fc70c39805ed129bd17a7c828/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d253230253234253234253742465f3125374453636f72652532302533442532303225374225374250522537442532302535436f766572253230253742502532302b25323052253744253744253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#4选择使用什么样的feature单元高斯分布
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#5多元高斯分布
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_04.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_02.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_03.png
	https://camo.githubusercontent.com/e4eeece966ac8ebce46a67a856e75feb53e7dec247f14a4aec8b8295d04533c4/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d25323025323425323478253230253543696e253230253742522535456e253744253234253234
	https://camo.githubusercontent.com/4017ab68057aef8fd9eb638aa6a3b84323630ecbf1e9d1984eb0c16915fed413/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532342535436d75253230253543696e253230253742522535456e2537442532432535435369676d61253230253543696e253230253742522535452537426e25323025354374696d6573253230253742253543726d2537426e253744253744253744253744253234253234
	https://camo.githubusercontent.com/b64e9c4de6c0c18983737446bd337ded2cd739cde5e47be7cc08c0fd9bc7200d/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532347025323878253239253230253344253230253742312532302535436f7665722532302537422537422537422532383225354370692532302532392537442535452537422537426e2532302535436f766572253230322537442537442537442537432535435369676d61253230253742253743253545253742253742312532302535436f76657225323032253744253744253744253744253744253742652535452537422532302d253230253742312532302535436f76657225323032253744253742253742253238782532302d25323075253239253744253545542537442537422535435369676d612532302535452537422532302d25323031253744253744253238782532302d25323075253239253744253744253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_05.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_07.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_06.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#6单元和多元高斯分布特点
	https://camo.githubusercontent.com/fca7e1fc92681f5ea2a61d34cb9e4abbd39e9f0874817d8d3bd8d31069f81143/687474703a2f2f6c617465782e636f6465636f67732e636f6d2f706e672e6c617465783f253543666e5f636d2532302532342532342535435369676d61253230253543696e253230253742522535452537426e25323025354374696d6573253230253742253543726d2537426e253744253744253744253744253234253234
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#7程序运行结果
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_08.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_09.png
	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/blob/master/images/AnomalyDetection_10.png
Readme	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#readme-ov-file
MIT license	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python#MIT-1-ov-file
Please reload this page	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python
Activity	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/activity
0 stars	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/stargazers
0 watching	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/watchers
0 forks	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/forks
Report repository	https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FChunyeLi%2FMachineLearning_Python&report=ChunyeLi+%28user%29
Releases	https://patch-diff.githubusercontent.com/ChunyeLi/MachineLearning_Python/releases
Packages 0	https://patch-diff.githubusercontent.com/users/ChunyeLi/packages?repo_name=MachineLearning_Python
	https://github.com
Terms	https://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacy	https://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Security	https://github.com/security
Status	https://www.githubstatus.com/
Community	https://github.community/
Docs	https://docs.github.com/
Contact	https://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.