| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:29528b56-421d-4440-8dd0-cf3cae9df72e |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | A082:39B0E5:108D4C:15BD98:697E16F0 |
| html-safe-nonce | 592711929a399a7274df89732f4bcab0a451f4893b3b90a433034c0b5b8e02e3 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMDgyOjM5QjBFNToxMDhENEM6MTVCRDk4OjY5N0UxNkYwIiwidmlzaXRvcl9pZCI6IjM1ODE3NjcxMDA0MzMwNDUyMzIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | c32f1239df52b417a4c4e430dbdcce6f70b560b6023e0734dd16c3aa86434d3d |
| hovercard-subject-tag | repository:81720730 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | // |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/bryoco/lectures |
| twitter:image | https://opengraph.githubassets.com/312912f31a9e7ed75fd5d24eb59ac13ba6e90b8cd045daa66ec78236fe920b04/bryoco/lectures |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/312912f31a9e7ed75fd5d24eb59ac13ba6e90b8cd045daa66ec78236fe920b04/bryoco/lectures |
| og:image:alt | Oxford Deep NLP 2017 course. Contribute to bryoco/lectures development by creating an account on GitHub. |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 60279d4097367e16897439d16d6bbe4180663db828c666eeed2656988ffe59f6 |
| turbo-cache-control | no-preview |
| go-import | github.com/bryoco/lectures git https://github.com/bryoco/lectures.git |
| octolytics-dimension-user_id | 8148101 |
| octolytics-dimension-user_login | bryoco |
| octolytics-dimension-repository_id | 81720730 |
| octolytics-dimension-repository_nwo | bryoco/lectures |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 81080671 |
| octolytics-dimension-repository_parent_nwo | oxford-cs-deepnlp-2017/lectures |
| octolytics-dimension-repository_network_root_id | 81080671 |
| octolytics-dimension-repository_network_root_nwo | oxford-cs-deepnlp-2017/lectures |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 7c85641c598ad130c74f7bcc27f58575cac69551 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| Skip to content | https://patch-diff.githubusercontent.com/bryoco/lectures#start-of-content |
|
| https://patch-diff.githubusercontent.com/ |
|
Sign in
| https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fbryoco%2Flectures |
| GitHub CopilotWrite better code with AI | https://github.com/features/copilot |
| GitHub SparkBuild and deploy intelligent apps | https://github.com/features/spark |
| GitHub ModelsManage and compare prompts | https://github.com/features/models |
| MCP RegistryNewIntegrate external tools | https://github.com/mcp |
| ActionsAutomate any workflow | https://github.com/features/actions |
| CodespacesInstant dev environments | https://github.com/features/codespaces |
| IssuesPlan and track work | https://github.com/features/issues |
| Code ReviewManage code changes | https://github.com/features/code-review |
| GitHub Advanced SecurityFind and fix vulnerabilities | https://github.com/security/advanced-security |
| Code securitySecure your code as you build | https://github.com/security/advanced-security/code-security |
| Secret protectionStop leaks before they start | https://github.com/security/advanced-security/secret-protection |
| Why GitHub | https://github.com/why-github |
| Documentation | https://docs.github.com |
| Blog | https://github.blog |
| Changelog | https://github.blog/changelog |
| Marketplace | https://github.com/marketplace |
| View all features | https://github.com/features |
| Enterprises | https://github.com/enterprise |
| Small and medium teams | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| App Modernization | https://github.com/solutions/use-case/app-modernization |
| DevSecOps | https://github.com/solutions/use-case/devsecops |
| DevOps | https://github.com/solutions/use-case/devops |
| CI/CD | https://github.com/solutions/use-case/ci-cd |
| View all use cases | https://github.com/solutions/use-case |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| View all industries | https://github.com/solutions/industry |
| View all solutions | https://github.com/solutions |
| AI | https://github.com/resources/articles?topic=ai |
| Software Development | https://github.com/resources/articles?topic=software-development |
| DevOps | https://github.com/resources/articles?topic=devops |
| Security | https://github.com/resources/articles?topic=security |
| View all topics | https://github.com/resources/articles |
| Customer stories | https://github.com/customer-stories |
| Events & webinars | https://github.com/resources/events |
| Ebooks & reports | https://github.com/resources/whitepapers |
| Business insights | https://github.com/solutions/executive-insights |
| GitHub Skills | https://skills.github.com |
| Documentation | https://docs.github.com |
| Customer support | https://support.github.com |
| Community forum | https://github.com/orgs/community/discussions |
| Trust center | https://github.com/trust-center |
| Partners | https://github.com/partners |
| GitHub SponsorsFund open source developers | https://github.com/sponsors |
| Security Lab | https://securitylab.github.com |
| Maintainer Community | https://maintainers.github.com |
| Accelerator | https://github.com/accelerator |
| Archive Program | https://archiveprogram.github.com |
| Topics | https://github.com/topics |
| Trending | https://github.com/trending |
| Collections | https://github.com/collections |
| Enterprise platformAI-powered developer platform | https://github.com/enterprise |
| GitHub Advanced SecurityEnterprise-grade security features | https://github.com/security/advanced-security |
| Copilot for BusinessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/premium-support |
| Pricing | https://github.com/pricing |
| Search syntax tips | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
| documentation | https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax |
|
Sign in
| https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fbryoco%2Flectures |
|
Sign up
| https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=bryoco%2Flectures |
| Reload | https://patch-diff.githubusercontent.com/bryoco/lectures |
| Reload | https://patch-diff.githubusercontent.com/bryoco/lectures |
| Reload | https://patch-diff.githubusercontent.com/bryoco/lectures |
|
bryoco
| https://patch-diff.githubusercontent.com/bryoco |
| lectures | https://patch-diff.githubusercontent.com/bryoco/lectures |
| oxford-cs-deepnlp-2017/lectures | https://patch-diff.githubusercontent.com/oxford-cs-deepnlp-2017/lectures |
|
Notifications
| https://patch-diff.githubusercontent.com/login?return_to=%2Fbryoco%2Flectures |
|
Fork
0
| https://patch-diff.githubusercontent.com/login?return_to=%2Fbryoco%2Flectures |
|
Star
0
| https://patch-diff.githubusercontent.com/login?return_to=%2Fbryoco%2Flectures |
|
0
stars
| https://patch-diff.githubusercontent.com/bryoco/lectures/stargazers |
|
3.6k
forks
| https://patch-diff.githubusercontent.com/bryoco/lectures/forks |
|
Branches
| https://patch-diff.githubusercontent.com/bryoco/lectures/branches |
|
Tags
| https://patch-diff.githubusercontent.com/bryoco/lectures/tags |
|
Activity
| https://patch-diff.githubusercontent.com/bryoco/lectures/activity |
|
Star
| https://patch-diff.githubusercontent.com/login?return_to=%2Fbryoco%2Flectures |
|
Notifications
| https://patch-diff.githubusercontent.com/login?return_to=%2Fbryoco%2Flectures |
|
Code
| https://patch-diff.githubusercontent.com/bryoco/lectures |
|
Pull requests
0
| https://patch-diff.githubusercontent.com/bryoco/lectures/pulls |
|
Actions
| https://patch-diff.githubusercontent.com/bryoco/lectures/actions |
|
Projects
0
| https://patch-diff.githubusercontent.com/bryoco/lectures/projects |
|
Wiki
| https://patch-diff.githubusercontent.com/bryoco/lectures/wiki |
|
Security
0
| https://patch-diff.githubusercontent.com/bryoco/lectures/security |
|
Insights
| https://patch-diff.githubusercontent.com/bryoco/lectures/pulse |
|
Code
| https://patch-diff.githubusercontent.com/bryoco/lectures |
|
Pull requests
| https://patch-diff.githubusercontent.com/bryoco/lectures/pulls |
|
Actions
| https://patch-diff.githubusercontent.com/bryoco/lectures/actions |
|
Projects
| https://patch-diff.githubusercontent.com/bryoco/lectures/projects |
|
Wiki
| https://patch-diff.githubusercontent.com/bryoco/lectures/wiki |
|
Security
| https://patch-diff.githubusercontent.com/bryoco/lectures/security |
|
Insights
| https://patch-diff.githubusercontent.com/bryoco/lectures/pulse |
| Branches | https://patch-diff.githubusercontent.com/bryoco/lectures/branches |
| Tags | https://patch-diff.githubusercontent.com/bryoco/lectures/tags |
| https://patch-diff.githubusercontent.com/bryoco/lectures/branches |
| https://patch-diff.githubusercontent.com/bryoco/lectures/tags |
| 24 Commits | https://patch-diff.githubusercontent.com/bryoco/lectures/commits/master/ |
| https://patch-diff.githubusercontent.com/bryoco/lectures/commits/master/ |
| Lecture 1a - Introduction.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%201a%20-%20Introduction.pdf |
| Lecture 1a - Introduction.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%201a%20-%20Introduction.pdf |
| Lecture 1b - Deep Neural Networks Are Our Friends.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%201b%20-%20Deep%20Neural%20Networks%20Are%20Our%20Friends.pdf |
| Lecture 1b - Deep Neural Networks Are Our Friends.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%201b%20-%20Deep%20Neural%20Networks%20Are%20Our%20Friends.pdf |
| Lecture 2a- Word Level Semantics.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%202a-%20Word%20Level%20Semantics.pdf |
| Lecture 2a- Word Level Semantics.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%202a-%20Word%20Level%20Semantics.pdf |
| Lecture 2b - Overview of the Practicals.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%202b%20-%20Overview%20of%20the%20Practicals.pdf |
| Lecture 2b - Overview of the Practicals.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%202b%20-%20Overview%20of%20the%20Practicals.pdf |
| Lecture 3 - Language Modelling and RNNs Part 1.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%203%20-%20Language%20Modelling%20and%20RNNs%20Part%201.pdf |
| Lecture 3 - Language Modelling and RNNs Part 1.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%203%20-%20Language%20Modelling%20and%20RNNs%20Part%201.pdf |
| Lecture 4 - Language Modelling and RNNs Part 2.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%204%20-%20Language%20Modelling%20and%20RNNs%20Part%202.pdf |
| Lecture 4 - Language Modelling and RNNs Part 2.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%204%20-%20Language%20Modelling%20and%20RNNs%20Part%202.pdf |
| Lecture 5 - Text Classification.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%205%20-%20Text%20Classification.pdf |
| Lecture 5 - Text Classification.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%205%20-%20Text%20Classification.pdf |
| Lecture 6 - Nvidia RNNs and GPUs.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%206%20-%20Nvidia%20RNNs%20and%20GPUs.pdf |
| Lecture 6 - Nvidia RNNs and GPUs.pdf | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/Lecture%206%20-%20Nvidia%20RNNs%20and%20GPUs.pdf |
| README.md | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/README.md |
| README.md | https://patch-diff.githubusercontent.com/bryoco/lectures/blob/master/README.md |
| README | https://patch-diff.githubusercontent.com/bryoco/lectures |
| https://patch-diff.githubusercontent.com/bryoco/lectures#preamble |
| Deep Natural Language Processing | http://www.cs.ox.ac.uk/teaching/courses/2016-2017/dl/ |
| https://patch-diff.githubusercontent.com/bryoco/lectures#lecturers |
| https://patch-diff.githubusercontent.com/bryoco/lectures#tas |
| https://patch-diff.githubusercontent.com/bryoco/lectures#timetable |
| https://patch-diff.githubusercontent.com/bryoco/lectures#practicals |
| https://patch-diff.githubusercontent.com/bryoco/lectures#lectures |
| https://patch-diff.githubusercontent.com/bryoco/lectures#lecture-materials |
| https://patch-diff.githubusercontent.com/bryoco/lectures#1-lecture-1a---introduction-phil-blunsom |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_1a_intro.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#2-lecture-1b---deep-neural-networks-are-our-friends-wang-ling |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_1b_friends.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#3-lecture-2a--word-level-semantics-ed-grefenstette |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_2a_lexical_semantics.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading |
| https://patch-diff.githubusercontent.com/bryoco/lectures#embeddings-basics |
| Firth, John R. "A synopsis of linguistic theory, 1930-1955." (1957): 1-32. | http://annabellelukin.edublogs.org/files/2013/08/Firth-JR-1962-A-Synopsis-of-Linguistic-Theory-wfihi5.pdf |
| Curran, James Richard. "From distributional to semantic similarity." (2004). | https://www.era.lib.ed.ac.uk/bitstream/handle/1842/563/IP030023.pdf?sequence=2&isAllowed=y |
| Collobert, Ronan, et al. "Natural language processing (almost) from scratch." Journal of Machine Learning Research 12. Aug (2011): 2493-2537. | http://www.jmlr.org/papers/volume12/collobert11a/collobert11a.pdf |
| Mikolov, Tomas, et al. "Distributed representations of words and phrases and their compositionality." Advances in neural information processing systems. 2013. | http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf |
| https://patch-diff.githubusercontent.com/bryoco/lectures#datasets-and-visualisation |
| Finkelstein, Lev, et al. "Placing search in context: The concept revisited." Proceedings of the 10th international conference on World Wide Web. ACM, 2001. | http://www.iicm.tugraz.at/thesis/cguetl_diss/literatur/Kapitel07/References/Finkelstein_et_al._2002/p116-finkelstein.pdf |
| Hill, Felix, Roi Reichart, and Anna Korhonen. "Simlex-999: Evaluating semantic models with (genuine) similarity estimation." Computational Linguistics (2016). | http://www.aclweb.org/website/old_anthology/J/J15/J15-4004.pdf |
| Maaten, Laurens van der, and Geoffrey Hinton. "Visualizing data using t-SNE." Journal of Machine Learning Research 9.Nov (2008): 2579-2605. | http://www.jmlr.org/papers/volume9/vandermaaten08a/vandermaaten08a.pdf |
| https://patch-diff.githubusercontent.com/bryoco/lectures#blog-posts |
| Deep Learning, NLP, and Representations | http://colah.github.io/posts/2014-07-NLP-RNNs-Representations/ |
| Visualizing Top Tweeps with t-SNE, in Javascript | http://karpathy.github.io/2014/07/02/visualizing-top-tweeps-with-t-sne-in-Javascript/ |
| https://patch-diff.githubusercontent.com/bryoco/lectures#further-reading |
| Hermann, Karl Moritz, and Phil Blunsom. "Multilingual models for compositional distributed semantics." arXiv preprint arXiv:1404.4641 (2014). | https://arxiv.org/pdf/1404.4641.pdf |
| Levy, Omer, and Yoav Goldberg. "Neural word embedding as implicit matrix factorization." Advances in neural information processing systems. 2014. | http://u.cs.biu.ac.il/~nlp/wp-content/uploads/Neural-Word-Embeddings-as-Implicit-Matrix-Factorization-NIPS-2014.pdf |
| Levy, Omer, Yoav Goldberg, and Ido Dagan. "Improving distributional similarity with lessons learned from word embeddings." Transactions of the Association for Computational Linguistics 3 (2015): 211-225. | https://www.transacl.org/ojs/index.php/tacl/article/view/570/124 |
| Ling, Wang, et al. "Two/Too Simple Adaptations of Word2Vec for Syntax Problems." HLT-NAACL. 2015. | https://www.aclweb.org/anthology/N/N15/N15-1142.pdf |
| https://patch-diff.githubusercontent.com/bryoco/lectures#4-lecture-2b---overview-of-the-practicals-chris-dyer |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_2b_practicals.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#5-lecture-3---language-modelling-and-rnns-part-1-phil-blunsom |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_3_modelling_1.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-1 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#textbook |
| Deep Learning, Chapter 10 | http://www.deeplearningbook.org/contents/rnn.html |
| https://patch-diff.githubusercontent.com/bryoco/lectures#blogs |
| The Unreasonable Effectiveness of Recurrent Neural Networks | http://karpathy.github.io/2015/05/21/rnn-effectiveness/ |
| The unreasonable effectiveness of Character-level Language Models | http://nbviewer.jupyter.org/gist/yoavg/d76121dfde2618422139 |
| Explaining and illustrating orthogonal initialization for recurrent neural networks | http://smerity.com/articles/2016/orthogonal_init.html |
| https://patch-diff.githubusercontent.com/bryoco/lectures#6-lecture-4---language-modelling-and-rnns-part-2-phil-blunsom |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_4_modelling_2.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-2 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#textbook-1 |
| Deep Learning, Chapter 10 | http://www.deeplearningbook.org/contents/rnn.html |
| https://patch-diff.githubusercontent.com/bryoco/lectures#vanishing-gradients-lstms-etc |
| On the difficulty of training recurrent neural networks. Pascanu et al., ICML 2013. | http://jmlr.csail.mit.edu/proceedings/papers/v28/pascanu13.pdf |
| Long Short-Term Memory. Hochreiter and Schmidhuber, Neural Computation 1997. | http://dl.acm.org/citation.cfm?id=1246450 |
| Learning Phrase Representations using RNN EncoderDecoder for Statistical Machine Translation. Cho et al, EMNLP 2014. | https://arxiv.org/abs/1406.1078 |
| Understanding LSTM Networks | http://colah.github.io/posts/2015-08-Understanding-LSTMs/ |
| https://patch-diff.githubusercontent.com/bryoco/lectures#dealing-with-large-vocabularies |
| A scalable hierarchical distributed language model. Mnih and Hinton, NIPS 2009. | https://papers.nips.cc/paper/3583-a-scalable-hierarchical-distributed-language-model.pdf |
| A fast and simple algorithm for training neural probabilistic language models. Mnih and Teh, ICML 2012. | https://www.cs.toronto.edu/~amnih/papers/ncelm.pdf |
| On Using Very Large Target Vocabulary for Neural Machine Translation. Jean et al., ACL 2015. | http://www.aclweb.org/anthology/P15-1001 |
| Exploring the Limits of Language Modeling. Jozefowicz et al., arXiv 2016. | https://arxiv.org/abs/1602.02410 |
| Efficient softmax approximation for GPUs. Grave et al., arXiv 2016. | https://arxiv.org/abs/1609.04309 |
| Notes on Noise Contrastive Estimation and Negative Sampling. Dyer, arXiv 2014. | https://arxiv.org/abs/1410.8251 |
| Pragmatic Neural Language Modelling in Machine Translation. Baltescu and Blunsom, NAACL 2015 | http://www.aclweb.org/anthology/N15-1083 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#regularisation-and-dropout |
| A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. Gal and Ghahramani, NIPS 2016. | https://arxiv.org/abs/1512.05287 |
| Uncertainty in Deep Learning | http://mlg.eng.cam.ac.uk/yarin/blog_2248.html |
| https://patch-diff.githubusercontent.com/bryoco/lectures#other-stuff |
| Recurrent Highway Networks. Zilly et al., arXiv 2016. | https://arxiv.org/abs/1607.03474 |
| Capacity and Trainability in Recurrent Neural Networks. Collins et al., arXiv 2016. | https://arxiv.org/abs/1611.09913 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#7-lecture-5---text-classification-karl-moritz-hermann |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_5_text_classification.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-3 |
| Recurrent Convolutional Neural Networks for Text Classification. Lai et al. AAAI 2015. | http://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/download/9745/9552 |
| A Convolutional Neural Network for Modelling Sentences, Kalchbrenner et al. ACL 2014. | http://www.aclweb.org/anthology/P14-1062 |
| Semantic compositionality through recursive matrix-vector, Socher et al. EMNLP 2012. | http://nlp.stanford.edu/pubs/SocherHuvalManningNg_EMNLP2012.pdf |
| Understanding Convolution Neural Networks For NLP | http://www.wildml.com/2015/11/understanding-convolutional-neural-networks-for-nlp/ |
| Distributional Representations for Compositional Semantics, Hermann (2014). | https://arxiv.org/abs/1411.3146 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#8-lecture-6---deep-nlp-on-nvidia-gpus-jeremy-appleyard |
| [video] | http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_6_nvidia_gpus.mp4 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-4 |
| Optimizing Performance of Recurrent Neural Networks on GPUs. Appleyard et al., arXiv 2016. | https://arxiv.org/abs/1604.01946 |
| Persistent RNNs: Stashing Recurrent Weights On-Chip, Diamos et al., ICML 2016 | http://jmlr.org/proceedings/papers/v48/diamos16.pdf |
| Efficient softmax approximation for GPUs. Grave et al., arXiv 2016. | https://arxiv.org/abs/1609.04309 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#9-lecture-7---coming-soon-conditional-language-models-chris-dyer |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-5 |
| Sutskever et al. (2014) Sequence to Sequence Learning with Neural Networks. | https://arxiv.org/abs/1409.3215 |
| https://patch-diff.githubusercontent.com/bryoco/lectures#10-lecture-8---coming-soon-generating-language-with-attention-chris-dyer |
| https://patch-diff.githubusercontent.com/bryoco/lectures#reading-6 |
| Bahdanau et al. (2015) Neural Machine Translation by Jointly Learning to Align and Translate. | https://arxiv.org/abs/1409.0473 |
| Xu et al. (2015) Show, Attend, and Tell: Neural Image Caption Generation with Visual Attention. | https://arxiv.org/pdf/1502.03044.pdf |
| https://patch-diff.githubusercontent.com/bryoco/lectures#piazza |
| https://piazza.com/ox.ac.uk/winter2017/dnlpht2017/home | https://piazza.com/ox.ac.uk/winter2017/dnlpht2017/home |
| https://patch-diff.githubusercontent.com/bryoco/lectures#assessment |
| https://patch-diff.githubusercontent.com/bryoco/lectures#acknowledgements |
| DeepMind | http://www.deepmind.com |
| The University of Oxford Department of Computer Science | http://www.cs.ox.ac.uk/ |
| Nvidia | http://www.nvidia.com |
| Microsoft Azure | https://azure.microsoft.com |
|
Readme
| https://patch-diff.githubusercontent.com/bryoco/lectures#readme-ov-file |
| Please reload this page | https://patch-diff.githubusercontent.com/bryoco/lectures |
|
Activity | https://patch-diff.githubusercontent.com/bryoco/lectures/activity |
|
0
stars | https://patch-diff.githubusercontent.com/bryoco/lectures/stargazers |
|
0
watching | https://patch-diff.githubusercontent.com/bryoco/lectures/watchers |
|
0
forks | https://patch-diff.githubusercontent.com/bryoco/lectures/forks |
|
Report repository
| https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fbryoco%2Flectures&report=bryoco+%28user%29 |
| Releases | https://patch-diff.githubusercontent.com/bryoco/lectures/releases |
| Packages
0 | https://patch-diff.githubusercontent.com/users/bryoco/packages?repo_name=lectures |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |