http://www.batisengul.co.uk/tags/transformer/ Recent content in Transformer on Batı Şengül Hugo -- gohugo.io batisengul@gmail.com batisengul@gmail.com Tue, 12 Mar 2019 00:00:00 +0000 http://www.batisengul.co.uk/post/2019-03-12-from-zero-to-state-of-the-art-nlp-part-two/ Tue, 12 Mar 2019 00:00:00 +0000 batisengul@gmail.com http://www.batisengul.co.uk/post/2019-03-12-from-zero-to-state-of-the-art-nlp-part-two/ <div class="jupyter-cell markdown"> <p>Welcome to part two of the two part series on a crash course into state of the art natural language processing. This part is going to go through the transformer architecture from <a href="https://arxiv.org/abs/1706.03762">Attention Is All You Need</a>. If you haven&rsquo;t done so already, read the <a href="http://www.batisengul.co.uk/post/2019-03-06-from-zero-to-state-of-the-art-nlp-part-one/">first part</a> which introduces attention mechanisms. This post is all about transformers and assumes you know attention mechanisms.</p>