Rasa Learning CenterLearn to Make Virtual Assistants
  • Home
    • Windows
    • MacOS
    • Ubuntu
    • Introduction
    • Introduction to Rasa
    • Creating a New Assistant
    • The Domain File
    • Training Data & Rules
    • Entities
    • Slots
    • Responses
    • Pipeline
    • Custom Actions
    • Basic Forms
    • Custom Forms
    • Website Integration
    • Rasa is Always Improving
    • Study Guide
    • What you'll learn
    • Word Embeddings
    • Transformers
    • Tokenization
    • Bert
    • Shrinking Transformers
    • Model Confidence
    • Stopwords
    • Intents
    • End to End ML
    • GPT-3
    • Non-English Pipelines
    • Multi-Lingual Pipelines
    • Annotating Language Data
    • Featurizers
    • Regular Expressions
    • Transfer-Learning
    • What you'll learn
    • Measuring Bias
    • Mitigating Bias
    • Lipstick on a Pig
    • Projection Maths
    • Word Analogies
    • What you'll learn
    • Custom Actions
    • Introduction to Slots
    • Constraining Slots
    • Rasa Forms
    • Text Slots
    • Data Validation
    • What you'll learn
    • Self Attention
    • Keys, Values & Queries
    • Multi Head Attention
    • Transformers
    • What you'll Learn
    • Introduction to Docker
    • Premade Rasa Containers
    • The Need for Kubernetes
    • How Kubernetes Works
    • Local Kubernetes Demo
    • Why Helm
      • What you'll learn
      • Custom Actions Intro
      • Memory and Slots
      • Rasa Forms
      • Ask for Data
      • Data Validation
      • Example Form: Names
      • Slots
      • Custom Actions
      • Basic Forms
      • Custom Forms
    • Index
  • Home
    • Windows
    • MacOS
    • Ubuntu
    • Introduction
    • Introduction to Rasa
    • Creating a New Assistant
    • The Domain File
    • Training Data & Rules
    • Entities
    • Slots
    • Responses
    • Pipeline
    • Custom Actions
    • Basic Forms
    • Custom Forms
    • Website Integration
    • Rasa is Always Improving
    • Study Guide
    • What you'll learn
    • Word Embeddings
    • Transformers
    • Tokenization
    • Bert
    • Shrinking Transformers
    • Model Confidence
    • Stopwords
    • Intents
    • End to End ML
    • GPT-3
    • Non-English Pipelines
    • Multi-Lingual Pipelines
    • Annotating Language Data
    • Featurizers
    • Regular Expressions
    • Transfer-Learning
    • What you'll learn
    • Measuring Bias
    • Mitigating Bias
    • Lipstick on a Pig
    • Projection Maths
    • Word Analogies
    • What you'll learn
    • Custom Actions
    • Introduction to Slots
    • Constraining Slots
    • Rasa Forms
    • Text Slots
    • Data Validation
    • What you'll learn
    • Self Attention
    • Keys, Values & Queries
    • Multi Head Attention
    • Transformers
    • What you'll Learn
    • Introduction to Docker
    • Premade Rasa Containers
    • The Need for Kubernetes
    • How Kubernetes Works
    • Local Kubernetes Demo
    • Why Helm
      • What you'll learn
      • Custom Actions Intro
      • Memory and Slots
      • Rasa Forms
      • Ask for Data
      • Data Validation
      • Example Form: Names
      • Slots
      • Custom Actions
      • Basic Forms
      • Custom Forms
    • Index

NLP for Developers: Transformers

In this video, Rasa Developer Advocate Rachael will talk about what transformers are, how they work, when they're used and some common errors.

Video#


Links#

  • The Illustrated Transformer by Jay Alammar
  • Research Updates from Rasa: Transformers in NLU and Dialogue by Alan Nichol
Prev
Next
2016-2022 © Rasa.