1/6
this classifer
Name | Mastery | Learn | Test | Matching | Spaced |
---|
No study sessions yet.
What is Text Classification?
Text classification is the process of assigning predefined categories to text data based on its content.
What is a Naive Bayes Classifier?
A Naive Bayes classifier is a probabilistic machine learning model used for classification tasks. It assumes that the features are independent given the class.
Transfer Learning in NLP
Transfer Learning in NLP involves fine-tuning pre-trained language models like BERT and GPT on specific tasks to improve performance with minimal data.
what tranfer leanrning improve in machine laerning
It's a powerful approach that has revolutionized NLP, leading to improvements in machine translation, business analytics, and natural language generation.
Attention Mechanism enhance neural networks
The Attention Mechanism focuses on relevant parts of input sequences, enhancing model understanding in tasks like translation and summarization.
Advantage of Attention Mechanism
It assigns weights to different input elements based on their importance, enabling the model to capture long-range dependencies and context more effectively.
This approach enhances tasks like machine translation, text summarization, and image captioning by dynamically adjusting focus, improving accuracy, and reducing information loss complex sequences.
How weights are assigned
Query, Key, and Value Vectors
Each word in the input sequence is transformed into three vectors: query (Q), key (K), and value (V). These vectors are learned during training.
(Q,K)=Q⋅KT
apply softmax for probabilty.
comptute the context vector.