IBM: Natural Language Processing and Computer Vision

Project Debater

is an AI system developed by IBM that can engage in natural language debates with humans. It analyzes vast amounts of data and constructs coherent arguments.

corpus

collection of learned material

tounge-twisters

what simple ideas can turn into due to the complexity of human language

Natural Language Processing (NLP)

is a branch of artificial intelligence focused on enabling computers to understand, interpret, and generate human language.

sentence segmentation

is the process of dividing text into individual sentences. This is crucial for various NLP tasks as it helps in understanding the structure and meaning of written language.

tokens

are individual pieces of text, such as words or phrases, that are used in natural language processing to analyze the structure and meaning of language.

entity

a noun representing a person, place, or thing. It’s not an adjective, verb, or other article of speech.

relationship

a group of two or more entities that have a strong connection to one another.

concept

something implied in a sentence but not actually stated.

Emotion Detection

 identifies distinct human emotion types.

Sentiment analysis

a measure of the strength of an emotion; a means of assessing if data is positive, negative, or neutral

classification problem

a task in machine learning where the goal is to assign categories to inputs based on their attributes.

small data

data that chatbots work with to generate responses or make predictions. Unlike big data, this data is limited in volume but can still provide valuable insights.

classifiers

Algorithms that sort data into predefined categories based on features, enabling tasks such as sentiment analysis and object recognition.

intent

a purpose: the reason why a user is contacting the chatbot.

dialog

a flowchart—an IF / THEN tree structure that illustrates how a machine will respond to user intents

node

a condensed moment of the conservation that contains a statement by the chatbot and a long, expandable list of possible replies.

convolutional neural network (CNN)

process that makes it possible for visual recognition systems to identify things in an image, as in facial recognition. 

generative adversarial network (GAN)

a class of machine learning frameworks where two neural networks contest with each other to generate new data that resembles a given dataset.

AI Debater System Steps

• Step 1: Learn and understand the topic

• Step 2: Build a position

• Step 3: Organize your proof

• Step 4: Respond to your opponent

Chatbot Frontend

interacts with the person asking questions. It listens (or reads) and speaks (or presents text)

Chatbot Backend

operates application logic and has enough memory to remember earlier parts of a conversation as dialog continues.