1/27
Looks like no tags are added yet.
Transactional Information
Encompasses all of the information contained within a single business process or unit of work, and its primary purpose is to support the performing of daily operational tasks.
Analytical information
Encompasses all organizational information, and its primary purpose is to support the performing of managerial analysis tasks.
Airline tickets, Sales receipts, and Packing Slips
Examples of transactional information
Product Statistics, Sales Projections, Future Growth, and Trends
Examples of analytical information.
Data quality
Data that are fit for use by data consumers.
High-Quality Data
Data that satisfies the requirements of its intended use.
Information Quality
Business decisions are only as good as the quality of the information used to make the decisions.
Accurate, Complete, Consistent, Timely, and Unique.
What are the 5 characteristics of high-quality information?
Accurate
Is there an incorrect value in the information? Example: Is the name spelled correctly? Is the dollar amount recorded properly?
Complete
Is a value missing from the information. Example: Is the address complete including street, city, state, and zip code?
Consistent
Is aggregate or summary information in agreement with detailed information? Example: Do all total columns equal the true total of the individual item?
Timely
Is the information current with respect to business needs? Example: Is information updated weekly, daily, or hourly?
Unique
Is each transaction and event represented only once in the information? Example: Are there any duplicate customers?
Provides tremendous insight into how an organization is performing; better decision making.
Benefits of High-Quality Information
Missing information (no first name); Incomplete information (no street, or area code); possible duplicates (similar names, address, and phone number); potential wrong information (fax and phone are different); Inaccurate Information (Invalid e-mail).
Examples of low-quality information.
1.Customers intentionally enter inaccurate information to protect their privacy. 2. Different entry standards and formats. 3. Operators enter abbreviate or erroneous information by accident or to save time. 4. Third party and external information contains inconsistencies, inaccuracies, and errors. 5. Parallel data entry.
What are the five primary sources of low-quality information:
Inability to accurately track customers; difficulty identifying valuable customers; inability to identify selling opportunities; marketing to nonexistent customers; difficulty tracking revenue; inability to build strong customer relationships
Costs of low-quality information:
It helps ensure that the information is reliable and accurate, its efficient, and supports machine learning.
Why is data cleaning important?
Replace Values
Used when there are missing values in a column (null values) and are replaced via the replace values in the Transform tab, or when you need to change a value everywhere it appears.
Remove duplicate rows
Used when there is redundant data/repeated rows. Found in the remove rows—> remove duplicates.
Split Column by Delimiter
Used when there are multiple values in one cell. Use the Split Column function in home tab to split data into multiple columns.
Delimiter
A sequence of one or more characters used to specify the boundary between values in a stream of text.
Trim
Used to remove the extra spaces between the text and before or after text. Under Format→ Trim
Clean
Used to remove all non-printable characters. Format→ Clean
lowercase, UPPERCASE, Capitalize Each Word
Used when the text is mis-capitalized. Lowercase makes all letters lowercase, Uppercase makes all letters uppercase, and Capitalize Each Word capitalizes the first letter of each word and puts the remaining letters in lower case. Under Format.
Create Custom Column (Glue)/Concatenate multiple values
Used when values are spread across multiple columns. Used to combine things. Under Add Column.
Create Conditional Column as a test
This is used when the data is invalid due to an incorrect format. Under Add Column.
Extract text using delimiter
This is used when text is embedded in a cell. Under Add-Column —> Extract