lecture 16 - databases, data warehouses, and api's

what is structured information?

facts and data that are reasonably ordered or can be easily organized into hierachies

what is a pro of structured information?

accessible and easy to use, abundance of tools

what are the cons to structured information?

limited usage and less flexible, limited storage options, only 20% of data

how much of data is structured?

only 20%

what is unstructured information?

information that has no inherent structure or order (like emails, texts, social media posts, etc.)

what are the pros of unstructured information?

flexible, fast accumulating rates, easy and cheap to store

what are the cons of unstructured information?

requires expertise, specialized tools and data cleanliness

what is semi-structured information?

information category that falls between the two!

true or false: semi-structured information does not have predefined data models, however, it does use metadata or data about data

true

what factors make up information quality?

accuracy and precision, completeness, consistency, context, timeliness, bias and duplication

what is accuracy and precision when it comes to information quality?

how accurate is the data

what is context hen it comes to information quality?

does the data have the proper context to understand it

what is timeliness when it comes to information quality?

has the data arrived timely enough

what is a database?

organized collection of data that is logically related and stored to minimize duplication

what is the relational database?

organizes information into tables and records that are related to one another by linking a field in one table toa field in another table with matching data

why do we use relational databases?

avoid redundancy, ensure consistency, and improve efficiency

what is sql?

structured query language (originally system R)

how is data stored?

data lake → data warehouse → datamart

what are data warehouses used for?

to perform analytics on data aggregated from other sources

what does api stand for?

application programming interface

what is the process of using an api?

a request, a call, and a response

what are the challenges with information management?

ownership issues, shadow systems, and database without boundaries