1/143
Looks like no tags are added yet.
Name | Mastery | Learn | Test | Matching | Spaced | Call with Kai | Chat |
|---|
No analytics yet
Send a link to your students to track their progress
Scraping of data from the web can be accomplished by using which of the following tools:
Microsoft Excel
A python program
A software tool specifically designed for scraping
Copying a table of data from a web page and pasting into Excel
**All of the above are correct
A company might choose to scrape data from a website for which of the following reasons
Follows your sitemap instructions.
The Google Chrome web scraper extension:
Follows your sitemap instructions.
The which of the following is required by the Google Chrome web scraper extension before you can actually scrape the data:
A sitemap
A starting point url
A Google Chrome web scraper extension sitemap uses which of the following to grab data from a page:
A SelectorLink selector type
The Google Chrome web scraper extension might allow us to:
Move from one page on a website to another page on a website in order to collect related data.
An API:
Can be 'called' from an Excel spreadsheet and the data can be used for BI analysis.
An API will have
Multiples urls where each individual url will handle a request for specific resource data.
The organic farms API used in lab; returned data in which format:
JSON
1) Which of the following, (1) money deposited in a bank account, (2) student recording her answer to a question in an online test, (3) customer adding an item to the online shopping cart, are considered transactions in an information system?
All of them
A(n) _____ can replace many applications with one unified set of programs, this system can then be used to manage all its vital business operations.
enterprise resource planning system
Which of the following is true about structured data from an Online Transaction Processing System?
Each transaction is processed at the time of entry
Which of the following is true about structured data from an Online Transaction Processing System?
Point of Sale system that reads a UPC code is an example
Transaction processing systems that support a large enterprise typically store data in a:
Relational database
Which of the following is NOT considered a business intelligence (BI) practice or tool?
Transaction processing controls
Which of the following is considered a business intelligence (BI) practice or tool?
Data extraction
Visualization
Predictive Modeling
Which of the following is an example of unstructured data:
Social media posts
Clickstream data
9) Data used in business intelligence (BI) analysis could come from which of the following sources
a. An OLTP internal system
b. Unstructured data from sources outside the company
c. Unstructured data from sources inside the company
A business intelligence (BI) predictive model that predicts whether a student accepted to the Tippie COB will actually enroll in the Tippie COB; might use:
Structured and Unstructured Data
Big and unstructured data is often stored in a NoSQL database for which of these reasons:
Data is spread over multiple servers leading to better response times for queries
NoSQL databases DOES NOT require a company to
a. Model a business process prior to building the database and then not allow changes to the database
b. Specifically define the data type for each attribute in the NoSQL table
c. Store data in rows and columns
1Multi-valued fields in relational databases are:
Not allowed
When assessing security threats and procedures for endpoints; which of the following is True:
c. All endpoints should have an up-to-date Operating System installed
&
c. All servers should have an up-to-date Operating System installed
After assessing security threats and procedures for IT Systems:
Servers and endpoints might have different security risk levels
17) A company buys and receives products from suppliers that they will sell on their e-commerce site. Once they receive the products from the suppliers and record it in their Purchasing System; they create a spreadsheet of products and quantities received; and then manually update the quantity available for sale in their ecommerce system. Real-time system integration might enable them to:
Sell more products by having more accurate and real-time data
18) A company buys and receives products from suppliers that they will sell on their e-commerce site. Once they receive the products from the suppliers and record it in their Purchasing System; they create a spreadsheet of products and quantities received; and then manually update the quantity available for sale in their ecommerce system. Options for real-time system integration software are:
Buy real-time system integration software from a software provider and implement it
19) Which of the following is an example that would need to use an ETL process:
Merging sales data with advertising data and deploying the merged data into a business intelligence tool
Moving data from the old system into a newly developed and deployed system
20) Before importing data into Access from another source; like Excel; the data should be cleaned. Converting multi valued columns in Excel into multiple columns in Excel prior to moving to Access:
a. Is necessary as Access doesn't uses multi-valued fields
b. Is necessary as Access doesn't converts multi-valued Excel columns into multiple columns when you run a Make Table query
c. Is necessary as Access
doesn't converts multi-valued Excel columns into multiple columns when you run an Append Table query
Types of data that can be moved from the source to Access include:
-Transaction data
-Unstructured data like web ad data
-Data stored in a different relational database
-Sentiment Analysis customer scores stored in your ERP system
An RPO is:
(Recovery Point Objective)
Different depending on each system at a business
Which of the following applies to a company that is OK with losing 12 hours worth of newly entered data:
RPO=12
Employee Fraud
Fraudulent use of purchasing or procurement cards (P-Cards) and fraudulent claims for travel and entertainment expenses (T&E) rank among the most commonly occurring types of employee fraud.
T&E frauds alone account for about 16% of all frauds uncovered.
T & E fraud total losses can represent a significant sum for a company
Data analysis can be particularly effective.
can make up for control weaknesses and rapidly identify where fraud has occurred.
Analyze entire populations of transactional data
Look for various forms of anomalies.
effective way of highlighting a situation that just does not seem to make sense and warrants further investigation.
identify expenses relating to airfares and hotels in non-standard locations
To find fraud
Compare data across different databases and systems (T&E data compare to HR records of when on vacay and bus. vacay)
Responsive design
allows you to create one website that provides an optimal viewing experience across a range of devices- mobile or desktop
knows width of screen
Responsive design :Card and Card-like Layout design pattern.
organize different topics
sections are called cards
moved around according to the device you are on to optimize the view
Mobile Site vs. Responsive Site
For many sites, content and feature parity is the right answer
Mobile E-Commerce
use of mobile devices to enable online transactions
Designing the site with a mobile-first approach requires:
Prioritizing what content goes on the site.
A careful analysis of the functionality needed by users.
Responsive design helps to furnish:
A full experience at the mobile level.
A full experience at the desktop level.
Site design changes as the display used by the user increases in screen size.
Responsive design helps to avoid an inconsistent experience for users on different devices
TRUE
Privacy
refers to an individual's right to control both access to and use of his or her information
Confidentiality
relates to the right of an individual to the protection of their information during storage, transfer, and use, in order to prevent unauthorized disclosure of that information to third parties
Security
consists of the protections or safeguards put in place to secure protected information. It requires that administrative, technical, and physical safeguards are developed and used
Privacy Policy
statement that describes what the organization's practices are usually follow the Fair Information Practices Principles (FIPP)
Evaluating Information quality
Accessibility and volume of information do not equal Quality
Need to know where data comes from and is it bias and does it represent whole population
Evaluating Information quality
know:
Author- qualified?
Purpose- motive behind page- intended audience
Objective- is it opinion, associated with group, appear bias
Accuracy- info verified and reviewed
Reliability and Credibility- why believe, valid
Currency- up to date or when last updated appear?
Web Query in Excel
data ribbon: from web, insert url
import to new sheer or exsisting
What is Web Scraping?
Process of extracting data from websites
You could go website to website and copy and paste data into Excel or word; clean it; then use it.
You could automate the extraction with software; clean it; then use it.
Dashboards
pg395-397 chp. 9
Structured Data
information easily displayed in titled columns and rows which can easily be ordered and processed.
unstructured data
Data does not exist in a fixed location and can include text documents, PDFs, voice messages, emails
ultimately related back to the company's structured data records.
Dashboards
Reporting tool that is informative and geared towards KPI's
report done graphically shows previous year data or current data
in excel or tableau
KPI's
metrics that have:
measure
direction
target
time frame
Example- a university increase (direction) the 5 year graduation rate for incoming freshman(measure) to at least 80%(target) starting with the graduating class of 2022 (time frame)
Enterprise Resource Planning System
Ensures that information can be shared across all business functions and all levels of management to support the running and managing of a business
Enterprise Resource Planning System used in areas like
Product supply and distribution
Sales and marketing
Human resources
Manufacturing
Accounting and taxes
ERP (Enterprise Resource Planning)
A set of integrated programs that manage a company's vital business operations for an entire organization
Advantages of ERP
Improved access to quality data for operational decision making
Elimination of costly, inflexible legacy systems
Improvement of work processes
Opportunity to upgrade and standardize technology infrastructure
Why build and re-invent the wheel, when you can buy it?
What is the Cloud?
Cloud computing is the on-demand delivery of compute power, database storage, applications, and other IT resources through a cloud services platform via the internet with pay-as-you-go pricing
Infrastructure as a Service (IaaS):
an instant computing infrastructure, provisioned and managed over the Internet.
Computers (virtual or on dedicated hardware), networking, and data storage space hardware.
helps you avoid the expense and complexity of buying and managing your own physical servers and other datacenter infrastructure.
Platform as a Service (PaaS) includes IaaS (the infrastructure) :
Like IaaS, PaaS includes infrastructure—servers, storage, and networking—but also development tools, business intelligence (BI) services, database management systems, and more.
Development framework.
PaaS provides a framework that developers can build upon to develop cloud-based applications
Analytics or business intelligence
Tools provided as a service with PaaS allow organizations to analyze and mine their data, finding insights and patterns and predicting outcomes to improve forecasting, product design decisions, investment returns, and other business decisions.
Additional service components that can be incorporated into your application.
Workflow, directory, security, and scheduling
Software as a Service (SaaS):
provides you with a completed product that is run and managed by the service provider.
"end user applications"
do not have to think about how the service is maintained or how the underlying infrastructure is managed; you only need to think about how you will use that particular application software
ex. web based email- send and recieve dont need to manage features
API
like a user interface but used for consumption by software
a technology that allows applications (software programs) to talk to one another.
User interface
app- allows you to talk to software and recieve info back
amazon echo- voice user interface
UI are what allow us to interact with machines.
Keyboards
Screens
Xbox Kinect is built upon
API's
enable websites, web and mobile applications to build applications, using resources that were completely out of reach in even the recent past
"request and response"
API examples
in class example- excel with weather type in zip and it pulls the weather info from that area
real estate site- "Zillow" pulls data through api from some data source to get info such as mortgage rates, local crime- demographics- schools- taxes- nearby places
API return
JSON
APIS
need authentication key- rely on for response
and have terms of service- can use data right away then dispose of it cant keep it
Revival store
uses shopify for POS as its api to pull info its a cloud based software so they just need a tablet
API consumers have a need, a problem they need to solve.
To get information that would be time-consuming to get otherwise.
To get information that you can't get otherwise.
To automate a news app that needs live data
To use it as a more direct interface for reading and writing data to a service.
API
Example: you use MailChimp to manage all of your mailing lists. You want to be able to automatically add and remove people from lists when certain things happen instead of someone having to manually manage those lists
RESTful API
acronyms for Representational State Transfer and Application Programming Interface.
REST
a data architecture and design methodology that produces predictable and consistent outputs and behaviors by receiving a set of standard methods and returning standardized structured data, typically JSON or XML, called the resource.
APIs that us the REST architecture pattern are said to be RESTful.
RESTful API
When the client submits a request, in this case to get a resource, the RESTful API receives that request, identifies the requested resource, figures out what data needs to be gathered, and in what format, creates a representation of the data matching the requested format, and sends it all back to the client.
The API's job is to receive requests, process data, and send responses.
You provide an interface for your data to be quite literally consumed by whatever client comes knocking.
Client-Server:
: a pull-based interaction style(Client request data from servers as and when needed)
POST
Clients can modify (add to) the resource using HTTP POST
POST
is a way to send hidden data as part of a request, data that doesn't get listed as part of the URL.
You use POST all the time when you use the web. When you fill out a form to buy something online, it submits your payment information using POST, because it would be bad if you loaded a URL that put that information out in the open, like:
http://www.amazon.com/checkout?creditcardnumber=1234567812345678
POST is generally used when you need to modify data in a database
SWAPI
Base API URL
The Base URL is the root URL for all of the API methods
The Base URL for swapi is:
https://swapi.co/api/
Authentication
Swapi is a completely open API. No authentication is required to query and get data. This also means that we've limited what you can do to just GET-ing the data.
JSON Schema
The response: JSON
when use web API response can be
Some data - this is what you want.
An explanation of why your request failed - this might tell you that you failed to supply a required parameter, you're over your rate limit, you need to supply authentication to make that particular request, or there was some other problem with the request.
JSON
JavaScript Object Notation
waterfall system development process
A sequential, multistage system development process in which work on the next stage cannot begin until the results of the current stage are reviewed and approved or modified as necessary
waterfall system phases
There are six phases:
Investigation
Analysis
Design
Construction
Integration
Testing and implementation
system investigation
The initial phase in the development of a new or modified business information system whose purpose is to gain a clear understanding of the specifics of the problem to solve or the opportunity to address.
steps of the investigation phase
Review systems investigation request
Identify and recruit team leader and team members
Develop budget and schedule for investigation
Perform investigation
Perform preliminary feasibility analysis
Prepare draft of investigation report
Review results of investigation with steering team
Technical feasibility:
component of preliminary analysis
examines whether a project is feasible within the current limits of available technology
economic feasibility
component of preliminary analysis
determines whether the expected benefits associated with the project outweigh the expected costs sufficiently to make the project financially attractive
Legal feasibility
component of preliminary analysis
the process of determining whether laws or regulations may prevent or limit a system development project
Operational feasibility
component of preliminary analysis
the process of determining how a system will be accepted by people and how well it will meet various system performance expectations
.
Schedule feasibility:
component of preliminary analysis
the process of determining whether a project can be completed within a desired time frame
system investigation- prepare draft
A systems investigation report that summarizes the results of the systems investigation and recommends a course of action
Possible actions
system analysis
The overall emphasis of system analysis is on:
Gathering data on the existing system
Determining requirements for the new system
Considering alternatives within identified constraints
Investigating the feasibility of alternative solutions
system analysis steps
Identify and recruit team leader and team members
Develop budget and schedule for systems analysis activities
Study existing system
Develop prioritized set of requirements
Identify and evaluate alternative solutions
Perform feasibility analysis
Prepare draft of systems analysis report
Review results of systems analysis with steering team
system design
creates a complete set of technical specifications that can be used to construct the information system
system design steps
Identify and recruit team leader and team members
Develop schedule and budget for systems design activities
Design user interface
Design system security and controls
Design disaster recovery plan
Design database
Perform feasibility analysis
Prepare draft of systems design report
Review results of systems design with steering team
Construction
System construction converts the system design into an operational system
Steps of the system construction phase
Code software components
Create and load data
Perform unit testing
Construction
Create and Load Data:
This step involves making sure that all files and databases are populated and ready to be used with the new information system
It may be necessary to write a program:
To read the old data files from several sources
To reformat the data to be compatible with the new system
Merge data sources together