INTEGRATIVE PROG - Midterms

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/73

encourage image

There's no tags or description

Looks like no tags are added yet.

74 Terms

1
New cards

system integration

the practice of connecting independent applications, data stores and services so that they behave as one coordinated whole

2
New cards

fields, types, required values, encoding, customer records, events, files

what moves in an integrated system?

3
New cards

HTTPS/REST, SOAP, gRPC, message queue, SFTP file drop, direct database links

how does data move in an integrated system?

4
New cards

real time requests or responses, event-driven publishes, or scheduled batch actions

when does data in an integrated system move?

5
New cards

data level, application/API level, business process level, presentation/UI level

four levels of integration

6
New cards

data level

this level of integration involves moving and reconciling records between different systems; records are copied between systems so all of them has what it needs locally

7
New cards

ETL, replication, change data capture, file transfer

examples of data level integration?

8
New cards

application/API level integration

this level of integration involves one system calling another system’s functions; instead of copying files, one system asks another for it, or asks it to do something

9
New cards

REST, SOAP, gRPC, GraphQL, SDKs, webhooks

examples of application/API level integration?

10
New cards

business process level integration

this level of integration involves orchestrating a workflow that spans various different systems

11
New cards

ESB orchestration, BPM engines, workflow/saga patterns

examples of business process level integration?

12
New cards

presentation/UI level integration

this level of integration involves unifying only at the glass, not underneath; the systems stay separate and only the user’s screen is unified

13
New cards

portals, dashboards, embedded widgets, mashups

examples of presentation/UI level integration?

14
New cards

coupling

how much a change in one system forces a change in another

15
New cards

payload

actual data carried in one message or call

16
New cards

idempotency

sending the same request twice has the same effect as sending it once

17
New cards

contract

the published interface that has been agreed upon, involving endpoints, fields, types, errors, etc.

18
New cards

synchronous vs asynchronous

sync: the caller waits for the answer
async: the caller hands off the message and continues

19
New cards

latency vs throughput

how long one message takes to send versus how many messages per second the pipe sustains

20
New cards

ERP, CRM, HRIS

three most common organizational use cases?

21
New cards

ERP

this organizational use case owns money and materials

22
New cards

enterprise resource planning

meaning of ERP?

23
New cards

general ledger, inventory, purchase orders, invoices, production

what kind of data is stored in an ERP?

24
New cards

CRM

this organizational use case owns the customer

25
New cards

customer relationship management

meaning of CRM?

26
New cards

leads, opportunities, contacts, quotes, support cases, campaigns

what kind of data is stored in a CRM?

27
New cards

HRIS

this organizational use case owns the employee

28
New cards

human resource information system

meaning of HRIS?

29
New cards

personal records, positions, org chart, leave, payroll inputs

what kind of data is stored in an HRIS?

30
New cards

e-commerce, warehouse, business intelligence, learning, ticketing

other kinds of organizational use cases?

31
New cards

ERP

a single suite of modules sharing one database, covering the operational and financial core of the business

32
New cards

CRM

the system of record for everyone outside of the organization such as prospects and customers

33
New cards

identity verification, duplicate records, consent and data privacy, two-way sync

problems with CRMs?

34
New cards

item/price/stock lists, invoice and payment status, financial extracts to data warehouses, purchase orders to suppliers

what are expected outputs from an ERP?

35
New cards

HRIS

system of record for everyone inside the organization

36
New cards

identity/active directory, ERP finance, access control, project/billing systems, LMS

what are some systems that depend on the HRIS?

37
New cards

process

this type of data transaction is sequential, completing one action triggers another and so on

38
New cards

fan-out

this type of data transaction is non-sequential, one main event occurs which triggers other events that occur simultaneously and independently of each other

39
New cards

point-to-point, middleware, service-oriented

three integration architectures?

40
New cards

point-to-point

this type of integration architecture is direct, lightly-coupled hardcoded connections between pairs of specific applications; better for simple localized scenarios that require immediate data transfer

41
New cards

middleware

this type of integration architecture is a centralized hub infrastructure routing, translating and managing all system messages

42
New cards

service-oriented

this type of integration architecture is a decoupled, reusable microservices that communicate over standard network protocol; provides high agility when combining existing services and is cloud-ready

43
New cards

rapidly creates an unmanageable spaghetti code

complexity growth of point-to-point integration architecture?

44
New cards

siloed → point to point → middleware → SOA/micro

architectural evolution?

45
New cards

data mapping

a specification linking source fields to target fields, written before implementation

46
New cards

prevents data loss, maintains integrity, foundation for transformation, shared documentation

4 main functions of data mapping?

47
New cards

csv, json, xml

standard exchange formats for data mapping?

48
New cards

comma separated values

what does csv mean?

49
New cards

csv

strengths include: compact, human-readable, bulk operations
limitations include: flat only, no data types

50
New cards

extensible markup language

what does xml mean?

51
New cards

xml

key ideas include hierarchical self-describing tags, unique names and validated structures and types


but it is verbose and heavier to process

52
New cards

javascript object notation

what does json mean?

53
New cards

json

supports strings, numbers, boolean and null

lightweight and readable

but has no built in data type or comments

54
New cards

json

standard for RESTful APIs

55
New cards

structural and value

two categories of transformation?

56
New cards

structure

this category of transformation involves changing the format of the data rather than the data itself

57
New cards

value

this category of transformation involves changing the content of the individual fields to a standardized format

58
New cards

extract, transform, load

ETL pipeline?

59
New cards

ETL pipeline

the process of collecting data from different sources and transforming it into a consistent and usable format

60
New cards

extract

this process of the ETL pipeline involves retrieving data from one or more sources

61
New cards

transform

this process of the ETL pipeline involves cleaning, validating, combining and modifying the data

62
New cards

load

this process of the ETL pipeline involves storing the processed data into the destination system

63
New cards

data cleaning

this type of ETL transformation involves removing invalid or incorrect records

64
New cards

data validation

this type of ETL transformation involves checking whether values are acceptable

65
New cards

standardization

this type of ETL transformation involves making formats consistent

66
New cards

data mapping

this type of ETL transformation involves matching fields from different systems

67
New cards

data integration

this type of ETL transformation involves combining different data sets

68
New cards

aggregation

this type of ETL transformation involves calculating summaries

69
New cards

filtering

this type of ETL transformation involves removing unnecessary records

70
New cards

data warehouses, relational databases, cloud databases, data lakes, analytical platforms

common destination systems for ETL loading

71
New cards

batch processing, incremental processing, real-time processing

3 types of ETL processing?

72
New cards

batch processing

this type of ETL processing is when data is collected and processed in groups at scheduled intervals

73
New cards

incremental processing

this type of ETL processing is when the pipeline only retrieves new or modified records since the previous run

74
New cards

real time processing

this type of ETL processing is when data is processed continuously or with very low latency as events arrive