Big Data

List the three Vs of big data

• volume

• velocity

• variety

Define volume

The amount of data which has to be stored over multiple servers

Define velocity

How quickly the data is created and how fast it moves

Define variety

data is of many different types

How can patterns be found in big data?

using machine learning

Why is functional programming used in big data?

• stateless - no side effects

• immutable data structures

• higher order functions

Define immutable

can’t be overwritten

What is a graph schema

where nodes represent entities containing properties, and edges represent relationships

Why is big data’s lack of structure an issue?

• analysing data is more difficult

• relational databases are not appropriate as data must follow row column format

What does big mean in regards to big data and why is it an issue?

data does not fit on one server, which relational databases don’t scale well on

What is the fact based model?

every individual piece of information is stored as a fact with a timestamp that is immutable

What is a graph schema?

a graph of nodes and edges to represent the structure of a dataset

What do nodes represent on a graph schema?

entities and their properties

What do edges represent on a graph schema?

relationships between entities

What is a high order function?

a function which takes a function as an argument and/or returns a function

What does stateless mean?

produces no side effects