Functional Programming and Big Data

What does “Map“ do in Functional Programming?

Map is used in order to apply a select function to each element within a list. In return leaving a list of results.

What does “Filter“ do in Functional Programming?

With the definition practically being in the name. Once “Filter” is used upon a data structure commonly a list all the available data will be used to create a brand new corresponding data structure following the conditions set along with “Filter“

What does “Reduce“ or “Fold“ do in Functional Programming?

Has the ability to reduce lists down to a single value by repeatedly combining the list of values.

What is a Higher Order function?

Theses special functions either take a function as an input (argument), returns functions as results or both.

What are 3 Higher Order Functions?

Map, Filter and Reduce or Fold

What does Foldl mean? (Fold Left)

It means that when folding we should start from the left and go right.

Vise Versa for Foldr (Fold Right)

What are the main Features of Functional Programming?

• Functions act as building blocks with them coming together to create statements.

• Every function accepts an input and returns the output.

• Stateless & Immutable.

What does Immutability mean?

This means that variables cannot be changed after they are set.

What is a first-class object?

A function is considered a first-class object. As well as simple data types:

• Integer

• Char

etc.

What is the name given to the set of outputs from a function?

Co-Domain

What is the name given the inputs of a function?

Domain

What do Functional Programs use as First Class Objects?

Functions

What is a rule for Composition Functions?

The Domain of one function must be the same as the co-domain of the other.

What is statelessness?

in functional programming it means that it doesn’t matter the order considering how and where functions get called.

What is a fact-based model?

A model used in order to represent, model, query on the same level as Big Data.

What is an alternative to ER Models?

Fact-based models just instead of entities they make use of facts.

What is a “Fact“ considering fact-based models?

Looking at ER Models and Entities a “Fact“ is like one of those except that they cannot be deconstructed and each fact gets timestamped.

What are 3 facts about ‘Facts‘?

• canNOT be deconstructed

• They are eternally true

• They must all be timestamped

What are the 3 key parts of a Graph Schema?

• Nodes — (Represent core entities in Oval form)

• Edges — (Directed or Undirected connecting lines between Nodes)

• Properties — (Inside Rectangle boxes)

What is meant by Six Degrees of seperation?

Like that one video stating that most users are more like 4-6 people away from the Gaben Logan Newell.

Technically the longer and the more users that become apart of this net mean that it should both grow larger in numbers as well as further depending on how the pointer leans.

What are the 3 big V’s

• Volume

• Variety

• Velocity

What is Big Data?

An overarching term referring to all data that wont fit its common container.

How is useable information extracted from Big Data?

By using Machine Learning to notice patterns.

What is the best Programming Paradigm for Big Data?

Functional Programming

What does Immutability mean?

It means for example in Functional Programming the value for the variables don’t change after being set.

Why can’t the common table contain Big Data?

Big Data doesn’t conform to the simplicity of Rows and Columns.

Why is Big Data so hard to analyse?

Because of its unstructured nature.

What are 3 Benefits of Functional Programming?

Functional Programming makes it easier to write:

• Correctly

• Efficiently

• with distributed code (Somewhat encapsulated)