Data Analytics Notes
Introduction to Data Analytics
1.1 Meaning and Scope of Data Analytics
- Business data analytics transforms business operations by using processes, tools, and techniques to gather insights from business data.
- Companies analyze past and present data to identify trends, patterns, and opportunities, optimizing operations, sales, and strategic decisions.
- It transforms raw data into actionable information.
- Business enterprises generate massive data; business data analytics helps uncover hidden patterns and trends.
- It helps enterprises understand customers, optimize processes, and drive strategic decision-making.
- Data analytics can resolve business issues like:
- Understanding customers better
- Improving marketing campaigns
- Developing new products and services
- Reducing costs
- Increasing efficiency
- Leveraging data analytics provides a competitive edge and enhances performance.
- Insights from data analytics enable data-backed decisions that are likely to succeed.
- Business data analytics uses data analysis tools and techniques to extract valuable insights from business data.
1.1.1 Data and Data Types
- Data: Raw, unprocessed pieces of information (facts, numbers, symbols, audio, visual observations) lacking context.
- Information: Structured, organized, and presented data in a meaningful format.
- Data types: Attributes applicable to data, enabling correct identification, understanding, and interpretation by a computer program.
- Classification of Data Types:
- Primitive Data Types: Basic data storage elements representing simple values.
- Numeric: Stores numbers, including decimals (e.g., 28, -4.36, 10.001).
- Integer: Stores whole numbers (positive, negative, or zero) (e.g., 21, -15, 0).
- Character: Stores a single character (e.g., 'x', '#', '4').
- Boolean: Stores logical values (True or False).
- Non-primitive Data Types: Complex data structures organizing and storing large datasets.
- Array: Stores a collection of data items of the same type, retrievable and modifiable using an index (e.g., "[1, 2, 3]", "[A,B,C]").
- String: Stores an ordered collection of characters (letters, symbols, numerical values, blank spaces) (e.g., "Alpha@123").
- List: Stores an ordered group of data items of different data types (e.g., "[Name, Address, Phone No.]").
- Dictionary (or Map): Associative data structure storing key-value pairs (e.g., "get(firstname) - Ampreet; get(lastname) - Kaur").
- Primitive Data Types: Basic data storage elements representing simple values.
- Data may be categorized, analyzed, and interpreted based on its level of measurement.
- Nominal: Categorical data without order or ranking. It is essentially a label to give distinctive meaning, e.g., month (January, February, December); gender (male, female, others); movie genre (action, comedy, drama).
- Ordinal: Categorical data with ranks or order, but intervals between ranks may not be of the same magnitude. E.g., customer satisfaction survey ratings ('highly satisfied', 'somewhat satisfied', 'neutral', 'somewhat dissatisfied', 'highly dissatisfied').
- Scale: Categorical data with numerical values, according meaningful ranks or order. Intervals between successive values are of equal magnitude. Classified into ratio and interval data.
- Ratio data has a true zero indicating absence of value (e.g., zero age, weight, speed).
- Interval data has an arbitrary zero point not indicating the absence of value (e.g., 0 degrees Celsius or Fahrenheit, year zero).
- Understanding data types and levels of measurement is essential for data collection, organization, analysis, and interpretation to derive conclusions and solve problems.
1.1.2 Meaning of Data Analytics and Data Science
- Data analytics involves data collection, organization, and storage to analyze, interpret, and infer meaningful insights for informed decision-making and alternative strategies.
- It also includes data cleaning and transformation into an easily understood format for data-driven decisions and competitive advantage.
- Data analytics helps uncover patterns, trends, and correlations, improving operational efficiency, customer insights, and strategic planning.
- It unlocks the value of data and drives organizational success by identifying trends, optimizing processes, and predicting outcomes.
- Big Data analytics and Data Science are associated with Data Analytics.
- Data science is an interdisciplinary field involving statistics, mathematics, and computer programming.
- It derives knowledge from data and applies it for predictive purposes using expertise about underlying processes, systems, and algorithms.
- Application of t-values and p-values from statistics in identifying significant model parameters in a regression model is an outcome of data science.
- Big data analytics analyzes huge data volumes to solve complex problems, requiring significant storage and computing capability.
- Analysis of geospatial data captured by satellite to identify weather patterns is an example.
- Data analytics is collecting, organizing, examining, cleaning, and transforming raw data into information for informed decisions.
- It's a tool usable in any organization and industry.
- Elements of the data analytics process:
- Data Collection: Gathering data from various sources (databases, surveys, social media).
- Data Cleaning: Identifying and rectifying errors, discrepancies, or inconsistencies, including removing duplicates, redundancies, formatting consistently, and filling in missing values.
- Data Transformation: Transforming cleaned data into a suitable format for analysis, including combining datasets, creating new variables, and summarizing data.
- Data Analysis: Analyzing data to identify patterns, trends, and relationships using statistical analysis, machine learning, and data visualization. Machine learning is a branch of AI that enables machines to imitate intelligent human behavior.
- Information Communication: Communicating results to stakeholders in a clear and concise manner through reports, charts, and dashboards.
1.1.3 Data and Data Analytics
- Data: Raw facts, figures, and statistics collected and stored for analysis to draw inferences about events.
- It appears in various forms (text, numbers, images, videos) and is typically stored in databases or data repositories.
- Data analytics: Collecting, organizing, storing, examining, interpreting, and deriving insights from data to make informed decisions and drive business strategies.
- It involves using tools and techniques to analyze data, uncover patterns and trends, and extract valuable information to optimize processes, improve decision-making, and gain a competitive advantage.
- Data analytics transforms raw data into actionable insights to help organizations achieve their goals and objectives.
- Data analytics depends on the availability of data.
1.1.4 Business Data Analytics and Business Intelligence
- Data Analytics: The analysis of data, big or small, to understand patterns, trends, and relationships within datasets to explore and expose knowledge.
- Example: Analyzing data related to various classes of people using guest houses and hotels.
- Business Data Analytics: The application of data analytics to a business environment to explore and understand business opportunities.
- Example: Offering specific discounts to different classes of people using guest houses and hotels based on the volume of business they generate or have the capacity to generate.
- Goal: Glean practical and actionable business insights to boost efficiency, productivity, and revenue.
- Business analytics and business intelligence (BI) are related but different.
- Business Intelligence (BI): Gathering data from all sources and preparing it for use by business data analysts.
- BI reveals what has happened, whereas business analytics divulges why it has happened and when it may occur again.
- The main task of a Business Analyst is to identify the weak areas of the corporate enterprise.
- Growth Drivers of Business Data Analytics:
- The Ever-Rising Volume and Variety of Transactions: Modern businesses generate more transactions from customers, suppliers, and service providers. Each transaction creates data that needs to be processed for potential insights.
- The growing Importance of Customer Experience: Businesses focus on ensuring a positive customer experience, which is better inferred through data analytics. Analyzing customer data enables businesses to personalize marketing campaigns, improve products and services, and provide better customer support.
- The Need for Data-driven Decision Making: Businesses rely on a scientific and fact-based foundation for better decision-making using Business Data Analytics.
- Availability of Cloud: The cloud has made it easier and more affordable for businesses to store, access, and analyze data anytime and from anywhere, eliminating the need for expensive hardware and software infrastructure.
- Growth of Artificial Intelligence (AI) Tools and Machine Learning (ML): AI and ML transform data analytics by automating tasks, identifying patterns, and making more reliable predictions.
- Several open-source software packages have contributed to the growth of business data analytics.
- Python, for example, is an open source, free to use programming language that has a rich library support for data analysis.
- R programming environment also offers various data sets, documentation on its packages, and ready-made algorithms for performing data analytics
1.1.5 Scope of Business Data Analytics (BDA)
- The scope of Business Analytics is expanding, and its relevance across all verticals cannot be undermined.
- Business Data Analytics is not just about processing numerical data; it is also about interpreting the data and suggest business strategies.
- Corporates need engage qualified professionals to analyze the data, interpret, and apply insights, or the data and its analytics is of little value.
- Real-time applications of Business Data Analytics are becoming popular among business enterprises.
- Scope of Business Data Analytics with respect to core functional areas and business functions:
1. Manufacturing:
Business data analytics improves efficiency, quality, and profitability.
Manufacturers leverage analytics to optimize operations by analyzing data to improve production, forecast demand, manage supply chains, and enhance quality control.
They seek to reduce costs by optimizing processes, predict and prevent equipment failures, and improve overall efficiency.
They gain a competitive advantage by making data-driven decisions for better business outcomes.
Common applications in the manufacturing sector:
Predictive Maintenance: Predicting equipment failure times by analyzing data from sensors and scheduling maintenance in advance to prevent downtime and improve equipment effectiveness.
Supply Chain Optimization: Optimizing the supply chain by identifying bottlenecks to improve inventory management, reduce costs, and improve delivery times.
Quality Control: Improving quality control by identifying trends in product defects and taking corrective action by comparing product data with specifications.
Demand Forecasting: Forecasting product demand to plan production volumes and avoid stockouts or overproduction.
Process Improvements: Identifying areas for improvement by identifying bottlenecks and inefficiencies, measuring progress, improving decision making and continuous performance monitoring.
- Six Sigma is a data-driven methodology that focuses on eliminating defects in processes.
- Lean Six Sigma is a combination of lean manufacturing principles and Six Sigma methodology that focuses on reducing waste and improving efficiency.
- Kaizen is a Japanese philosophy that focuses on continuous improvement.
2. Retail Sector:
- BDA empowers retailers with valuable insights to make informed decisions and optimize operations.
- Main applications of BDA in retail:
- Customer Segmentation and Targeting: Analyzing customer purchase history, demographics, and loyalty program data to segment customers into distinct groups with similar characteristics and buying behaviors. This enables targeted marketing campaigns, personalized product recommendations, and targeted promotions.
- Inventory Management: Optimizing inventory levels by analyzing sales trends, seasonal fluctuations, and supplier lead times to prevent stockouts, reduce storage costs, and ensure that the right products are available at the right time. Predictive analytics can be used to forecast future demand and adjust inventory levels accordingly.
- Pricing Strategy: Leveraging BDA to decide optimal prices considering competitor pricing, product cost, customer demand, and price elasticity. This enables retailers to identify the price point that maximizes profitability.
- Store Operations: Analyzing data from point-of-sale systems, foot fall, and video surveillance to gain insights into store layout, staffing levels, and checkout efficiency. This optimizes store layout, staffing schedules, and reduces wait times.
- Fraud Detection: Detecting fraudulent transactions by analyzing purchase patterns and identifying inconsistencies and anomalies. Large purchases, frequent returns, unusual purchase locations, or a sudden spike in transactions can be red flags. Unexplained discrepancies between inventory records and actual stock counts can indicate internal theft of inventory. Analysis of Point-of-sale (POS) from cash registers can reveal unusual activity patterns.
- Supply Chain Management: Improving the efficiency of the supply chain by tracking inventory levels, identifying bottlenecks, and optimizing transportation routes.
- Site Selection: Identifying the best locations for new stores by analyzing demographic data, traffic patterns, and presence of competitors.
3. Communication Sector:
- BDA improves communication.
- Key applications:
- Understanding Customer Behaviour and Preferences: Analyzing data from various communication channels to understand how customers prefer to be contacted and the kind of content that resonates with them. This enables targeted communication strategies.
- Optimizing Communication Channels: Assessing the effectiveness of different communication channels to identify the channels that generate the best results and optimize communication efforts.
- Improving Messaging and its Content: Analyzing customer engagement with communication to tailor messaging for different audiences and communication channels. This leads to more effective communication that drives conversions or brand loyalty.
- Identifying Communication Gaps: Identifying areas in which communication might be missing or at a rudimentary stage. Businesses can use this information to identify and address communication gaps to bring about an improvement in overall communication efficiency.
- Measuring ROI of Communication Efforts: Tracking key metrics like website traffic, conversion rates, and customer satisfaction. This helps to measure the return on investment (ROI) of communication efforts and understand the most effective communication strategies.
4. Financial Sectors:
- BDA plays a critical role in main sectors of the finance industry, such as banking and insurance.
- BDA helps extract insights that help organizations maneuver their way through trickly terrains.
- Financial sector enterprises turn to business analysts to optimize budgeting, banking, financial planning, forecasting, and portfolio management.
- Key functionalities provided by BDA in the finance sector:
- Risk Management: Assessing the creditworthiness of loan applicants to make informed lending decisions and minimize bad debts. Developing credit scoring models to predict the likelihood of loans turning bad in the future. Identifying fraudulent transactions and suspicious activities.
- Investment Decisions: Leveraging historical market data and trends to make better informed investment suggestions to clients. Identifying undervalued stocks and optimizing investment portfolios.
- Customer Segmentation: Segmenting customers on the basis of demographics, financial behaviour, and risk profiles. This helps them to offer tailor-made financial products and services to specific customer segments and thereby improve the effectiveness of marketing strategies.
- Operational Efficiency: Analyzing operational data for identifying areas of improvement to streamline processes within a financial enterprise, bringing about cost savings and increased efficiency.
- Regulatory Compliance: Ensuring compliance with regulations by automating reporting processes and enabling them to submit their period statements to regulatory bodies on time and identifying potential breaches in such reporting activities.
5. Credit Card Business Organizations:
- Credit and debit cards gather information about consumer spending habits, financial situation, behavior trends, demographics, and lifestyle preferences.
- BDA applications turn data into actionable insights to improve their bottom line and customer satisfaction.
- Key applications of business data analytics in credit card business:
- Detection and Prevention of Frauds: Identifying fraudulent activities such as unauthorized purchases, reckless spending etc. Analyzing spending patterns and comparing them to customer profiles, can flag suspicious transactions in real-time and thereby prevent financial losses by blocking suspicious transactions.
- Customer Segmentation and Targeting: Categorizing customers on the basis of demographics, spending habits, and creditworthiness. This enables targeted marketing campaigns with personalized credit card offerings, rewards programs, and interest rates.
- Creditworthiness Assessment and Risk Management: Assessing the creditworthiness of new applicants and also that of existing customers from time to time involving analyzing income, debt-to-income ratio, and also the credit history to determine credit limits and interest rates effectively.
- Customer Relationship Management (CRM): Understanding customer behaviour and preferences to allow for personalized communication, improved customer service experiences, and increased customer retention rates.
- Product Innovation and Development: Analyzing customer spending patterns to reveal trends and unfulfilled needs. This information can be used to develop new credit card products with features that benefit and cater to specific customer segments.
- Regulatory Compliance: Ensuring compliance with various regulations by tracking and reporting the transactions and customer data securely on time.
6. Healthcare Sector:
- Healthcare organizations utilize BDA to improve patient outcomes, optimize resource allocation, and enhance operational efficiency.
- Healthcare providers analyze patient data treatment outcomes, and operational processes, can identify areas for improvement, reduce costs; identify frauds and deliver better quality care.
- Hospitals use BDA to track patient outcomes, identify patients who are at higher risk of readmission and subsequently take steps to prevent them from being readmitted.
- Key applications of BDA in healthcare:
- Resource Management: Predicting staffing needs by analyzing patient volume data, optimizing staffing needs, reducing wait times and improving patient satisfaction. Optimizing inventory levels of medical supplies and medications by analyzing usage patterns, thereby reducing wastage and ensure that essential supplies are always in stock.
- Financial Performance: Identifying areas of high spending, such as unnecessary readmissions or inefficient processes, implementing cost-saving measures to achieve cost reduction. Tracking and improving the efficiency of medical billing and coding processes to ensure timely and accurate reimbursement from insurance companies.
- Patient Care: Analyzing patient data for identifying individuals at high risk for developing chronic diseases and enabling personalized healthcare, by analyzing a patient's medical history, genetics, and lifestyle factors to tailor treatment plans.
- Other Applications: Identifying patterns of fraudulent activity in healthcare claims and targeting healthcare services and educational programs to specific patient population, thereby improving public health outcomes.
Future of Business Data Analytics
- The future is bright due to continuous growth in data collection, storage, and analysis techniques.
- Emerging technologies (AI and machine learning) will further enhance capabilities.
- Effective leveraging of data processing technologies provides a competitive advantage.
- Driven by rising data volume, advancements in computing, and recognition of data-driven decisions.
- Key trends:
- Real-time and Predictive Analytics: Transitioning from static reports to real-time data analysis using IoT and social media. Predictive analytics is anticipated to enable businesses in anticipating future outcomes.
- Data Democratization: Making analytics tools user-friendly and accessible to empower employees at all levels to make data-driven decisions.
- Focus on Data Governance and Security: Ensuring data quality, security, and compliance with privacy regulations.
- Rise of Citizen Data Scientists: Increasing the number of business users with the ability to analyze data without extensive technical expertise.
- Integration of AI and Machine Learning: Automating business data analysis tasks and freeing up human analysts for strategic work. Generative AI techniques are expected to open doors to new possibilities in exploration and analysis of business data.
- Cloud-Based Analytics: Cloud platforms for flexibility, scalability, and cost-efficiency in data storage and analytics.
- Focus on Decision Intelligence: Integrating data analysis with human psychology and behavioural science to bridge the gap between data insights and actions.
- The future lies in empowering organizations to leverage data for competitive advantage, operational optimization, and data-driven decision-making.
- Businesses that harness data effectively will be better positioned to navigate the competitive landscape, identify new opportunities, and achieve sustainable success.
1.2 Classification of Data Analytics
- Data analytics may be classified based on what is intended to be achieved with data insights.
- Four main types: Descriptive, Diagnostic, Predictive, and Prescriptive. Also, Cognitive.
- Descriptive Analytics: Summarizes past data to gain insights into what has already happened.
- Common applications: Generating summary reports, calculating Key Performance Indicators (KPIs), and creating descriptive dashboards.
- Diagnostic Analytics: Digs deeper into the reasons behind the patterns and trends identified by descriptive analytics.
- Helps understand the root causes of underlying issues and identify areas for improvement.
- Techniques used: Data mining and data drill-downs.
- Predictive Analytics: Uses insights of historical data to predict trends and expected outcomes in the future.
- Useful for forecasting sales, identifying potential risks, and making data-driven decisions.
- Techniques used: Statistical modeling and machine learning.
- Prescriptive Analytics: Suggests and recommends actions based on insights from predictive analytics.
- Helps optimize business processes, make better decisions, and gain a competitive advantage.
- Techniques used: Optimization and simulation to suggest the best business strategies.
- Cognitive Analytics: An advanced form of analytics that uses artificial intelligence (AI) and machine learning (ML) to extract and explore insights from data analysis.
- Mimics human-like intelligence because of its ability to understand the context and meaning of derived information, and improve over time with additional information.
- Has the ability to handle unstructured data, learn and improve by itself and is capable of understanding the context.
1.2.1 Descriptive Analytics
- Descriptive business data analytics involves analyzing historical data to understand and describe past events.
- It focuses on summarizing and presenting data in a meaningful way to gain insights into trends, patterns, and relationships.
- It helps businesses understand and identify key metrics, track progress towards goals, and current performance.
- Advanced techniques (predictive and prescriptive analytics) use the outcome of descriptive analytics as their foundation.
- Descriptive analytics is all about understanding what has actually happened in the business enterprise.
- The common tools that are employed for this purpose include basic statistical analysis, preparing reports, and Key Performance indicators (KPIs).
- Common tools: Basic statistical analysis, reports, and Key Performance Indicators (KPIs).
- Examples of KPIs: Sales figures, customer acquisition cost, or website traffic.
- Descriptive Analytics in Action:
- Tracking Performance Over Time: can track performance of the business enterprise, by comparing sales and operating results across the years and also through monitoring website traffic patterns and trends
- Identifying Areas for Improvement: by discovering and identifying the products with high sales volume and also the most preferred products of customers, can pinpoint other products and service areas where improvements are required.
- Benchmarking against Industry Standards: helps understand how business enterprise stands up against competitors by using benchmarks against industry standards.
- Descriptive Analytics in Business Functions:
*Marketing: creates a new demand or tits a product into an existing market by focusing on moving the product from the company to the market through product launches and awareness campaigns.
*Customer Behaviour: The analysis of website traffic, social media engagement, and customer surveys, helps business enterprises or marketers gain insights into customer demographics, preferences, and buying journeys, enabling for targeted campaigns, and messaging that resonate with specific customer segments.
*Optimization of Marketing Campaigns: The measurement of the success of marketing initiatives. Marketing teams can track metrics like click-through rates, conversion rates, and cost-per-acquisition to identify what works and what does not work for the business enterprises. The information revealed by descriptive analytics helps to make adjustments in campaigns on a real-time basis to maximize return on investment (ROI).
*Efficient Allocation of Resources: The facilitation of an efficient allocation of resources by providing clarity about the marketing channels generates the best results, and thereby enabling marketing teams to allocate resources through budget optimization
*Tracking Progress Towards Goals:The tracking of progress towards goals for campaigns and overall marketing efforts that are set by marketing teams by providing clear data on key performance indicators (KPIs). This measurement of progress in goals allows for course correction and timely adjustments to the marketing strategies. The analysis of social media engagement metrics is used to identify the campaigns that are most effective.
*Sales: Sales fulfil the demand and sales focuses on moving the product from the market to the customer.
*Monitoring Performance: Sales teams may keep track of Key Performance Indicators (KPIs) such as sales rep performance, revenue by product or region, and sales growth over time. As a result, sales teams are able to identify strengths and weaknesses, and thereby adjust sales strategies accordingly.
*Understanding the Customer: Sales teams get an understanding customer behavior by analyzing customer purchase history, demographics, and interactions, thereby identify trends and patterns. This is achieved through descriptive analytics, which help them to personalize outreach, target high-value customers, and tailor promotions for better results.
*Sales Pipeline Analysis: The sales,team, by identifying bottlenecks and analyzing conversion rates at each stage, can improve the efficiency of the sales process through tracking the progress of leads and deals through the sales funnel.
*Sales Forecasting: Allows the business to explore, organizing and summarizing historical sales data that is used to forecast sales trends, thereby helping with budgeting, resource allocation and setting realistic sales targets.
*Benchmarking: Enables Sales Benchmarking by allowing business enterprises to compare their sales performance against industry averages or the sales achieved by competitors. This Benchmarking may further reveal areas for improvement and identify best practices to emulate.
*In essence, descriptive analytics provides a strong foundational structure for data-driven sales decisions, which is facilitated by exploring, summarizing and visualizing past sales data, thereby equipping the sales teams to improve performance, optimize strategies, and achieve better sales results.
*Finance: Descriptive analytics provide reports to track revenue and expenses over a period of time.
*financial performance measurement: financial statements such as the income statements and balance sheets as well as comparing the financial statements across various periods
* enabling trend identification in financial parameters through descriptive analytics
*financial ratio calculation to relate different parts of the enterprise's financial statements
*investment analysis performed through descriptive analytics allowing investers to evaluate potential investments
*Operations and Production: Descriptive analytics is a powerful tool used in operational and production activity to understand past performance and identify areas for improvement.
*Used to monitor a multitude of data (KPIs) that is produced on the production lines
*helps to identify trends, revealing seasonal dips or increase in defect rates
*Manufacturing enterprises can conduct benchmarking of their operations by comparing their performance against industry standards or their own timeline
*HRM: Historical personnel patterns are summarized and analyzed to identify trends. Furthermore, Benchmarking is used to judge HR's metrics against sector standards, and insights such as demographics are gleaned from the analysis to assess future goals. - HR team can identify trends in historical data pertaining to labour-turnover, absenteeism in specific department, and time to hire.
- Further, such trends may be investigated to understand the root causes of absenteeism and higher labour turnover.
- descriptive analytics allows Benchmarking by HRprofessionals
Benefits of Descriptive Analytics:
- Provides a clear understanding of business health.
- Helps monitor progress towards goals.
- Identifies areas and issues where deeper analysis (predictive or prescriptive) might be useful.
- Specifically, it offers several benefits to organizations, as explained below:
- Understanding Past Performance: Historical data provides insights into past performance, trends, and patterns. This understanding may help identify areas of strengths and weaknesses, as well as opportunities for improvement.
- Data Visualization: Charts, graphs, and dashboards make it easier for stakeholders to understand and interpret complex data, thereby enabling better informed decision-making.
- Identifying Key Metrics: Key performance indicators (KPIs) and metrics critical in measuring success and tracking progress towards achievement of business goals, allowing businesses to focus on important matters and prioritize resource utilization effectively.
- Improving Operational Efficiency: Analyzing historical data to identify inefficiencies, bottlenecks, and areas for optimization. This insight can lead to process improvements; cost savings, and increased operational efficiency.
- Enhancing Strategic Planning: Provides a solid structural foundation for strategic planning by offering a comprehensive overview of the business enterprise's data landscape. The business enterprises are enabled to make data-driven decisions, se realistic goals, and develop effective strategies for growth and success.
- in hands of business data analysts working for business enterprises of all sizes to turn data into insights that can be used to improve decision-making and overall performance.
1.2.2. Diagnostic Analytics
- focuses on uncovering the root causes of trends and patterns within business data to improve their operational performance.
- using diagnostic analytics, can deep dive into developing an understanding of their data and make better decisions that may result in greater success.
- goes beyond simply describing what has happened (that is descriptive analytics) or predicting what might happen in the future (that is predictive analytics) to explain why something is happening.
- The process of diagnostic analytics involves:
- Identify an Anomaly (or an area) for Improvement:
- Collect Relevant Data:
- Clean and Prepare the Data:
- Explore the Data:
- Formulation of Hypothesis:
- Testing of Hypothesis:
- Draw Inferences:
- Appropriate Action:
Techniques of Diagnostic Analytics
*Data Mining: A process to extract hidden patterns and trends from a large dataset, and thereafter explore the relationships within such datasets.
*Data Drilling Down: This technique is the process of zooming in on specific data points to dig deeper into specific data points to understand the underlying causes and also to get a more detailed view.
*Statistical Analysis: This technique of statistical analysis is also used to test hypotheses and identify correlations between variables.
*Regression Analysis: This technique is used to model the relationship between a dependent variable and one or more independent variables.
Benefits of Diagnostic Analytics
*Identify and Resolve Problems:
*Improved Decision-making: Making decision based on evidence
*Increased Productivity: Diagnostic analytics can help businesses identify areas where they are wasting time or money.
*Reduced Costs: Diagnostic analytics, by identifying and solving problems at an early stage, can help save money on corrective actions and thereby reduce the costs.
*Develop Better Products and Services:
*Boost Customer Satisfaction and Loyalty:
diagnostic analytic applications include
*understand why customer satisfaction scores are declining.
*identify the root cause of manufacturing defects
*Analyse the effectiveness of marketing campaigns
*diagnose the reasons for high employee turnover
Third, Diagnostic business data analytics may also be used in business functions to improve a wide range of business processes
1.2.3 Predictive Analytics
- uses historical data, statistical modelling, and machine learning techniques to forecast future trends, patterns and events.
- allows business enterprises to forecast with reasonable accuracy as to what might happen in near future, allowing businesses to develop their strategies.
- enablo the forecasting of expected outcomes in the near future, on the basis of historical data
- aiming to provide insights into what is likely occur
- uses statistical algorithms and machine learning techniques to identify patterns and uncover hidden patterns that may not be readily apparent through simpler analytical methods.
Techniques of Predictive Analytics: Predictive analytics is a branch of data analytics that uses
statistical techniques,
extrapolation, data mining, machine learning and artificial intelligence to
.make predictions about future outcomes. The process of predictive Analytics to explore and analyse
historical data to identify patterns and relationships that can be used for forecasting
*(a) Regression Analysis: This is a statistical technique that helps to identify the causal relationship
between a dependent variable (the variable sought to be predicted) and one or more independent.
variables (the variables that influence the dependent variable). It helps in understanding the
degree to which the value of the dependent variable registers a change when one or more
independent variables are varied. There are different types of regression analysis, including
linear regression, multiple regression, logistic regression and polynomial regression, each suited
to different types of data and forecasting. Regression analysis is widely used in various business.
functions to identify patterns, understand the impact of different variables on an outcome and
also to make predictions. It helps in making informed decisions, by facilitating forecasting
future trends, besides testing hypotheses based on data.
*(b) Decision Trees: involves creating a flowchart-like structure with nodes and branches to represent different
decision points and their potential outcomes. The root node is the starting point, internal nodes
represent decision points, branches represent possible choices, and leaf nodes represent the
final outcomes. By analyzing the decision tree, organizations can identify the most effective
course of action.
*(c) Neural Networks: It is a type of machine learning process, and are neural (inspired by human brain) networks that use interconnected nodes or artificial neurons in a layered structure
that resembles the human brain, thereby creating an adaptive system. The computers learn
from their mistakes and improve continuously through trial-and-error process. Therefore, artificial
neural networks are a type of machine learning algorithm that is inspired by the structure and
functioning of the human brain. Neural networks are used to model complex relationships
between inputs and outputs and can be used for a variety of predictive analytics tasks, such as
fraud detection, image recognition, and natural language processing.
*(d) Time Series Analysis: Time series analysis is a specific way of analyzing a sequence of data
points collected over an interval of time consistently. In time series analysis, it is imperative to records
data points at uniform intervals over a set period of time rather than just recording the
data points intermittently or randomly. This statistical technique is used to identify trends,
seasonality, and other patterns in data. This information may then be used to forecast expected
values of the time series
*(e) Survival Analysis: has been
used to understand the onset of certain diseases. Now survival analysis is a branch of statistics
that may be used to forecast how long it takes for certain instances to occur
Benefits of Predictive Analytics: The predictive analytics offers the following benefits to the
business enterprises to boost their operational capabilities and business functions:
(a) Identify Future Trends and Opportunities in Real-Time
(b) Reduce Risk and Improve Operational Efficiency
Reducing Risk:
*Early Warning Signs: The analysis of historical data enables predictive analytics to
identify patterns that signal potential problems and issues of concern. This allows for
proactive maintenance, thereby preventing costly downtime and safety hazards,
*Improved Risk Assessment: Predictive models may be used to analyse a wider range of drivers