Documente Academic
Documente Profesional
Documente Cultură
Structured - (as explained succinctly in Big Data Republic’s video) is information, usually text
files, displayed in titled columns and rows which can easily be ordered and processed by data
mining tools.
Unstructured data- Unstructured data has internal structure but is not structured via pre-defined
data models or schema. It may be textual or non-textual, and human- or machine-generated.
Typical human-generated unstructured data includes:
Email: Email has some internal structure thanks to its metadata, and we sometimes refer to it as
semi-structured. However, its message field is unstructured and traditional analytics tools cannot
parse it.
Scientific data: Oil and gas exploration, space exploration, seismic imagery, atmospheric data.
System also applying the new technology to the forest resources management system such as the
GIS technology, the nano scale electronic waves filter technology, intelligent video analysis,
3G/WI-FI wireless transmission, digital image processing technique and the integrated application
of high technology. The early warning framework is based on the big data. Sensors on trees can
take measurements that indicate when a fire has broken out, or there is a strong risk, e.g.
temperature, moisture, CO2 and CO levels. If there is a critical combination of these parameters,
early warning systems alert the local population and request help. The firefighters when they arrive
have detailed information about the location and spread of the blaze.
Video data- Cameras are used for monitoring the entire forest. Signal processing and Infrared
image processing is also used to monitor the signal and image of the entire forest
Sensors date; Temperature data, Humidity- When a fire occurs the air becomes dry and the
humidity will be low. And there is a maximum possibility of occurrence of fire when the air is dry
than being moistures
2. Describe alternative approaches for storing the data.
The system must be integrated with the architecture of the hierarchical storage system in the
storage to lay the foundation for the design and implementation of the following data mining and
data acquisition module. Ex: Big data uses Hadoop tool for storing huge amount of data. In forest
fire prediction, the data will be collected and stored in hadoop as unstructured form.
3. Describe what type of analysis is required for forest fire detection from the data collected?
Predictive analysis.
The system structure is based on the early warning and the data analysis and forecast are
characterized. System, give full consideration to the practical application in forest fire monitoring,
and supplemented by the protection of natural ecology.
It is necessary to detect the fire as early as possible and it would be better if it is predicted in
advance. The fire usually occurs when the humidity of the air is lower and the temperature is higher.
Thus if the humidity of the air is below a threshold value and the temperature is higher than the
threshold value then an alert signal is sent to the control center. Once the fire is predicted at a
particular location then the necessary precautionary measures are carried out. The fire may
occur even without being predicted. This prediction will work only when the fire arises due to
increase in the relative temperature but when the fire occurs due to incidents such as lightning or
manmade events or due to crown fires then the fire cannot be predicted
Forecast analysis: Predict the forest fire grade data of the region by reference the forest phenology
and property data and by analysis using expert database model comprehensively. The fire
prediction system which combine the video avoid the original artificial fire lookout observation
limitations, that realizes the digitization and scientific of the forest management. It greatly reduce
the cost of the forestry sector and management costs and improve the effect of the forest enterprise.
When monitoring the forest fires, the system can also monitor the forest resources, ecological
environment, plant diseases and insect pests of forest and wildlife and deforestation and other
forestry activities effectively.
Predictive analytics is the practice of extracting information from existing data sets in order to
determine patterns and predict future outcomes and trends.
Predictive analytics uses historical data to predict future events. Typically, historical data is used
to build a mathematical model that captures important trends. That predictive model is then used
on current data to predict what will happen next, or to suggest actions to take for optimal outcomes.
Predictive analytics has received a lot of attention in recent years due to advances in supporting
technology, particularly in the areas of big data and machine learning. With predictive analytics,
organizations can find and exploit patterns contained within data in order to detect risks and
opportunities. Models can be designed, for instance, to discover relationships between various
behavior factors.
4. Discuss the major challenges, issues and benefits of this system when it collaborates with Big
Data and Cloud Computing.
When combines these three technologies to efficiently support various services from different
kind of objects (e.g., devices, machines, etc.), there will be many challenges and issues.
The relevant standardization efforts for realization of the cloud-based IoT need to be accelerated
with special consideration of their commercial viability.
Security and privacy. Cloud-based IoT makes it possible to transport data from the real world to
the Cloud.
What is IOT
IOT is the concept of everyday objects from industrial machines to wearable devices using
built-in sensors to gather data and take action on that data across a network
Characteristics of IoT
• Self-Configuring
• Unique Identity
• Web Service: Web services serve as a link between the IoT device, application,
database and analysis components. Web service can be either implemented using
HTTP and REST principles (REST service) or using WebSocket protocol
• Application: IoT applications provide an interface that the users can use to control
and monitor various aspects of the IoT system. Applications also allow users to view
the system status and view the processed data.
IOT ARCHITECTURE
Things equipped with sensors to gather data and actuators to perform commands
received from the cloud.
Gateways for data filtering, preprocessing and moving it to the cloud and vice versa, –
receiving commands from the cloud.
Cloud gateways to ensure data transition between field gateways and central IoT servers.
Streaming data processors to distribute the data coming from sensors among relevant IoT
solution’s components.
Data lake for storing all the data of defined and undefined value.
Machine learning to generate the models which are then used by control applications.
• A level-5 IoT system has multiple end nodes and one coordinator node.
• Coordinator node collects data from the end nodes and sends to the cloud.
• Level-5 IoT systems are suitable for solutions based on wireless sensor networks, in
which the data involved is big and the analysis requirements are computationally
intensive.
• E.g. Forest Fire detection system (Equipped with various sensors- Humidity, temperature
and C02)
IoT Level-6
• A level-6 IoT system has multiple independent end nodes that perform sensing and/or
actuation and send data to the cloud.
• The analytics component analyzes the data and stores the results in the cloud database.
• The centralized controller is aware of the status of all the end nodes and sends control
commands to the nodes.
• Descriptive Analytics, which use data aggregation and data mining to provide insight into
the past and answer: “What has happened?”
• Predictive Analytics, which use statistical models and forecasts techniques to understand
the future and answer: “What could happen?”
123222222222222222ffdsfds
Fdsfdsfsdfdsfs
fffffvvvvv