Extracting value from Big Data through a new ... - Solutions Linux

5 downloads 982 Views 1MB Size Report
through a new information exploration paradigm. Monica Franceschini - SpagoBI Architect. SpagoBI Competency Center - Engineering Group ... Page 4 ...
Extracting value from Big Data through a new information exploration paradigm

Monica Franceschini - SpagoBI Architect SpagoBI Competency Center - Engineering Group

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

big data dimensions

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

3 scenarios Analytics

SpagoBI for Big Data SEMANTIC BIG DATASETS

BYTES STREAM

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

big data storages Schedulation

Data Source Data Set HBQL CQL HiveQL ….

Visualization

Impala Persistency

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

In-Memory

www.spagobi.org

real-time Event Handlers Event Dispatcher





Alerts



SMS



Mail

Dataset

Visualization

Persistency

Data Streaming

SpagoBI Adapter



Web Service



Java API



Queue



...

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

In-Memory

www.spagobi.org

semantic approach Classify and Categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies.

Semantic database

Network Analysis Engine MQL,Cypher, SPARQL...

FILTER

Freebase, Orient DB, Neo4J...

Visualization

Explorative Analysis Network Analysis as DRIVER

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

use cases Telecommunication companies:

Public administration: need to

need to extract value from mobile data traffic information to improve services and advance new solutions

extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services

BIG DATA

OPEN DATA

VALUE Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

big data platform Cloud services

SpagoBI

Data Marketplace

...

SpagoBI

Data Marketplace

...

Local Services

NoSQL

Cleaning & Integration

API ORCHESTRATION

Process/ Services designer

Analysis & Visualization

RDBMS DWH

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Dataset SpagoBI

API

Open Data www.spagobi.org

data “measures”

a Dat

Does size matter?

Big Data are different types...Big Data are something more!!!

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

dashboards Use cockpits to:

Aggregate analysis to get information at a glance

Filter data using specific documents

Make different kinds of documents interact with each other

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

self-service Use Free Enquiry engine to:

Create new datasets in a graphical and smart way

Define your own queries over datasets Refine your analysis

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

ad-hoc reporting Use Worksheet to:

Interact with Qbe to refresh your data

Create a prototype for your project Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

Provide an instant graphical meaning to your datasets www.spagobi.org

agile development Query Create charts Refine the query Persist New query

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

what comes next?

Unstructured & heterogeneous data

Statistical computing

Text mining

NEW VISUALIZATION

Sentiment analysis

...and more...

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

open-source as a resource Big-data through Open Source tools: – Technologically feasible – No product costs – Experimental proposals on well-known domains – Exploration of new domains – Investment skills (data scientist)

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org

contacts Find out all information (demo, documentation, tutorials, services and much more) and download all SpagoBI components at: www.spagobi.org

Contact us [email protected]

http://www.caribbean-tour.com/Contact-Us.html

Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.

www.spagobi.org