Description of selected simulation tools for WMN. 6. Additional tools for ... o Use mathematical models to evaluate the network performance o Simulations.
Review of Simulation Tools for Wireless Mesh Network Piotr Owczarek
Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
1
1. 2. 3.
4. 5. 6. 7.
8.
Introduction Main methods of evaluation for routing protocols Advantages and drawbacks of the use of simulators The most popular simulation tools for WMN Description of selected simulation tools for WMN Additional tools for simulation purposes Comparison of network simulation tools Summary – What to choose? Appendix - Simulator software availability and licensing
Plan of the presentation Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
2
o
Wireless Mesh Networks has become one of key technologies for providing increased network coverage of Internet infrastructures
o
Development process in WMN is typically split into evaluations by simulation and testing prototype in a test-bed
o
In case of WMN as compared to traditional wireless networks there is additional challenge due to mobility of clients
1. Introduction Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
3
2. Main methods of evaluation for routing protocols Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
4
o
Theoretical Analysis o Use mathematical models to evaluate the network performance
o
Simulations o Models virtual environment to help verify new ideas or compare proposed solutions
o
Emulation o Hybrid study enviroment consisting of real and simulated, virtual part
o
Virtualization o Enables running virtual hosts for testing on one host system
o
Real Testbeds o Real environment (prototype implementation) for studying network protocols and to conduct experiments
2. Main methods of evaluation for routing protocols Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
5
Method Property
Theoretical analysis
Simulation
Emulation
Virtualization
Real Testbed
Repeatability
-
High
Low
Low
Poor
Controllability
High
High
Middle
Middle
Poor
Maintainability
-
High
Middle
Middle
Poor
Scenario creation
-
Simple
Middle
Middle
Complex
Scalability
-
High
Middle
Middle
Low
Duration
-
Variable
Real-Time
Real-Time
Real-Time
Cost
-
Low
Middle
Middle
High
2. Main methods of evaluation for routing protocols Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
6
3. Advantages and drawbacks of the use of simulators Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
7
Easy to expand network topologies due to high scalability of simulation applications Simulation process is easy to maintain It is the most common way of developing and testing new routing protocols
There is no one standardized simulation tool that would allow to compare simulation results between different projects
3. Advantages and drawbacks of the use of simulators Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
8
Testing cost relatively small Results have high repeatability Full control of simulation process Easy process of scenario preparing and data collecting
Results can differ from real world because of abstracted PHY layer modeling Results can depend on implementation of simulation software
3. Advantages and drawbacks of the use of simulators Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
9
4. The most popular simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
10
oNS-2 – The Network Simulator v.2 oNS-3 – The Network Simulator v.3 oOPNET – Optimized Network Engineering Tool oOMNET++ - Optical Micro-Networks ++ oQualNet - QualNet® communications simulation platform oGloMoSim - Global Mobile Information System Simulator
4. The most popular simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
11
oj-sim - J-Sim Wireless Extension oopenWNS - Open Source Wireless Network Simulator oSSFNET - Scalable Simulation Framework Network Model oREAL – The Real Network Simulator oGTNetS - The Georgia Tech Network Simulator
4. The most popular simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
12
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
13
NS-2 First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
1996-97 2011 Tcl, Object TCL (OTcl) GNU/Linux, FreeBSD, Solaris, MacOS X, Windows under Cygwin Free, GNU General Public License. http://www.isi.edu/nsnam/ns/ns-build.html WiMsh Library Command line, text editor
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
14
NS-3 First release End of project date Programming language Enviroment
2006 C++, Python GNU/Linux, FreeBSD, MacOS X, Optionally Windows/Cygwin, Windows Visual Studio 2012
License Download available Support for WMN User Interface Additional Tools
Free, GNU GPLv2 license http://www.nsnam.org/releases/ Mesh NetDevice, WifiNetDevice Command line, text editor o Scenario generator o Ns-2 setdest o BonnMotion o Topology generator o Orbis o Inet o NS-3 Topology generator o NetAnim
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
15
OPNET First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
Data N/A C++ Windows, Red Hat Linux, Fedora Linux Commercial Only Trial version after registration The OPNET Modeler Wireless Suite for simulating wireless networks GUI, XML Scenarios
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
16
OMNET++ First release End of project date Programming language Enviroment
License
Download available
Support for WMN User Interface
2000 C++ GNU/Linux, MacOS X, Windows Free for academic and educational use. Commercial use requires a commercial license from SimulCraft Inc, www.omnest.com. http://www.omnetpp.org/omnetpp/c at_view/17-downloads/1-omnetreleases VirtualMesh, GUI, Eclipse Based
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
17
QualNet First release End of project date Programming language Enviroment
License Download available
Support for WMN User Interface
1999 C++ Windows CentOS Linux, Red Hat Enterprise Linux, Ubuntu Linux Commercial Only after Scalable Network Technologies training or as Managed Evaluation (30 day evaluation license). Education Program also available. Wireless Library, Advanced Wireless Library, Custom Libraries GUI
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
18
GloMoSim First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
Parsec, C based Linux, FreeBSD, Solaris, Windows Open Source License http://ubuntuone.com/p/kXS/ Partial with custom libraries Command line, GUI with external tools
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
19
j-sim First release End of project date Programming language Enviroment License Download available Support for WMN User Interface
2001 2006 Java, TCL Windows, Linux Open Source License https://sites.google.com/site/jsimofficial/ downloads Custom libraries Command Line, GUI with additional Libary
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
20
SSFNet First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
1998 2004 C++, Java SunOS, FreeBSD, Linux, Windows GNU General Public License http://www.ssfnet.org/ dmlImplementations.html Some custom libraries Command Line, Java Based GUI
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
21
openWNS First release End of project date Programming language Enviroment License Download available Support for WMN User Interface
C++ Ubuntu Linux, Windows with Cygwin GNU General Public License http://www.openwns.org/Wiki/Download Wireless Library Command Line, GUI Editor, External GUI
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
22
GTNets First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
2008 C++ Linux, FreeBSD, OsX, SunOS, Windows GNU Public License http://www.ece.gatech.edu/research/labs/MANI ACS/GTNetS/downloads.html Simple mesh library Command Line, Visual Studio Framework for Windows
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
23
REAL First release End of project date Programming language Enviroment
License Download available Support for WMN User Interface
1988 1997 C SunOS, FreeBSD, Linux Free for Academic Use http://www.cs.cornell.edu/skeshav/real/ overview.html Some custom libraries Command Line, Java Based GUI
5. Description of selected simulation tools for WMN Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
24
6. Additional tools for simulation purposes Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
25
npart o Tool for generation of wireless network topologies o Uses novel nodes placement algorithm (NPART) which is able to place wireless nodes in more realistic way o Based on real topologies - Berlin and Leipzig roofnets o Results can be exported as NS-2 formatted file or plain text o Java based – easy to install and use on different platforms
6. Additional tools for simulation purposes Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
26
BRITE Topology Generator o Tool for generating topologies, written in Java and C++ o Universal, topologies generated can be used in different tools like SSFNet, NS, JavaSim OmNet++, etc. o Provides GUI for better user experience o Supports multiple generation models including models for flat AS, flat Router and hierarchical topologies. Models can be enhanced by assigning links attributes such as bandwidth and delay
6. Additional tools for simulation purposes Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
27
GT-ITM o Georgia Tech Internetwork Topology Models o Can be used to create flat random graphs and two types of hierarchical graphs, the N-level and transit-stub o Topologies can be used in NS2 after conversion in sgb2ns software o With GT-ITM TOOLS FOR OMNET++ topologies can be used in OmNet++
6. Additional tools for simulation purposes Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
28
More Topology Generators Tiers Topology Generator Inet Topology Generator
6. Additional tools for simulation purposes Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
29
7. Comparison of network simulation tools Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
30
REAL
GTNets
OpenWNS
SSFNet
JSim
GloMoSim
QualNet
OMNET++
OPNET
NS3
NS2 Interface
C++/OT cl
C++/ Python
C/C++
C++
Parsec
Parsec (C)
Java
C++/Ja va
C++
C++
C
Graphical Support
No
Limited
Yes
Yes
Yes
Limited
Yes
Limited
Yes
Yes
Yes
Parallelism
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes (disREAL)
Scalability
Small
Large
Medium
Large
Very Large
Large
Small
Very Large
Large
Large
Large (disREAL)
Documentation and user support
Excellent
Excellent
Excellent
Good
Good
Poor
Poor
Good
Poor
Good
Poor
Extendibility
Excellent
Excellent
Excellent
Excellent
Excellent
Excellent
Excellent
Good
Good
Excellent
Good
Emulation
Limited
Yes
Not direct
Limited
Yes
Not direct
Yes
Not direct
Limited
Yes
Not direct
7. Comparison of network simulation tools Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
31
Number of articles published in the years 2000-2013 using the selected simulation tools Wiley
70
(Wireless Networks only ) 350
IEEE
60
300
50
250
40
200
MESH
30
150
Ad-Hoc
20
100
Sensor
10
50
0
0
600 500
Springer
800
Elsevier
700 600
400 500 300 200 100
400 300 200 100
0
0
7. Comparison of network simulation tools Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
32
Piotr Owczarek JiST REAL GtnetS
Books
SSFNET
Journals and magazines
4
SimJava
6
CSIM
0 250
Comnet III
8
j-sim
2 QualNet
GtnetS
REAL
SSFNET
JiST
SimJava
CSIM
Comnet III
HASE III
j-sim
GloMoSim
60
HASE III
10
QualNet
Wiley
GloMoSim
0 OPNET
20
OMNET++
Journals and magazines
OPNET
40
ns-3
Conference publications
openWNS
60
ns-2
40
OMNET++
REAL
GtnetS
80
openWNS
JiST SSFNET
50
ns-3
CSIM SimJava
100
IEEE
ns-2
GtnetS
REAL
SSFNET
JiST
SimJava
12 Comnet III
HASE III
j-sim
GloMoSim
QualNet
OMNET++
OPNET
openWNS
ns-3
ns-2
120
CSIM
14
Comnet III
HASE III
j-sim
GloMoSim
QualNet
OMNET++
OPNET
openWNS
ns-3
ns-2
Number of publications on WMN using selected simulators (2000-2013)
Springer
30
20 Journals and magazines
10
Books
0
200
Elsevier
150
100
Journals and magazines
50 Books
0
7. Comparison of network simulation tools Review of Simulation Tools for Wireless Mesh Network 33
8. Summary Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
34
General capabilities ◦ Flexibility, available models, re-use ◦ Which specific problem / class of problems do I want to tackle? ◦ Which orders of magnitude for simulation size?
Hardware/software considerations ◦ Which OS is available / needed? ◦ Which compilers etc.?
Graphical facilities ◦ Educational / scientific purpose?
Statistical features ◦ Tracing vs. inline statistics
Ease of use, documentation, support ◦ How many languages do I have to learn?
Output reports and plots What do the others in my community use?
8. Summary – What to choose? Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
35
Simulation Software
Web Site
License Type
NS2
http://www.isi.edu/nsnam/ns/ns-build.html
GNU Public License
NS3
http://www.nsnam.org/releases/
Free, GNU GPLv2 license
OPNET
http://www.opnet.com/
Commercial
OMNET++
http://www.omnetpp.org/omnetpp/cat_view/17-downloads/1-omnetreleases
Academic Public License
QualNet
http://web.scalable-networks.com/content/qualnet
Commercial
GloMoSim
http://ubuntuone.com/p/kXS/
Academic Public License
J-Sim
https://sites.google.com/site/jsimofficial/downloads
Open Source License
SSFNet
http://www.ssfnet.org/dmlImplementations.html
GNU General Public License
GTNets
http://www.ece.gatech.edu/research/labs/MANIACS/GTNetS/downloads.html
GNU General Public License
REAL
http://www.cs.cornell.edu/skeshav/real/overview.html
Free for Academic Use
openWNS
Appendix - Simulator software availability and licensing Piotr Owczarek
Review of Simulation Tools for Wireless Mesh Network
36
