Performance Evaluation on 6LoWPAN and PANA in IEEE 802.15.4g Mesh Networks
Received 19 February 2014; Accepted 05 March 2014; Publication 18 March 2014
Journal of Cyber Security, Vol. 2 No. 3 & 4, 329–350.
doi: 10.13052/jcsm2245-1439.237
Copyright © 2014 River Publishers. All rights reserved.
Yoshihiro Ohba1 and Stephen Chasko2
In this paper, we evaluate performance of 6LoWPAN and PANA over a mesh network based on mathematical analysis, considering IEEE 802.15.4 MAC/PHY behavior, 6LoWPAN behavior including fragmentation and PANA protocol behavior. End-to-end IP packet error rate, mean end-to-end IP packet delay, PANA session failure rate and mean PANA session establishment delay are used as the performance criteria. We show tradeoff points between Long Frame and Short Frame profiles for 6LoWPAN and PANA performance. As a result of performance analysis, we show a recommended PANA profile for IEEE 802.15.4g mesh networks to use Long Frame profile as long as MAC performance metric meet certain criterion.
Wireless mesh networks continue to deploy throughout the Smart Grid especially for HAN (Home Area Network) and NAN (Neighborhood Area Network) where efficient network devices and efficient operations of the devices are needed. ZigBee IP [1] is a IPv6-based network stack profile over IEEE 802.15.4 [2] wireless mesh network for HAN. There is similar work underway to establish a profile for not only the HAN but for the NAN.
ZigBee IP uses PANA (Protocol for carrying Authentication for Network Access) [3] for network access authentication by transporting EAP (Extensible Authentication Protocol) [4], in conjunction with PANA relay extension [5] that is required for PANA to operate over multi-hop networks.
PANA is designed to be independent of link-layer technologies and is proven to be interoperable over small-scale ZigBee IP HANs that typically have only one or two hops between an end-device and the ZigBee IP coordinator. There has been no study on PANA for a large-scale IEEE 802.15.4 NAN. In order to define a NAN profile, it is important to clarify operational conditions of PANA for meta-networks that are common within the NAN.
The main goal of this document is to evaluate performance of 6LoWPAN (IPv6 over Low-Power Wireless Personal Area Networks) [6] and PANA over large-scale IEEE 802.15.4 mesh networks and define a PANA profile that works for NAN environments. In this paper, we develop a mathematical model for 6LoWPAN and PANA over a mesh network to evaluate the following performance metrics: end-to-end IP packet error rate and mean end-to-end IP packet delay, PANA session failure rate and mean PANA session establishment delay. Accuracy of the mathematical model for 6LoWPAN performance analysis is validated by simulation. We show tradeoff points between Long Frame and Short Frame profiles for 6LoWPAN and PANA performance.
Based on the performance evaluation, we show a recommended PANA profile GFSK (Gaussian Frequency-Shift Keying) PHY based IEEE 802.15.4g mesh networks to use Long Frame profile as long as MAC performance metric meet certain criterion. We further explore a cross-layer mechanism for dynamically changing fragment size taking into account not only the PHY and MAC profiles and performance metrics but also the application layer profiles and performance metric.
The following network model is used. See also Figure 1. All nodes in the same IEEE 802.15.4g mesh network support IPv6 and 6LoWPAN for encapsulating IPv6 packets over 802.15.4 MAC. Each IEEE 802.15.4g MAC PDU (i.e., a MAC frame) can carry up to 2000 octets of MAC SDU. GFSK PHY with the maximum link speed of 100kbps is used where 1 symbol is equal to 1 bit. It is assumed that the channel is idle when an ACK frame is sent. A route-over mesh routing protocol such as RPL (IPv6 Routing Protocol for Low-Power and Lossy Networks) [7] is used in the mesh network. The mesh network coordinator is referred to as a root node and the node on the other end of the PAN is referred to as a leaf node. The leaf node or the root node is the source node of 6LoWPAN packets. When the leaf node is the source node, the root node is the destination node, and vice versa. The path from the leaf node to the root node (i.e., the forward path) and the path from the root node to the leaf node (i.e., the reverse path) are symmetric. Hereafter the forward path and the reverse path are referred to as the path without distinction. There are H links along the path, constituting an H-hop path. 6LoWPAN header compression is not used. Fragmentation threshold for fragmenting an IP packet into multiple 6LoWPAN packets may be changed per packet and per hop, but does not change among multiple 6LoWPAN packets belonging to the same IP packet. The leaf node is the PaC and the root node is the PAA. For simplicity, we describe a model without utilizing the PANA relay element. On the other hand, our analysis can consider the impact of PANA relay by increasing the message size of each PANA message.
The following messaging model is used. See also Figure 2. The PaC initiates the PANA session. An authentication and authorization phase of a PANA session consists of an initiation followed by T transactions where T depends on the EAP authentication method in use. A successful initiation triggers the 1-st transaction. A successful i-th transaction triggers the (i+1)-st transaction. A PANA session is established if initiation and all T transactions are successful. An initiation consists of a PCI (PANA-Client-Initiation) message which is sent by the PaC. The PCI message will be retransmitted if the 1-st transaction does not start in a certain amount of time. The initiation is considered successful if the PCI message is received by the PAA before the number of retransmissions reaches its maximum value, R. A transaction consists of a PAR (PANA-Auth-Request) message sent by the PAA and a PAN (PANA-Auth-Answer) message sent by the PaC in response to the PAR. The PAR message will be retransmitted if the PAN message is not received in a certain amount of time. The transaction is considered successful if the PAN message is received by the PAA before the number of retransmissions reaches R. It is assumed that retransmissions of MAC frames of a PANA message in the network complete before the PANA retransmission timer for the PANA message expires.
The notations used in the analytical model are shown in Table 1.
Name | Meaning |
---|---|
MAC and PHY Parameters | |
L | Data frame size in octets. |
La | ACK size in octets. La=4 octets in IEEE 802.15.4. |
M | Maximum number of retransmissions of link-layer frame. |
The maximum number of CSMA/CA back-offs (default = 4). | |
u | Back-off unit. u=20 (bits) for GFSK PHY. |
Minimum back-off exponent (default = 3). | |
Maximum back-off exponent (default = 5). | |
ACK wait time. for GFSK PHY.. | |
Mean CSMA/CA back-off time. | |
Inter-frame spacing latency for data. for GFSK PHY. | |
Inter-frame spacing latency for ACK. for GFSK PHY. | |
Frame processing latency for data. We assume . | |
C | Link speed in bps. for GFSK PHY. |
e | Bit error rate per link. |
c | Channel busy rate. |
PANA Parameters | |
R | Maximum number of retransmissions of a PCI or PAR message. |
T | Number of transactions. We use which is a typical number for EAP-TLS. |
m0 | The number of link-layer frames encapsulating a PCI message. |
The frame length of each frame encapsulating a PCI message. | |
The number of link-layer frames encapsulating a PAR message in i-th transaction. | |
The frame length of each link-layer frame encapsulating a PAR message in i-th transaction. | |
The number of link-layer frames encapsulating a PAN message in i-th transaction. | |
The length of each link-layer frame encapsulating a PAN message in i-th transaction. | |
Initial retransmission interval in seconds for PCI message. We use . | |
Maximum retransmission interval in seconds for PCI message. We use . | |
Initial retransmission interval in seconds for PAR message. We use . | |
Maximum retransmission interval in seconds for PAR message. We use . | |
MAC Performance Metrics | |
Frame error rate for data frame of length L octets. | |
Frame error rate for ACK frame. . | |
CSMA/CA failure rate for data frame. | |
Failure rate for transmission of a MAC data frame of length L octets. | |
Failure rate for an exchange of a MAC data frame of length L octets and an ACK frame sent in response to the data frame. | |
6LoWPAN Performance Metrics | |
Packet transmission failure rate over the path for an IP packet consisting of m 6LoWPAN frames of length L octets. | |
Mean per-hop transmission latency in seconds for an IP packet consisting of m 6LoWPAN frames of length L octets. | |
Mean end-to-end delay in seconds for an IP packet consisting of m 6LoWPAN fragments of length L octets. | |
PANA Performance Metrics | |
A failure rate of a PAR transmission in i-th transaction . | |
A failure rate of i-th transaction. | |
A failure rate of PANA session establishment (i.e., PANA session error rate). | |
D | Mean PANA session establishment delay in seconds |
We analyze performance of IP over 6LoWPAN over an IEEE 802.15.4g mesh network employing un-slotted CSMA/CA with use of ACK frame (Figure 3). The sender of a data frame waits for LIFS (Long Inter-Frame Space) seconds after the last received ACK frame and before starting CSMA/CA back-off for data frame transmission. The sender of an ACK frame waits for SIFS (Short Inter-Frame Space) seconds after receipt of a data frame and before transmitting the ACK frame. The CSMA/CA back-off algorithm used in IEEE 802.15.4 MAC is shown in Figure 4.
1) End-to-end Packet Error Rate
First, is computed from fb and as , where .
Based on the assumption that the channel is idle when ACK is sent, is calculated as .
Since there are H links between the originating node and the destination node for an m–fragment IP packet, is computed as .
2) Mean End-to-end Packet Delay
Since the first requires an ACK frame and the link-layer retransmission interval is , the back-off time is , and the MAC frame transmission latency is , and the transmission of an ACK frame for the last (i.e., m–th) data frame of an IP packet does not contribute to the latency of the IP packet for each hop, is computed as follows.
where
is given by .
1) Session Failure Rate
Since a single transmission of a PAR message can result in a successful receipt of a PAN message when both the request and answer messages are successfully transmitted, is computed as:
Since a transaction fails when all retransmissions of the PAR message fail, .
Finally, a PANA session establishment fails when initiation fails or one of T transactions fails, is computed as:
2) Mean Session Establishment Delay
Let be the mean delay for i-th transaction that succeeds after k retransmissions. Then, for
Let be the mean delay for i-th transaction, then is compute from as follows.
Finally,
Note that the computed D value is valid if the maximum roundtrip time is smaller than the initial retransmission interval. Therefore, the operational condition of the system is given by:
, where.For example, for , and for .
We use two types of fragment size profiles, i.e., “Short Frame” and “Long Frame” as described in Table 2.
6LoWPAN Parameter | Value | |
---|---|---|
Short Frame | Long Frame | |
Maximum fragment size | 127 octets | 1327 octets |
First, we show 6LoWPAN performance in terms of packet loss rate given by and mean delay given by for an IPv6 packet of length 1280 octets, , and where (18, 127) for Short Frame profile and (1,1327) for Long Frame profile . Results for 4 cases based on analysis and simulation are shown in Table 3, Table 4, Table 5, and Table 6, respectively. Tens of thousands of IP packets are generated in each simulation run. In the simulations, adjacent nodes are placed at a distance of 100m which is equal to the radio coverage. These tables indicate that difference in analysis and simulation results are close in the examined parameter range. Specifically, mean delay difference is within 5.2% and packet loss difference is within 2 orders of magnitude for packet loss rate higher than and within the 1 order of magnitude for packet loss rate higher than. Hereafter our evaluation is based on analysis only.
Next we show packet loss rate and mean packet delay performance in broader set of parameters. Figure 5 and Figure 6 show packet loss rate versus H for , respectively for Figure 7 and Figure 8 show mean packet delay versus H for , respectively for . Note that mean packet delay values for are nearly the same as those for. Short Frame shows more than 4 orders of magnitudes lower packet loss rate than Long Frame profile. On the other hand, Long Frame profile shows less than 1/2 the lower packet delay than Short Frame profile.
Figure 9 and Figure 10 show packet loss rate and mean packet delay performance versus c, respectively, for and Again Long Frame profile shows less than ½ the lower packet delay than Short Frame profile. When channel busy rate is low, Short Frame profile shows smaller packet loss rate than Long Frame profile, but when channel busy rate exceeds a certain threshold, Short Frame profile incurs higher packet loss rate than Long Frame profile. This can be explained as follows. A MAC frame loss can be caused by bit errors and CSMA/CA back-off failures. The former occurs more frequently when the fragment size is large. On the other hand, the latter occurs more frequently when the channel busy rate is high. The benefit of smaller fragment size to be robust against bit errors is negated by the disadvantage of the larger number of smaller sized fragments which causes higher CSMA/CA back-off failure rate, and the disadvantage overwhelms the advantage where the channel busy rate exceeds the threshold.
In this section we evaluate performance of PANA over 6LoWPAN in terms of packet loss rate given by and mean session establishment delay given by D. We use the following profile for PANA. Both profiles are corresponding to PCI message of 80 octets in IP PDU length, followed by a sequence of T=4 pairs of PAR and PAN messages all of which have 1280 octets in IP PDU length.
PANA Operational Parameters | Value | |
---|---|---|
Short Frame | Long Frame | |
1 frame | 1 frame | |
16 frames | 1 frame | |
127 octets | 127 octets | |
127 octets | 1327 octets |
Figure 11 and Figure 12 show PANA session failure rate versus M for and , respectively for. Figure 13 and Figure 14 show PANA session establishment delay versus M for and , respectively for. Figure 15 and Figure 16 show PANA session failure rate and PANA session establishment delay versus c , respectively, for , and . The following observations can be made.
Increasing the maximum number of MAC frame retransmissions can decrease both PANA session error rate and PANA session establishment delay for both Short Frame and Long Frame cases (Figure 11, Figure 12, Figure 13 and Figure 14). Increasing the maximum number of PANA message retransmissions can decrease PANA session error rate and increase PANA session establishment delay for both Short Frame and Long Frame cases (Figure 11, Figure 12, Figure 13 and Figure 14). Short Frame profile shows lower PANA session error rate than Long Frame profile when the channel busy rate is low (Figure 11 and Figure 12). Long Frame profile shows lower PANA session establishment delay than Short Frame profile when the maximum number of MAC frame retransmission is high (Figure 16). There is a threshold for the maximum number of MAC frame retransmissions below which PANA session establishment delay for Long Frame profile becomes larger than that for Short Frame profile when channel busy rate is low (Figure 13 and Figure 14). There is a threshold for the channel busy rate above which PANA session error rate for Short Frame profile becomes larger than that for Long Frame profile (Figure 15).
From these observations, it is recommended to use Long Frame profile defined in Section 0 for PANA with and the following PANA session parameters for achieving PANA session error rate lower than and mean PANA session establishment delay lower than 20 seconds in 6LoWPAN over IEEE 802.15.4g networks that employ GFSK PHY with the link speed (C) of 100 kbps with the number of hops (H) not exceding 10 and bit error rate (e) not exceeding 0.00003 and channel busy rate (c) not exceeding 0.6: and
In the case where bit error rate on the outgoing link of a node exceeds 0.00003 and channel busy rate does not exceed 0.6, it is recommended to either switch to use Short Frame profile or use an alternative next hop node. In the case where channel busy rate on the outgoing link of a node exceeds 0.6, it is recommended to use an alternative next hop node without switching to Short Frame profile. A more simplified way is to use an alternative next hop node if packet loss rate bit error rate exceeds 0.00003 or channel busy rate exceeds 0.6.
Although the analysis and performance evaluation described in this paper is focused on PANA over IPv6 employing 6LoWPAN encapsulation, the obtained results lead to an insight into a cross-layer mechanism for dynamically changing fragment size taking not only the PHY and MAC profiles and performance metric but also application layer profiles and performance metric into accounts. As a rule of thumb, in the environments such as IEEE 802.15.4 wireless mesh networks where MAC frame loss rate is not ignorant, use of smaller 6LoWPAN fragment size is recommended for real-time applications since they do not rely on retransmissions above MAC layer, and use of larger 6LoWPAN size is recommended for non-real time applications that employs a transport or application layer retransmission mechanism that can compensate IP packet loss.
Note that this kind of dynamic fragment size control is applicable to IP-layer fragmentation as well. However, it is recommended to use 6LoWPAN fragmentation wherever available because 6LoWPAN provides not only fragmentation but also more efficient header compression schemes [8] than IP header compression [9].
In this document, we developed a mathematical model for 6LoWPAN and PANA over a mesh network to evaluate end-to-end IP packet error rate and mean end-to-end IP packet delay, PANA session failure rate and mean PANA session establishment delay.
Through performance evaluation of 6LoWPAN, we observed that Short Frame profile always shows larger mean packet delay than Long Frame profile, and when channel busy is low, Short Frame profile shows smaller packet loss rate than Long Frame profile. On the other hand, when channel busy rate exceeds a certain threshold, Short Frame profile incurs higher packet loss rate than Long Frame profile. Through performance evaluation of PANA over 6LoWPAN, we observed that increasing the maximum number of MAC frame retransmissions can decrease both PANA session error rate and PANA session establishment delay, and increasing the maximum number of PANA message retransmissions can decrease PANA session error rate at the cost of larger PANA session establishment delay. We also observed tradeoff points in terms of PANA session establishment delay as well as PANA session error rate between Long Frame and Short Frame profiles.
As a result, a recommended PANA profile was introduced for GFSK-based IEEE 802.15.4g mesh networks to use Long Frame profile as long as MAC performance metric meet certain criterion.
Finally, we explored an idea of cross-layer mechanism for dynamically changing fragment size taking not only the PHY and MAC profiles and performance metric but also application layer profiles and performance metric into accounts. We plan to investigate such a mechanism deeply in our future work.
The authors gratefully acknowledge the support of Mitsuru Kanda, Seijiro Yoneyama, Yasuyuki Tanaka, Mike Demeter and Ruben Salazar for this work.
[1] ZigBee Alliance, “ZigBee IP Specification'', ZigBee Public Document 13–002r00, 2013.
[2] IEEE, “IEEE Standard for LAN/MAN—Specific requirements Part 15.4: Wireless Medium Access Control (MAC) and Physical Layer (PHY) Specifications for Low-Rate Wireless Personal Area Networks (WPANs),” 2011.
[3] Y. Ohba , a. et., “Protocol for Carrying Authentication for Network Access (PANA),” RFC 5191, 2008.
[4] B. Aboba and a. et., “Extensible Authentication Protocol (EAP),” RFC 3748, 2004.
[5] P. Duffy, S. Chakrabarti, R. Cragie, Y. Ohba and A. Yegin, Protocol for Carrying Authentication for Network Access (PANA) Relay Element, RFC 6345, 2011.
[6] G. Montenegro, N. Kushalnagar, J. Hui and D. Culler, Transmission of IPv6 Packets over IEEE 802.15.4 Networks, RFC 4944, 2007.
[7] E. T. Winter , E. P. Thubert, RPL: IPv6 Routing Protocol for Low power and Lossy Networks, RFC 6550.
[8] J. Hui and P. Thubert, “Compression Format for IPv6 Datagrams over IEEE 802.15.4-Based Networks,” RFC 6282, 2011.
[9] M. Degermark, B. Nordgren and S. Pink, “IP Header Compression,” RFC 2507, 1999. enumerate
Yoshihiro Ohba is a Chief Research Scientist in Toshiba Corporate R & D Center, Japan. He received B.E., M.E. and Ph.D. degrees in Information and Computer Sciences from Osaka University in 1989, 1991 and 1994, respectively. He is an active member in IEEE 802 and IETF for standardizing security and mobility protocols. He is Chair of IEEE 802.21a Task Group and IEEE 802.21d Task Group, and Vice Chair and Secretary of ZigBee Alliance Neighborhood Area Network (NAN) WG. He is a main contributor to RFC 5191 (PANA - Protocol for carrying Authentication for Network Access). He received IEEE Region 1 Technology Innovation Award 2008.
Stephen Chasko (M'1888, F'17) was born in San Diego, California on August 5, 1969. He graduated from the Arizona State University with a BSEE.
His employment experience includes NCR, ACI Worldwide, Texas Instruments. His special fields of interest include data communications, smart card systems, secure microcontrollers and smart grid security He is currently a Security+Software Manager at Landis+Gyr.
Mr. Chasko has spoken at numerous security conferences including the RSA Conference, Smart Grid Security, Distributech and IEEE PES.