--- 1/draft-ietf-rmcat-wireless-tests-03.txt 2017-05-16 13:13:13.948853634 -0700 +++ 2/draft-ietf-rmcat-wireless-tests-04.txt 2017-05-16 13:13:13.988854585 -0700 @@ -1,24 +1,24 @@ Network Working Group Z. Sarker Internet-Draft I. Johansson Intended status: Informational Ericsson AB -Expires: May 18, 2017 X. Zhu +Expires: November 17, 2017 X. Zhu J. Fu W. Tan M. Ramalho Cisco Systems - November 14, 2016 + May 16, 2017 Evaluation Test Cases for Interactive Real-Time Media over Wireless Networks - draft-ietf-rmcat-wireless-tests-03 + draft-ietf-rmcat-wireless-tests-04 Abstract There is an ongoing effort in IETF RMCAT working group to standardize rate adaptation algorithm(s) for real-time interactive communication. To ensure seamless and robust user experience, the proposed rate adaptation algorithm(s) should work well across all access network types. This document describes test cases for evaluating performances of the proposed rate adaptation solutions over LTE and Wi-Fi networks. @@ -31,25 +31,25 @@ Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at http://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on May 18, 2017. + This Internet-Draft will expire on November 17, 2017. Copyright Notice - Copyright (c) 2016 IETF Trust and the persons identified as the + Copyright (c) 2017 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as @@ -71,23 +71,23 @@ 4.1. Bottleneck in Wired Network . . . . . . . . . . . . . . . 12 4.1.1. Network topology . . . . . . . . . . . . . . . . . . 12 4.1.2. Test setup . . . . . . . . . . . . . . . . . . . . . 13 4.1.3. Typical test scenarios . . . . . . . . . . . . . . . 14 4.1.4. Expected behavior . . . . . . . . . . . . . . . . . . 14 4.2. Bottleneck in Wi-Fi Network . . . . . . . . . . . . . . . 15 4.2.1. Network topology . . . . . . . . . . . . . . . . . . 15 4.2.2. Test setup . . . . . . . . . . . . . . . . . . . . . 15 4.2.3. Typical test scenarios . . . . . . . . . . . . . . . 16 4.2.4. Expected behavior . . . . . . . . . . . . . . . . . . 17 - 4.3. Potential Potential Test Cases . . . . . . . . . . . . . 18 + 4.3. Other Potential Test Cases . . . . . . . . . . . . . . . 18 4.3.1. EDCA/WMM usage . . . . . . . . . . . . . . . . . . . 18 - 4.3.2. Legacy 802.11b Effects . . . . . . . . . . . . . . . 18 + 4.3.2. Effects of Legacy 802.11b Devices . . . . . . . . . . 18 5. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . 18 6. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 18 7. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 19 8. Security Considerations . . . . . . . . . . . . . . . . . . . 19 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 19 9.1. Normative References . . . . . . . . . . . . . . . . . . 19 9.2. Informative References . . . . . . . . . . . . . . . . . 20 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 20 1. Introduction @@ -611,29 +611,29 @@ 4.1.3. Typical test scenarios o Single uplink RMCAT flow: N=1 with uplink direction and M=0. o One pair of bi-directional RMCAT flows: N=2 (with one uplink flow and one downlink flow); M=0. o One pair of bi-directional RMCAT flows, one on-off CBR over UDP flow on uplink : N=2 (with one uplink flow and one downlink flow); - M=1 (uplink). CBR flow on time at 0s-60s, off time at 60s-119s + M=1 (uplink). CBR flow on time at 0s-60s, off time at 60s-119s. o One pair of bi-directional RMCAT flows, one off-on CBR over UDP flow on uplink : N=2 (with one uplink flow and one downlink flow); - M=1 (uplink). UDP off time: 0s-60s, on time: 60s-119s + M=1 (uplink). UDP off time: 0s-60s, on time: 60s-119s. o One RMCAT flow competing against one long-live TCP flow over - uplink: N=1 (uplink) and M = 1(uplink), TCP start time: 0s, end - time: 119s. + uplink: N=1 (uplink) and M = 1(uplink), TCP start time at 0s and + end time at 119s. 4.1.4. Expected behavior o Single uplink RMCAT flow: the candidate algorithm is expected to detect the path capacity constraint, to converge to bottleneck link capacity and to adapt the flow to avoid unwanted oscillation when the sending bit rate is approaching the bottleneck link capacity. No excessive rate oscillations should be present. o Bi-directional RMCAT flows: It is expected that the candidate @@ -796,36 +796,36 @@ timely fashion to the resulting changes in available bandwidth. o Multiple bi-directional RMCAT flows with TCP traffic: overall bandwidth usage shared by all RMCAT flows should not be significantly lower than those achieved by the same number of bi- directional TCP flows. In other words, the performance of multiple concurrent TCP flows will be used as a performance benchmark for this test scenario. All downlink RMCAT flows are expected to obtain similar bandwidth with respect to each other. -4.3. Potential Potential Test Cases +4.3. Other Potential Test Cases 4.3.1. EDCA/WMM usage EDCA/WMM is prioritized QoS with four traffic classes (or Access Categories) with differing priorities. RMCAT flows should achieve better performance (i.e., lower delay, fewer packet losses) with EDCA/WMM enabled when competing against non-interactive background traffic (e.g., file transfers). When most of the traffic over Wi-Fi is dominated by media, however, turning on WMM may actually degrade performance since all media flows now attempt to access the wireless transmission medium more aggressively, thereby causing more frequent collisions and collision-induced losses. This is a topic worthy of further investigation. -4.3.2. Legacy 802.11b Effects +4.3.2. Effects of Legacy 802.11b Devices When there is 802.11b devices connected to modern 802.11 network, it may affect the performance of the whole network. Additional test cases can be added to evaluate the affects of legancy devices on the performance of RMCAT congestion control algorithm. 5. Conclusion This document defines a collection of test cases that are considered important for cellular and Wi-Fi networks. Moreover, this document @@ -894,21 +894,21 @@ 9.2. Informative References [I-D.ietf-rmcat-cc-requirements] Jesup, R. and Z. Sarker, "Congestion Control Requirements for Interactive Real-Time Media", draft-ietf-rmcat-cc- requirements-09 (work in progress), December 2014. [I-D.ietf-rmcat-eval-test] Sarker, Z., Singh, V., Zhu, X., and M. Ramalho, "Test Cases for Evaluating RMCAT Proposals", draft-ietf-rmcat- - eval-test-04 (work in progress), October 2016. + eval-test-05 (work in progress), April 2017. [IEEE802.11] "Standard for Information technology--Telecommunications and information exchange between systems Local and metropolitan area networks--Specific requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications", 2012. [LTE-simulator] "NS-3, A discrete-Event Network Simulator", @@ -957,17 +957,17 @@ Wei-Tian Tan Cisco Systems 725 Alder Drive Milpitas, CA 95035 USA Email: dtan2@cisco.com Michael A. Ramalho - Cisco Systems + Cisco Systems, Inc. 8000 Hawkins Road Sarasota, FL 34241 USA Phone: +1 919 476 2038 Email: mramalho@cisco.com