Introduction

Hello, i'm Renato, an italian WISP consultant. Right now, i work for Progetto8, a small WISP of ~1500 customers. The network is managed with OSPF by Mikrotik while the Wireless part is mostly Ubiquiti RocketM5 and some old Canopy 100. 

Lately Cambium networks has released the new PMP450, with an aggregated throughput of ~90Mbit/s. That would be awesome in a crowded area where the frequencies are not free to deploy more than 1 or 2 APs.

But what's the aggregated throughput of Ubiquiti Rocket M5? I was looking on the web about real tests on field of the throughput of a standard config but i can't find any. We really needed those data to choose which AP install in a very crowded area.

An expensive but efficient PMP450 or the low cost high performance Ubiquiti Airmax? Let's make a real life test of the Ubiquiti Airmax before making a choice...

Setup

We have created a cluster of 8x6 Nanostations/Nanostations Loco M5 connected to a new deployed AP (there were already 2 customers connected) The AP was a Rocket M5 with an Airmax Ubiquiti Antenna 90° and RF Armor.

Each cluster of 8 Nanostations were connected to a RB750UP to power them up and give a client peer for the Traffic Generator attached to the AP.

The whole cluster was powered up by 2x100A Gel Batteries @24v

 

     

The Cluster was located at around 900m from the AP and the fresnel was pretty clear (Radiomobile simulates city obstructions but the LOS was clear)

The AP is at around 35m from the ground, in a standard installation with a cluster of 4 APs, one on each side of the site. Every AP has his RFArmor.

Below the APs, there's a Mikrotik that manages the routing and PPPoE of the site. Mikrotik Traffic generator has a limit of 16 streams (AFAIK) so i used 4 RB450G instead of the existing RB1100AH to generate the traffic for the tests.

Configuration

Ubiquiti

The Ubiquiti AP configuration was pretty straightforward:

  • Bridge Mode
  • Wireless 5GHz, 20MHz
  • Airmax Enabled
  • WDS Disabled
  • WPA2-AES

The Stations were configured like the AP:

  • Bridge Mode
  • Wireless 5GHz, 20MHz
  • Airmax Enabled
  • WDS Disabled
  • WPA2-AES

Some stations were bridged with VLANs to create one single broadcast domain for each stations to the Mikrotik Cluster Client.

Everything else wasn't changed from default configuration.

Mikrotik

The Below config was splitted between the 4 RB450G (Yeah i could've use only 3 of them, but i used 4 to have some room to more experiments).

/ip address add interface=bridge-PPPoE address=192.168.101.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.101.2 ip-src=192.168.101.1 name=101; /tool traffic-generator stream add mbps=2 name=str101 packet-size=1500 tx-template=101 id=1
/ip address add interface=bridge-PPPoE address=192.168.102.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.102.2 ip-src=192.168.102.1 name=102; /tool traffic-generator stream add mbps=2 name=str102 packet-size=1500 tx-template=102 id=2
/ip address add interface=bridge-PPPoE address=192.168.103.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.103.2 ip-src=192.168.103.1 name=103; /tool traffic-generator stream add mbps=2 name=str103 packet-size=1500 tx-template=103 id=3
/ip address add interface=bridge-PPPoE address=192.168.104.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.104.2 ip-src=192.168.104.1 name=104; /tool traffic-generator stream add mbps=2 name=str104 packet-size=1500 tx-template=104 id=4
/ip address add interface=bridge-PPPoE address=192.168.105.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.105.2 ip-src=192.168.105.1 name=105; /tool traffic-generator stream add mbps=2 name=str105 packet-size=1500 tx-template=105 id=5
/ip address add interface=bridge-PPPoE address=192.168.106.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.106.2 ip-src=192.168.106.1 name=106; /tool traffic-generator stream add mbps=2 name=str106 packet-size=1500 tx-template=106 id=6
/ip address add interface=bridge-PPPoE address=192.168.107.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.107.2 ip-src=192.168.107.1 name=107; /tool traffic-generator stream add mbps=2 name=str107 packet-size=1500 tx-template=107 id=7
/ip address add interface=bridge-PPPoE address=192.168.108.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.108.2 ip-src=192.168.108.1 name=108; /tool traffic-generator stream add mbps=2 name=str108 packet-size=1500 tx-template=108 id=8
/ip address add interface=bridge-PPPoE address=192.168.111.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.111.2 ip-src=192.168.111.1 name=111; /tool traffic-generator stream add mbps=2 name=str111 packet-size=1500 tx-template=111 id=11
/ip address add interface=bridge-PPPoE address=192.168.112.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.112.2 ip-src=192.168.112.1 name=112; /tool traffic-generator stream add mbps=2 name=str112 packet-size=1500 tx-template=112 id=12
/ip address add interface=bridge-PPPoE address=192.168.113.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.113.2 ip-src=192.168.113.1 name=113; /tool traffic-generator stream add mbps=2 name=str113 packet-size=1500 tx-template=113 id=13
/ip address add interface=bridge-PPPoE address=192.168.114.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.114.2 ip-src=192.168.114.1 name=114; /tool traffic-generator stream add mbps=2 name=str114 packet-size=1500 tx-template=114 id=14
/ip address add interface=bridge-PPPoE address=192.168.115.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.115.2 ip-src=192.168.115.1 name=115; /tool traffic-generator stream add mbps=2 name=str115 packet-size=1500 tx-template=115 id=15
/ip address add interface=bridge-PPPoE address=192.168.116.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.116.2 ip-src=192.168.116.1 name=116; /tool traffic-generator stream add mbps=2 name=str116 packet-size=1500 tx-template=116 id=0
/ip address add interface=bridge-PPPoE address=192.168.117.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.117.2 ip-src=192.168.117.1 name=117; /tool traffic-generator stream add mbps=2 name=str117 packet-size=1500 tx-template=117 id=0
/ip address add interface=bridge-PPPoE address=192.168.118.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.118.2 ip-src=192.168.118.1 name=118; /tool traffic-generator stream add mbps=2 name=str118 packet-size=1500 tx-template=118 id=1
/ip address add interface=bridge-PPPoE address=192.168.121.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.121.2 ip-src=192.168.121.1 name=121; /tool traffic-generator stream add mbps=2 name=str121 packet-size=1500 tx-template=121 id=4
/ip address add interface=bridge-PPPoE address=192.168.122.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.122.2 ip-src=192.168.122.1 name=122; /tool traffic-generator stream add mbps=2 name=str122 packet-size=1500 tx-template=122 id=5
/ip address add interface=bridge-PPPoE address=192.168.123.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.123.2 ip-src=192.168.123.1 name=123; /tool traffic-generator stream add mbps=2 name=str123 packet-size=1500 tx-template=123 id=6
/ip address add interface=bridge-PPPoE address=192.168.124.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.124.2 ip-src=192.168.124.1 name=124; /tool traffic-generator stream add mbps=2 name=str124 packet-size=1500 tx-template=124 id=7
/ip address add interface=bridge-PPPoE address=192.168.125.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.125.2 ip-src=192.168.125.1 name=125; /tool traffic-generator stream add mbps=2 name=str125 packet-size=1500 tx-template=125 id=8
/ip address add interface=bridge-PPPoE address=192.168.126.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.126.2 ip-src=192.168.126.1 name=126; /tool traffic-generator stream add mbps=2 name=str126 packet-size=1500 tx-template=126 id=9
/ip address add interface=bridge-PPPoE address=192.168.127.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.127.2 ip-src=192.168.127.1 name=127; /tool traffic-generator stream add mbps=2 name=str127 packet-size=1500 tx-template=127 id=10
/ip address add interface=bridge-PPPoE address=192.168.128.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.128.2 ip-src=192.168.128.1 name=128; /tool traffic-generator stream add mbps=2 name=str128 packet-size=1500 tx-template=128 id=11
/ip address add interface=bridge-PPPoE address=192.168.131.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.131.2 ip-src=192.168.131.1 name=131; /tool traffic-generator stream add mbps=2 name=str131 packet-size=1500 tx-template=131 id=14
/ip address add interface=bridge-PPPoE address=192.168.132.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.132.2 ip-src=192.168.132.1 name=132; /tool traffic-generator stream add mbps=2 name=str132 packet-size=1500 tx-template=132 id=15
/ip address add interface=bridge-PPPoE address=192.168.133.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.133.2 ip-src=192.168.133.1 name=133; /tool traffic-generator stream add mbps=2 name=str133 packet-size=1500 tx-template=133 id=0
/ip address add interface=bridge-PPPoE address=192.168.134.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.134.2 ip-src=192.168.134.1 name=134; /tool traffic-generator stream add mbps=2 name=str134 packet-size=1500 tx-template=134 id=1
/ip address add interface=bridge-PPPoE address=192.168.135.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.135.2 ip-src=192.168.135.1 name=135; /tool traffic-generator stream add mbps=2 name=str135 packet-size=1500 tx-template=135 id=2
/ip address add interface=bridge-PPPoE address=192.168.136.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.136.2 ip-src=192.168.136.1 name=136; /tool traffic-generator stream add mbps=2 name=str136 packet-size=1500 tx-template=136 id=3
/ip address add interface=bridge-PPPoE address=192.168.137.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.137.2 ip-src=192.168.137.1 name=137; /tool traffic-generator stream add mbps=2 name=str137 packet-size=1500 tx-template=137 id=4
/ip address add interface=bridge-PPPoE address=192.168.138.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.138.2 ip-src=192.168.138.1 name=138; /tool traffic-generator stream add mbps=2 name=str138 packet-size=1500 tx-template=138 id=5
/ip address add interface=bridge-PPPoE address=192.168.141.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.141.2 ip-src=192.168.141.1 name=141; /tool traffic-generator stream add mbps=2 name=str141 packet-size=1500 tx-template=141 id=8
/ip address add interface=bridge-PPPoE address=192.168.142.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.142.2 ip-src=192.168.142.1 name=142; /tool traffic-generator stream add mbps=2 name=str142 packet-size=1500 tx-template=142 id=9
/ip address add interface=bridge-PPPoE address=192.168.143.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.143.2 ip-src=192.168.143.1 name=143; /tool traffic-generator stream add mbps=2 name=str143 packet-size=1500 tx-template=143 id=10
/ip address add interface=bridge-PPPoE address=192.168.144.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.144.2 ip-src=192.168.144.1 name=144; /tool traffic-generator stream add mbps=2 name=str144 packet-size=1500 tx-template=144 id=11
/ip address add interface=bridge-PPPoE address=192.168.145.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.145.2 ip-src=192.168.145.1 name=145; /tool traffic-generator stream add mbps=2 name=str145 packet-size=1500 tx-template=145 id=12
/ip address add interface=bridge-PPPoE address=192.168.146.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.146.2 ip-src=192.168.146.1 name=146; /tool traffic-generator stream add mbps=2 name=str146 packet-size=1500 tx-template=146 id=13
/ip address add interface=bridge-PPPoE address=192.168.147.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.147.2 ip-src=192.168.147.1 name=147; /tool traffic-generator stream add mbps=2 name=str147 packet-size=1500 tx-template=147 id=14
/ip address add interface=bridge-PPPoE address=192.168.148.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.148.2 ip-src=192.168.148.1 name=148; /tool traffic-generator stream add mbps=2 name=str148 packet-size=1500 tx-template=148 id=15
/ip address add interface=bridge-PPPoE address=192.168.151.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.151.2 ip-src=192.168.151.1 name=151; /tool traffic-generator stream add mbps=2 name=str151 packet-size=1500 tx-template=151 id=2
/ip address add interface=bridge-PPPoE address=192.168.152.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.152.2 ip-src=192.168.152.1 name=152; /tool traffic-generator stream add mbps=2 name=str152 packet-size=1500 tx-template=152 id=3
/ip address add interface=bridge-PPPoE address=192.168.153.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.153.2 ip-src=192.168.153.1 name=153; /tool traffic-generator stream add mbps=2 name=str153 packet-size=1500 tx-template=153 id=4
/ip address add interface=bridge-PPPoE address=192.168.154.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.154.2 ip-src=192.168.154.1 name=154; /tool traffic-generator stream add mbps=2 name=str154 packet-size=1500 tx-template=154 id=5
/ip address add interface=bridge-PPPoE address=192.168.155.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.155.2 ip-src=192.168.155.1 name=155; /tool traffic-generator stream add mbps=2 name=str155 packet-size=1500 tx-template=155 id=6
/ip address add interface=bridge-PPPoE address=192.168.156.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.156.2 ip-src=192.168.156.1 name=156; /tool traffic-generator stream add mbps=2 name=str156 packet-size=1500 tx-template=156 id=7
/ip address add interface=bridge-PPPoE address=192.168.157.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.157.2 ip-src=192.168.157.1 name=157; /tool traffic-generator stream add mbps=2 name=str157 packet-size=1500 tx-template=157 id=8
/ip address add interface=bridge-PPPoE address=192.168.158.1/30 ; /tool traffic-generator packet-template add header-stack=mac,ip,udp ip-dst=192.168.158.2 ip-src=192.168.158.1 name=158; /tool traffic-generator stream add mbps=2 name=str158 packet-size=1500 tx-template=158 id=9

 

We used the easiest packet: UDP 1500. We use PPPoE so it's about 1480, close to 1500. We could've mixed some different packet sizes but for the tests, we wanted to check the best performance at the best condition.

 

On the Cluster side, each VLAN coming from each Station, had the other address of the /30 configured. Nothing else.

 

Everything was set up, the Cluster powered up, let's start!

Results

Test 48 stations / 48 streams 2Mbit/s

With 48 streams @2Mbit/s the aggregated throughput was  ~22Mbit/s. 

Pretty poor results, but Airmax shared that throughput among all the stations, which is good!

    

Test 48 stations / 10 streams 8Mbit/s

Same number of connected stations, but only 10 of them making traffic (which is more close to real AP utilization)

Results were much better ~42Mbit/s

Test 24 stations / 24 streams 2Mbit/s

Half the stations, results were a little better: ~32Mbit/s (The screenshot doesn't tell the correct measurements)

Conclusions

While Airmax is a good product, with a lot of pros, like low latency and jitter on each customer, higher aggregated throughput compared to the other 802.11 like technologies, it is far behind the Cambium developed solution. It costs far less, which makes Ubiquiti Airmax the best solution for non crowded areas and low budget WISPs. For crowded areas, we might consider to purchase the Cambium PMP450. Or we would love to stick with Ubiquiti if they develop their custom protocol.

Special Thanks

To be fair, i need to thank Mikrotik for his beautiful devices and OS and his Traffic Generator tool. Maybe if i had more time, i could study a way to bypass the limit of 16 streams to accomplish the tests.

Thanks to Progetto8, to Marco, Massimo, Vania and Francesco, who helped me building up the tests and providing the needed devices.

Disclaimer

We are not affiliated with any of the mentioned brands, nor Ubiquiti, nor Mikrotik, nor Cambium Networks. The tests aren't official and won't be official. The tests might be flawed by some misconfiguration ( i can't find any btw) and some other tests might give different results.