Hung-Wei Chiu | 77c969e | 2020-10-23 18:13:07 +0000 | [diff] [blame] | 1 | .. |
| 2 | SPDX-FileCopyrightText: © 2020 Open Networking Foundation <support@opennetworking.org> |
| 3 | SPDX-License-Identifier: Apache-2.0 |
| 4 | |
Hung-Wei Chiu | 77c969e | 2020-10-23 18:13:07 +0000 | [diff] [blame] | 5 | Overview |
| 6 | ======== |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 7 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 8 | There are many ways to deploy Aether, depending on the requirements of the edge |
| 9 | site. The Reliability, Availability, and Serviceability (RAS) of each set of |
| 10 | equipment will differ depending on the characteristics of each edge. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 11 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 12 | This document provides several hardware deployment options and explains the |
| 13 | differences between them. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 14 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 15 | Deployment Options |
| 16 | ------------------ |
| 17 | |
| 18 | Development Environments |
| 19 | """""""""""""""""""""""" |
| 20 | |
| 21 | For users looking for a development or fully software-simulated environment, |
| 22 | there is ``Aether-in-a-Box (AiaB)`` - instructions for running this can be |
| 23 | found in the :doc:`Aether SD-Core Developer Guide </developer/sdcore>`. AiaB |
| 24 | is only suitable for testing and developing software, and can't connect to |
| 25 | physical hardware, but is a good choice for learning about the different |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 26 | software components within Aether. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 27 | |
| 28 | Production Environments |
| 29 | """"""""""""""""""""""" |
| 30 | |
| 31 | Deploying Aether on hardware is required for both production deployments and |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 32 | hardware testing. Before deploying Aether, a detailed plan including the |
| 33 | network topology, hardware, and all cabling needs to be created. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 34 | |
| 35 | For redundancy of workloads running in Kubernetes, at least 3 compute nodes |
| 36 | must be available. A single or pair of compute nodes can be used, but software |
| 37 | would need to be configured without High Availability (HA) enabled. |
Zack Williams | e8c3b2c | 2021-02-01 12:47:28 -0700 | [diff] [blame] | 38 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 39 | The topologies below are *simplified physical topologies* to show the equipment |
| 40 | needed and the minimal connectivity between devices. Within these topologies, |
| 41 | multiple VLANs, routing, and other network-level configuration is required to |
| 42 | make a functional Aether edge. |
| 43 | |
| 44 | There are also possible RAS improvements that can be done at a topology level - |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 45 | for example, fabric switch connections can be made with two cables, and |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 46 | configured to tolerate the failure or replacement of one cable or NIC port, |
| 47 | which is recommended especially for inter-switch links. |
| 48 | |
| 49 | Edge Connectivity |
| 50 | ----------------- |
| 51 | |
| 52 | Aether's is a managed service, and Aether Edges require a constant connection |
| 53 | via VPN to the 4G and 5G core in Aether Central for managing subscriber |
| 54 | information. |
| 55 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 56 | The edge site must provide internet access to the Aether edge, specifically the |
| 57 | Management Server. The traffic required is: |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 58 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 59 | * VPN connection (ESP protocol, Ports UDP/500 and UDP/4500) to Aether Central |
| 60 | |
| 61 | * SSH (TCP/22). used for installation, troubleshooting, and updating the site. |
| 62 | |
| 63 | * General outgoing internet access used for installation of software and other |
| 64 | components from ONF and public (Ubuntu) software repositories. |
| 65 | |
| 66 | The open ports can be restricted to specific internet addresses which are used |
| 67 | for Aether. |
| 68 | |
| 69 | The Management Server needs to have an IP address assigned to it, which can be either: |
| 70 | |
| 71 | * A public static IP address |
| 72 | |
| 73 | * Behind NAT with port forwarding with the ports listed above forwarded to the |
| 74 | Management Server |
| 75 | |
| 76 | In either case, the Management Server's IP address should be assigned using |
| 77 | a reserved DHCP if possible, which eases the installation process. |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 78 | |
| 79 | BESS-based Network Topology |
| 80 | --------------------------- |
| 81 | |
| 82 | The :doc:`Software-only BESS UPF |
| 83 | </edge_deployment/bess_upf_deployment>`, which can be used for deployments that |
| 84 | do not have P4 switching hardware. |
| 85 | |
| 86 | .. image:: images/edge_mgmt_only.svg |
| 87 | :alt: BESS network topology |
| 88 | |
| 89 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 90 | `BESS <https://github.com/NetSys/bess>`_ runs on an x86 compute server, and is |
| 91 | deployed using Kubernetes. In production it requires an SR-IOV capable network |
| 92 | card, and specific K8s CNIs to be used. |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 93 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 94 | The Management Server and Switch must be configured with multiple VLANs and |
| 95 | subnets with routing required for the BESS UPF. |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 96 | |
| 97 | P4-based Network Topology |
| 98 | ------------------------- |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 99 | |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 100 | If only a single P4 switch is used, the :doc:`Simple |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 101 | <trellis:supported-topology>` topology can be used, but provides no network |
| 102 | redundancy: |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 103 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 104 | .. image:: images/edge_single.svg |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 105 | :alt: Single Switch Topology |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 106 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 107 | If another switch is added, the "Paired Leaves" (aka :doc:`Paired Switches |
| 108 | <trellis:supported-topology>`) topology can be used, which can tolerate the |
| 109 | loss of a leaf switch and still retain connections for all dual-homed devices. |
| 110 | Single homed devices on the failed leaf would lose their connections (the |
| 111 | single-homed server is shown for reference, and not required). If HA is needed |
| 112 | for single-homed devices, one option would be to deploying multiple of those |
| 113 | devices in a way that provides that redundancy - for example, multiple eNBs |
| 114 | where some are connected to each leaf and have overlapping radio coverage: |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 115 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 116 | .. image:: images/edge_paired_leaves.svg |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 117 | :alt: Paired Leaves Topology |
Zack Williams | e8c3b2c | 2021-02-01 12:47:28 -0700 | [diff] [blame] | 118 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 119 | For larger deployments, a 2x2 fabric can be configured (aka :doc:`Single-Stage |
| 120 | Leaf-Spine <trellis:supported-topology>`), which provide Spine redundancy, but |
| 121 | does not support dual-homing of devices. |
| 122 | |
| 123 | .. image:: images/edge_2x2.svg |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 124 | :alt: 2x2 Fabric Topology |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 125 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 126 | Other topologies as described in the :doc:`Trellis Documentation |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 127 | <trellis:supported-topology>` can possibly be used, but are not actively being |
| 128 | tested at this time. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 129 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 130 | Additionally, the P4-based topologies can support running both the BESS UPF and |
| 131 | P4 UPF on the same hardware at the same time if desired (for testing, or |
| 132 | simultaneous 4G/5G support). |
Zack Williams | e8c3b2c | 2021-02-01 12:47:28 -0700 | [diff] [blame] | 133 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 134 | Hardware Descriptions |
| 135 | --------------------- |
Zack Williams | e8c3b2c | 2021-02-01 12:47:28 -0700 | [diff] [blame] | 136 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 137 | Fabric Switch |
| 138 | """"""""""""" |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 139 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 140 | To use the P4 UPF, you must use fabric switches based on the `Intel (previously |
| 141 | Barefoot) Tofino chipset |
| 142 | <https://www.intel.com/content/www/us/en/products/network-io/programmable-ethernet-switch/tofino-series.html>`_. |
| 143 | There are two variants of this switching chipset, with different resources and |
| 144 | capabilities. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 145 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 146 | Aether currently supports these P4 switch models: |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 147 | |
| 148 | * `EdgeCore Wedge100BF-32X |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 149 | <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=335>`_, |
| 150 | a Dual Pipe Tofino ASIC |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 151 | |
| 152 | * `EdgeCore Wedge100BF-32QS |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 153 | <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=770>`_, |
| 154 | a Quad Pipe Tofino ASIC, which has more chip resources and a faster embedded |
| 155 | system with more memory and storage. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 156 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 157 | The P4 UPF and SD-Fabric features run within the constraints of the Dual Pipe |
| 158 | system for production deployments, but for development of features in P4, the |
| 159 | larger capacity of the Quad Pipe is desirable. |
| 160 | |
| 161 | These switches feature 32 QSFP+ ports capable of running in 100GbE, 40GbE, or |
| 162 | 4x 10GbE mode (using a split DAC or fiber cable) and have a 1GbE management |
| 163 | network interface. |
| 164 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 165 | See also the :ref:`Rackmount of Equipment |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 166 | <edge_deployment/site_planning:rackmount of equipment>` for how the Fabric |
| 167 | switches should be rackmounted to ensure proper airflow within a rack. |
| 168 | |
| 169 | Compute Server |
| 170 | """""""""""""" |
| 171 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 172 | These servers run Kubernetes, Aether connectivity apps, and edge applications. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 173 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 174 | Minimum hardware specifications: |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 175 | |
| 176 | * AMD64 (aka x86-64) architecture |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 177 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 178 | * 8 CPU Cores (minimum), 16+ recommended |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 179 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 180 | * 32GB of RAM (minimum), 128GB+ recommended |
| 181 | |
| 182 | * 250 GB of storage (SSD preferred), 1TB+ recommended |
| 183 | |
| 184 | * 2x 40GbE or 100GbE Ethernet network card to P4 switches, with DPDK support |
| 185 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 186 | * 1x 1GbE management network port, with PXE boot support. 2x required for BESS |
| 187 | UPF. |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 188 | |
| 189 | Optional but highly recommended: |
| 190 | |
| 191 | * Lights out management support, with either a shared or separate NIC and |
| 192 | support for HTML5 console access. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 193 | |
| 194 | Management Server |
| 195 | """"""""""""""""" |
| 196 | |
| 197 | One management server is required, which must have at least two 1GbE network |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 198 | ports, and runs a variety of network services to bootstrap and support the |
| 199 | edge. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 200 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 201 | In current Aether deployments, the Management Server also functions as a router |
| 202 | and VPN gateway back to Aether Central. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 203 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 204 | Minimum hardware specifications: |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 205 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 206 | * AMD64 (aka x86-64) architecture |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 207 | |
| 208 | * 4 CPU cores, or more |
| 209 | |
| 210 | * 8GB of RAM, or more |
| 211 | |
| 212 | * 120GB of storage (SSD preferred), or more |
| 213 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 214 | * 2x 1GbE Network interfaces (one for WAN, one to the management switch) with |
| 215 | PXE boot support. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 216 | |
| 217 | Optional: |
| 218 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 219 | * 10GbE or 40GbE network card with DPDK support to connect to fabric switch |
| 220 | |
| 221 | * Lights out management support, with either a shared or separate NIC and |
| 222 | support for HTML5 console access. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 223 | |
| 224 | Management Switch |
| 225 | """"""""""""""""" |
| 226 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 227 | A managed L2/L3 management switch is required to provide connectivity within |
| 228 | the cluster for bootstrapping equipment. It is configured with multiple VLANs |
| 229 | to separate the management plane, fabric, and the out-of-band and lights out |
| 230 | management connections on the equipment. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 231 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 232 | Minimum requirements: |
| 233 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 234 | * 8x 1GbE Copper Ethernet ports (adjust to provide a sufficient number for |
| 235 | every copper 1GbE port in the system) |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 236 | |
| 237 | * 2x 10GbE SFP+ or 40GbE QSFP interfaces (only required if management server |
| 238 | does not have a network card with these ports) |
| 239 | |
| 240 | * Managed via SSH or web interface |
| 241 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 242 | * LLDP protocol support, for debugging cabling issues |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 243 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 244 | * Capable supporting VLANs on each port, with both tagged and untagged traffic |
| 245 | sharing a port. |
| 246 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 247 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 248 | Optional: |
| 249 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 250 | * PoE+ support, which can power eNB and monitoring hardware, if using |
| 251 | Management switch to host these devices. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 252 | |
| 253 | eNB Radio |
| 254 | """"""""" |
| 255 | |
| 256 | The LTE eNB used in most deployments is the `Sercomm P27-SCE4255W Indoor CBRS |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 257 | Small Cell |
| 258 | <https://www.sercomm.com/contpage.aspx?langid=1&type=prod3&L1id=2&L2id=1&L3id=107&Prodid=751>`_. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 259 | |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 260 | While this unit ships with a separate power brick, it also supports PoE+ power |
| 261 | on the WAN port, which provides deployment location flexibility. Either a PoE+ |
| 262 | capable switch or PoE+ power injector should be purchased. |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 263 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 264 | If connecting directly to the fabric switch through a QSFP to 4x SFP+ split |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 265 | cable, a 10GbE SFP+ to 1GbE Copper media converter should be purchased. The `FS |
| 266 | UMC-1S1T <https://www.fs.com/products/101476.html>`_ has been used for this |
| 267 | purpose successfully. |
| 268 | |
| 269 | Alternatively, the Fabric's 10GbE SFP+ could be connected to another switch |
| 270 | (possibly the Management Switch) which would adapt the speed difference, and |
| 271 | provide PoE+ power, and power control for remote manageability. |
| 272 | |
| 273 | |
| 274 | Testing Hardware |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 275 | ---------------- |
| 276 | |
| 277 | The following hardware is used to test the network and determine uptime of |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 278 | edges. It is currently required, to properly validate that an edge site is |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 279 | functioning properly. |
Zack Williams | 9026f53 | 2020-11-30 11:34:32 -0700 | [diff] [blame] | 280 | |
Hyunsun Moon | 2b62676 | 2021-03-26 16:21:14 -0700 | [diff] [blame] | 281 | Monitoring Raspberry Pi and CBRS dongle |
| 282 | """"""""""""""""""""""""""""""""""""""" |
| 283 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 284 | One pair of Raspberry Pi and CBRS band supported LTE dongle is required to |
| 285 | monitor the connectivity service at the edge. |
Hyunsun Moon | 2b62676 | 2021-03-26 16:21:14 -0700 | [diff] [blame] | 286 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 287 | The Raspberry Pi model used in Aether is a `Raspberry Pi 4 Model B/2GB |
Hyunsun Moon | 2b62676 | 2021-03-26 16:21:14 -0700 | [diff] [blame] | 288 | <https://www.pishop.us/product/raspberry-pi-4-model-b-2gb/>`_ |
| 289 | |
| 290 | Which is configured with: |
| 291 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 292 | * Raspberry Pi case (HiPi is recommended for PoE Hat) |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 293 | |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 294 | * A power source, either one of: |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 295 | |
| 296 | * PoE Hat used with a PoE switch (recommended, allows remote power control) |
| 297 | |
| 298 | * USB-C Power Supply |
| 299 | |
Hyunsun Moon | 2b62676 | 2021-03-26 16:21:14 -0700 | [diff] [blame] | 300 | * MicroSD Card with Raspbian - 16GB |
| 301 | |
Zack Williams | 1ae109e | 2021-07-27 11:17:04 -0700 | [diff] [blame] | 302 | One LTE dongle model supported in Aether is the `Sercomm Adventure Wingle |
Hyunsun Moon | 2b62676 | 2021-03-26 16:21:14 -0700 | [diff] [blame] | 303 | <https://www.sercomm.com/contpage.aspx?langid=1&type=prod3&L1id=2&L2id=2&L3id=110&Prodid=767>`_. |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 304 | |
| 305 | |
| 306 | Example BoMs |
| 307 | ------------ |
| 308 | |
| 309 | To help provision a site, a few example Bill of Materials (BoM) are given |
| 310 | below, which reference the hardware descriptions given above. |
| 311 | |
| 312 | Some quantities are dependent on other quantities - for example, the number of |
| 313 | DAC cables frequently depends on the number of servers in use. |
| 314 | |
| 315 | These BOMs do not include UE devices. It's recommended that the testing |
| 316 | hardware given above be added to every BoM for monitoring purposes. |
| 317 | |
| 318 | |
| 319 | BESS UPF Testing BOM |
| 320 | """""""""""""""""""" |
| 321 | |
| 322 | The following is the minimum BoM required to run Aether with the BESS UPF. |
| 323 | |
| 324 | ============ ===================== =============================================== |
| 325 | Quantity Type Purpose |
| 326 | ============ ===================== =============================================== |
| 327 | 1 Management Switch Must be Layer 2/3 capable for BESS VLANs |
| 328 | 1 Management Server |
| 329 | 1-3 Compute Servers Recommended at least 3 for Kubernetes HA |
| 330 | 1 (or more) eNB |
| 331 | 1x #eNB PoE+ Injector Required unless using a PoE+ Switch |
| 332 | Sufficient Cat6 Network Cabling Between all equipment |
| 333 | ============ ===================== =============================================== |
| 334 | |
| 335 | P4 UPF Testing BOM |
| 336 | """""""""""""""""" |
| 337 | |
| 338 | ============ ===================== =============================================== |
| 339 | Quantity Type Description/Use |
| 340 | ============ ===================== =============================================== |
| 341 | 1 P4 Fabric Switch |
| 342 | 1 Management Switch Must be Layer 2/3 capable |
| 343 | 1 Management Server At least 1x 40GbE QSFP ports recommended |
| 344 | 1-3 Compute Servers Recommended at least 3 for Kubernetes HA |
| 345 | 2x #Server 40GbE QSFP DAC cable Between Compute, Management, and Fabric Switch |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 346 | 1 QSFP to 4x SFP+ DAC Split cable between Fabric and eNB |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 347 | 1 (or more) eNB |
| 348 | 1x #eNB 10GbE to 1GbE Media Required unless using switch to convert from |
| 349 | converter fabric to eNB |
| 350 | 1x #eNB PoE+ Injector Required unless using a PoE+ Switch |
| 351 | Sufficient Cat6 Network Cabling Between all equipment |
| 352 | ============ ===================== =============================================== |
| 353 | |
| 354 | P4 UPF Paired Leaves BOM |
| 355 | """""""""""""""""""""""" |
| 356 | |
| 357 | ============ ===================== =============================================== |
| 358 | Quantity Type Description/Use |
| 359 | ============ ===================== =============================================== |
| 360 | 2 P4 Fabric Switch |
| 361 | 1 Management Switch Must be Layer 2/3 capable |
| 362 | 1 Management Server 2x 40GbE QSFP ports recommended |
| 363 | 3 Compute Servers |
| 364 | 2 100GbE QSFP DAC cable Between Fabric switches |
| 365 | 2x #Server 40GbE QSFP DAC cable Between Compute, Management, and Fabric Switch |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 366 | 1 (or more) QSFP to 4x SFP+ DAC Split cable between Fabric and eNB |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 367 | 1 (or more) eNB |
| 368 | 1x #eNB 10GbE to 1GbE Media Required unless using switch to convert from |
| 369 | converter fabric to eNB |
| 370 | 1x #eNB PoE+ Injector Required unless using a PoE+ Switch |
| 371 | Sufficient Cat6 Network Cabling Between all equipment |
| 372 | ============ ===================== =============================================== |
| 373 | |
| 374 | |
| 375 | P4 UPF 2x2 Leaf Spine Fabric BOM |
| 376 | """""""""""""""""""""""""""""""" |
| 377 | |
| 378 | ============ ===================== =============================================== |
| 379 | Quantity Type Description/Use |
| 380 | ============ ===================== =============================================== |
| 381 | 4 P4 Fabric Switch |
| 382 | 1 Management Switch Must be Layer 2/3 capable |
| 383 | 1 Management Server 2x 40GbE QSFP ports recommended |
| 384 | 3 Compute Servers |
| 385 | 8 100GbE QSFP DAC cable Between Fabric switches |
| 386 | 2x #Server 40GbE QSFP DAC cable Between Compute, Management, and Fabric Switch |
Zack Williams | 2dfb624 | 2021-08-24 09:19:00 -0700 | [diff] [blame^] | 387 | 1 (or more) QSFP to 4x SFP+ DAC Split cable between Fabric and eNB |
Zack Williams | 589ac23 | 2021-08-19 08:52:18 -0700 | [diff] [blame] | 388 | 1 (or more) eNB |
| 389 | 1x #eNB 10GbE to 1GbE Media Required unless using switch to convert from |
| 390 | converter fabric to eNB |
| 391 | 1x #eNB PoE+ Injector Required unless using a PoE+ Switch |
| 392 | Sufficient Cat6 Network Cabling Between all equipment |
| 393 | ============ ===================== =============================================== |
| 394 | |