blob: 10f2e84b919cb243f17d895973e6d344b82dc231 [file] [log] [blame]
Hung-Wei Chiu77c969e2020-10-23 18:13:07 +00001..
2 SPDX-FileCopyrightText: © 2020 Open Networking Foundation <support@opennetworking.org>
3 SPDX-License-Identifier: Apache-2.0
4
Hung-Wei Chiu77c969e2020-10-23 18:13:07 +00005Overview
6========
Zack Williams9026f532020-11-30 11:34:32 -07007
8A Pronto deployment must have a detailed plan of the network topology and
9devices, and required cabling before being put assembled.
10
11Once planning is complete, equipment should be ordered to match the plan. The
12VAR we've used for most Pronto equipment is ASA (aka "RackLive").
13
14Network Cable Plan
15------------------
16
17If a 2x2 TOST fabric is used it should be configured as a :doc:`Single-Stage
18Leaf-Spine <trellis:supported-topology>`.
19
20- The links between each leaf and spine switch must be made up of two separate
21 cables.
22
23- Each compute server is dual-homed via a separate cable to two different leaf
24 switches (as in the "paired switches" diagrams).
25
26If only a single P4 switch is used, the :doc:`Simple
27<trellis:supported-topology>` topology is used, with two connections from each
28compute server to the single switch
29
30Additionally a non-fabric switch is required to provide a set of management
31networks. This management switch is configured with multiple VLANs to separate
32the management plane, fabric, and the out-of-band and lights out management
33connections on the equipment.
34
35
36Required Hardware
37-----------------
38
39Fabric Switches
40"""""""""""""""
41
42Pronto currently uses fabric switches based on the Intel (was Barefoot) Tofino
43chipset. There are multiple variants of this switching chipset, with different
44speeds and capabilities.
45
46The specific hardware models in use in Pronto:
47
48* `EdgeCore Wedge100BF-32X
49 <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=335>`_
50 - a "Dual Pipe" chipset variant, used for the Spine switches
51
52* `EdgeCore Wedge100BF-32QS
53 <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=770>`_
54 - a "Quad Pipe" chipset variant, used for the Leaf switches
55
56Compute Servers
57"""""""""""""""
58
59These servers run Kubernetes and edge applications.
60
61The requirements for these servers:
62
63* AMD64 (aka x86-64) architecture
64* Sufficient resources to run Kubernetes
65* Two 40GbE or 100GbE Ethernet connections to the fabric switches
66* One management 1GbE port
67
68The specific hardware models in use in Pronto:
69
70* `Supermicro 6019U-TRTP2
71 <https://www.supermicro.com/en/products/system/1U/6019/SYS-6019U-TRTP2.cfm>`_
72 1U server
73
74* `Supermicro 6029U-TR4
75 <https://www.supermicro.com/en/products/system/2U/6029/SYS-6029U-TR4.cfm>`_
76 2U server
77
78These servers are configured with:
79
80* 2x `Intel Xeon 5220R CPUs
81 <https://ark.intel.com/content/www/us/en/ark/products/199354/intel-xeon-gold-5220r-processor-35-75m-cache-2-20-ghz.html>`_,
82 each with 24 cores, 48 threads
83* 384GB of DDR4 Memory, made up with 12x 16GB ECC DIMMs
84* 2TB of nVME Flash Storage
85* 2x 6TB SATA Disk storage
86* 2x 40GbE ports using an XL710QDA2 NIC
87
88The 1U servers additionally have:
89
90- 2x 1GbE copper network ports
91- 2x 10GbE SFP+ network ports
92
93The 2U servers have:
94
95- 4x 1GbE copper network ports
96
97Management Server
98"""""""""""""""""
99
100One management server is required, which must have at least two 1GbE network
101ports, and runs a variety of network services to support the edge.
102
103The model used in Pronto is a `Supermicro 5019D-FTN4
104<https://www.supermicro.com/en/Aplus/system/Embedded/AS-5019D-FTN4.cfm>`_
105
106Which is configured with:
107
108* AMD Epyc 3251 CPU with 8 cores, 16 threads
109* 32GB of DDR4 memory, in 2x 16GB ECC DIMMs
110* 1TB of nVME Flash storage
111* 4x 1GbE copper network ports
112
113Management Switch
114"""""""""""""""""
115
116This switch connects the configuration interfaces and management networks on
117all the servers and switches together.
118
119In the Pronto deployment this hardware is a `HP/Aruba 2540 Series JL356A
120<https://www.arubanetworks.com/products/switches/access/2540-series/>`_.
121