blob: a9fef8b0aaede43df680d40701d82cb01c28dfa7 [file] [log] [blame]
Hung-Wei Chiu77c969e2020-10-23 18:13:07 +00001..
2 SPDX-FileCopyrightText: © 2020 Open Networking Foundation <support@opennetworking.org>
3 SPDX-License-Identifier: Apache-2.0
4
Hung-Wei Chiu77c969e2020-10-23 18:13:07 +00005Overview
6========
Zack Williams9026f532020-11-30 11:34:32 -07007
8A Pronto deployment must have a detailed plan of the network topology and
9devices, and required cabling before being put assembled.
10
11Once planning is complete, equipment should be ordered to match the plan. The
12VAR we've used for most Pronto equipment is ASA (aka "RackLive").
13
Zack Williamse8c3b2c2021-02-01 12:47:28 -070014.. _network_cable_plan:
15
Zack Williams9026f532020-11-30 11:34:32 -070016Network Cable Plan
17------------------
18
19If a 2x2 TOST fabric is used it should be configured as a :doc:`Single-Stage
20Leaf-Spine <trellis:supported-topology>`.
21
22- The links between each leaf and spine switch must be made up of two separate
23 cables.
24
25- Each compute server is dual-homed via a separate cable to two different leaf
26 switches (as in the "paired switches" diagrams).
27
28If only a single P4 switch is used, the :doc:`Simple
29<trellis:supported-topology>` topology is used, with two connections from each
30compute server to the single switch
31
32Additionally a non-fabric switch is required to provide a set of management
33networks. This management switch is configured with multiple VLANs to separate
34the management plane, fabric, and the out-of-band and lights out management
35connections on the equipment.
36
37
Zack Williamse8c3b2c2021-02-01 12:47:28 -070038This diagram shows all the equipment used in a Pronto deployment.
39
40.. image:: images/pronto_logical_diagram.svg
41 :alt: Logical Network Diagram
42
43
Zack Williams9026f532020-11-30 11:34:32 -070044Required Hardware
45-----------------
46
47Fabric Switches
48"""""""""""""""
49
50Pronto currently uses fabric switches based on the Intel (was Barefoot) Tofino
51chipset. There are multiple variants of this switching chipset, with different
52speeds and capabilities.
53
54The specific hardware models in use in Pronto:
55
56* `EdgeCore Wedge100BF-32X
57 <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=335>`_
58 - a "Dual Pipe" chipset variant, used for the Spine switches
59
60* `EdgeCore Wedge100BF-32QS
61 <https://www.edge-core.com/productsInfo.php?cls=1&cls2=180&cls3=181&id=770>`_
62 - a "Quad Pipe" chipset variant, used for the Leaf switches
63
64Compute Servers
65"""""""""""""""
66
67These servers run Kubernetes and edge applications.
68
69The requirements for these servers:
70
71* AMD64 (aka x86-64) architecture
72* Sufficient resources to run Kubernetes
73* Two 40GbE or 100GbE Ethernet connections to the fabric switches
74* One management 1GbE port
75
76The specific hardware models in use in Pronto:
77
78* `Supermicro 6019U-TRTP2
79 <https://www.supermicro.com/en/products/system/1U/6019/SYS-6019U-TRTP2.cfm>`_
80 1U server
81
82* `Supermicro 6029U-TR4
83 <https://www.supermicro.com/en/products/system/2U/6029/SYS-6029U-TR4.cfm>`_
84 2U server
85
86These servers are configured with:
87
88* 2x `Intel Xeon 5220R CPUs
89 <https://ark.intel.com/content/www/us/en/ark/products/199354/intel-xeon-gold-5220r-processor-35-75m-cache-2-20-ghz.html>`_,
90 each with 24 cores, 48 threads
91* 384GB of DDR4 Memory, made up with 12x 16GB ECC DIMMs
92* 2TB of nVME Flash Storage
93* 2x 6TB SATA Disk storage
94* 2x 40GbE ports using an XL710QDA2 NIC
95
96The 1U servers additionally have:
97
98- 2x 1GbE copper network ports
99- 2x 10GbE SFP+ network ports
100
101The 2U servers have:
102
103- 4x 1GbE copper network ports
104
105Management Server
106"""""""""""""""""
107
108One management server is required, which must have at least two 1GbE network
109ports, and runs a variety of network services to support the edge.
110
111The model used in Pronto is a `Supermicro 5019D-FTN4
112<https://www.supermicro.com/en/Aplus/system/Embedded/AS-5019D-FTN4.cfm>`_
113
114Which is configured with:
115
116* AMD Epyc 3251 CPU with 8 cores, 16 threads
117* 32GB of DDR4 memory, in 2x 16GB ECC DIMMs
118* 1TB of nVME Flash storage
119* 4x 1GbE copper network ports
120
121Management Switch
122"""""""""""""""""
123
124This switch connects the configuration interfaces and management networks on
125all the servers and switches together.
126
127In the Pronto deployment this hardware is a `HP/Aruba 2540 Series JL356A
128<https://www.arubanetworks.com/products/switches/access/2540-series/>`_.
129