Facebook Network Appliance Quick Start Guide Ver 1.

1
Connect the Network Cables
Q ui ck St ar t Gu id e Locate the green sticker on the network cable
Facebook Network Appliance (FNA) – SKU1 and SKU2 connector and the network interface controller (NIC).
Orientate the connector so that the green sticker is
facing up. Connect the network cable to the network
For detailed installation and configuration information, port with the green sticker.
request the FNA Installation and Operation Guide.

Installation
Unpack Equipment and Check Contents
Make sure you have received the following
equipment:

Quantity Equipment SKU Type

SKU1
1 Network Switch
Connect the server at the highest position in the rack
SKU1, SKU2 (fna001) to QSFP+ port 32 on the switch. Utilize the
4 Server
following table as a reference for port connectivity
SKU1, SKU2
4 4-Post Rail Kit sequence for the remaining servers.
C13-C14 AC Power SKU1, SKU2
8
Cord
Server-Switch SKU1, SKU2
4
Network Cable
SFP+ Optical SKU1, SKU2 Rack Location Server Name Switch Port
2
Transceiver (LR or SR)
Top fna001 32

Rack the Servers 2nd from Top fna002 31

Install the servers into a compatible rack1. Use the
3rd from Top fna003 30
manufacturer’s documentation for assistance with
racking the servers. 4th from Top fna004 29

Connect AC power cables from each server to the

power distribution units (PDUs).

Rack the Switch

Install the switch into the rack. If needed, use the
manufacturer’s documentation for assistance with
racking the switch.

1: Installing servers in a 2-Post rack requires appropriate conversion

hardware.
2: The switch does not have power buttons. The switch powers on when

connected to a power source.

-1-
Facebook Network Appliance Quick Start Guide Ver 1.1
Connect the Switch to the Router Check Optical Light Levels
Install the optical transceivers to SFP+ ports 1 and 2. Check the optical light levels to ensure that the
Connect fiber patch cables from the switch to your cluster has adequate signal strength. Light levels
facility’s router. need to be between -2 dB and -7 dB.

Finish
This finishes the hardware isntallation procedure.
Perform the Network Configuration procedure. The
following diagram depicts a properly cabled FNA.

Power On the FNA

Press the power buttons on all four servers and
connect two AC power cables to the network switch.2
HardwareSpecifications - DC

Server
Maximum Rated Output Power 750W @ 36VDC ~ 72VDC
Maximum Rated Input Power  815W @ 36VDC
 805W @ 48VDC
 795W @ 72VDC
Input Voltage Range (VIN) 36VDC ~ 72VDC
Efficiency 91.5%
Nominal Input Current  23A @ 36VDC
 17A @ 48VDC
 11A @ 72VDC
Verify Basic Operation Power Cord  Length: 2 Meters
Check the LEDs on each server’s power supply, NIC,  Plug: SS10A
and solid state drive. Additionally, check the switch’s  Connector: HS10S
power supply and system status LED. The following
Operating Temperature Range 10°C to 35°C
table represents the behavior each LED should
Dimensions (HxWxD) 8.73 x 44.55 x 73.02 cm
display. (3.44 x 17.54 x 28.75 in)
Weight 14.7 kg (32.6 lb)
System - Component LED Name Behavior
Solid State Drive Capacity (per 1.86 TB
drive)
On, Steady
Server – Power Supply Status Green
Switch
On, Steady Input Voltage Range (VIN) 100 – 240 VAC
Server – Solid State Green
Drive
Status Efficiency 91%
Maximum Power 340W
On, Steady or
Server – Network Blinking Green Nominal Input Current 33A
Activity, Link
Interface Controller
Power Cord  Length: 2 Meters
On, Steady
Switch - Chassis Status Green  Plug: SS10A
 Connector: HS10S
Operating Temperature Range 0°C to 40°C
Dimensions (HxWxD) 4.4 x 43.9 x 50.50 cm
(1.72 x 17.3 x 19.7 in)
Weight 9.3 kg (21.5 lb)

-2-
HardwareSpecifications - AC
Facebook Network Appliance Quick Start Guide Ver 1.1

Network Configuration

Point-to-Point Link
The point-to-point connection is configured on the
Link-Aggregation Control Protocol (LACP) interface. Make sure
the following parameters are configured as follows:

 Untag the Virtual LAN (VLAN)

link-aggregation interface
 Set a static route to the allocated subnets via the
link-aggregation interface

The FNA must have internet connectivity before BGP peering can be established. The BGP peering session does not need to be routing before the FNA has
internet connectivity.

The FNA kit is preconfigured with the IP addresses that were specified in the order form. If IP addresses need to be changed at any time, refer to the latest version
of the FNA USB Boot Disk Creation and IP Reconfiguration Guide (available upon request).

Border Gateway Protocol (BGP)

The following describes how to configure BGP settings to ensure proper establishment.

 Use the IPv4 and IPv6 addresses originally indicated in the FNA order form.
 (Optional) Enable Graceful Restart (GR). For additional configuration details, contact fna-ops@fb.com and request the FNA Installation and
Operation Guide.
Enabling GR is not required, but it is recommended. If you have questions regarding GR and FNA deployments, contact
fna-ops@fb.com.

 Enable External BGP (EGBP) Multihop.

 Peering Autonomous System Number (ASN): 63293
 Configure your router’s BGP settings. For additional configuration information, contact fna-ops@fb.com and request the FNA Installation and
Operation Guide.
 FNA’s prefix should be announced to all Facebook peering connections.
 Routes advertised to the FNA must be present in the global routing table with the same destination Autonomous System (AS).

Software Delivery and Session Establishment

 After the BGP settings are saved, the FNA cluster will begin downloading application data.
 Within about two business days, BGP peering will be established:
o The connection wil be coming from the 16th IP address in each allocated subnet (e.g., 192.168.1.16, fe80::10)
o FNA will not advertise any routes / prefixes
 Contact fbticket@us.ibm.com to notify that the installation has been completed.
All servable Facebook netblocks should be announced for network traffic optimization (completed by the latency based routing test).

FNA applies inbound filtering to reject the following address spaces: default route, bogons, RFC 1918, Facebook’s IP, CGNAT (RFC 1918 and 6598 address spaces are
acceptable), and prefixes smaller than /24.

Support

Contact fna-ops@fb.com if you have questions about the installation or configuration process.

-3-