Skip to content

[FEC] Design for auto-fec #1416

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Sep 27, 2023
211 changes: 211 additions & 0 deletions doc/port_auto_neg/auto-fec.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,211 @@
# SONiC Port Auto FEC Design #

## Table of Content

- [Revision](#revision)
- [Scope](#scope)
- [Definitions/Abbreviations](#definitionsabbreviations)
- [Overview](#overview)
- [Requirements](#requirements)
- [High-Level Design](#high-level-design)
- [SAI API Requirements](#sai-api-requirements)
- [SWSS Enhancements](#swss-enhancements)
- [Configuration and management ](#configuration-and-management)
- [Config command](#config-command)
- [Show command](#show-command)
- [YANG Model changes](#yang-model-changes)
- [Warmboot and Fastboot Considerations](#warmboot-and-fastboot-considerations)
- [Restrictions/Limitations](#restrictionslimitations)
- [Testing Design](#testing-design)
- [VS Test cases](#vs-test-cases)


### Revision

| Rev | Date | Author | Change Description |
|:---:|:-----------:|:-------------------:|--------------------------------------------|
| 0.1 | | Sudharsan | Initial version |

### Scope
This document is the design document for port auto fec mode on SONiC. This includes the requirements, CLI change, yang model change and swss change.

### Definitions/Abbreviations
FEC - Forward Error Correction

### Overview
SONiC supports the following FEC settings:

**None**: FEC is disabled.

**Reed Solomon (RS)**: IEEE 802.3 Clause 108 (CL108) on individual 25G channels and Clause 91 on 100G (4channels). This is the highest FEC algorithm, providing the best bit-error correction.

**Fire Code (FC)**: IEEE 802.3 Clause 74 (CL74). Base-R provides less protection from bit errors than RS FEC but adds less latency.

The behavior of FEC when autoneg is configured is currently not defined. By introducing a new FEC mode called 'auto' this document brings a deterministic approach in behavior of FEC when autoneg is configured


### Requirements

Primary requirements for configuring FEC are
- Honor the backward compatibility. If an image upgrade is done from an image without the feature to image with the feature, there should be no issues. E.g a port with 'rs' fec and AN enabled should work the same before and after the upgrade to image with the feature.
- Allow user to enable FEC to be auto negotiated
- Allow user to override the auto-negotiated FEC


### High-Level Design
In order to facilitate the behavior of FEC when autoneg is enabled, the SAI attribute SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE was introduced. Before this attribute the behavior is not clearly defined and it is dependent on vendor SAI implementation.

A new FEC mode called 'auto' is introduced.
- When FEC mode is set to any of the legacy modes (none, rs, FC) SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will be set to true. User FEC will take precedence
- When FEC mode is seto 'auto' SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will be set to false. Auto negotiated FEC will take precedence.
- To maintain backward compatibility, the SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will be queried and will be used only when it is supported.

### SAI API Requirements

The following is an existing attribute which was added to support the FEC override functionality.
```
/**
* @brief FEC mode auto-negotiation override status
*
* If set to true, any auto-negotiated FEC mode will be
* overridden by the value configured in SAI_PORT_ATTR_FEC_MODE
*
* @type bool
* @flags CREATE_AND_SET
* @default false
*/
SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE,
```
Any SAI vendors who want to make use of this deterministic behavior should implement the above attribute.

In order to get operation FEC the following attributes was recently introduced
```
* @brief Operational FEC mode
*
* If port is down or auto negotiation is in progress, the returned value should be SAI_PORT_FEC_MODE_NONE.
* If auto negotiation is on, the returned value should be the negotiated FEC.
* If auto negotiation is off, the returned value should be the set value.
*
* @type sai_port_fec_mode_t
* @flags READ_ONLY
*/
SAI_PORT_ATTR_OPER_PORT_FEC_MODE
```

### SWSS Enhancements

As specified in the high level design, the SAI attribute SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will be queried in portsorch. If it is not supported the existing behavior will continue to be in effect. If it is supported and FEC is configured, SAI_PORT_ATTR_FEC_MODE will be set to the configured FEC value followed by SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE set to true.
If FEC is configured as 'auto' by the user SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will be set to false. With FEC as 'auto', if AN is set to false, SAI_PORT_ATTR_FEC_MODE will be set to SAI_PORT_FEC_MODE_NONE. Only when autoneg is set to true, FEC mode auto will take effect.
If AN is set to true and FEC is not set, no FEC related attributes will be programmed and existing behavior will continue.
The below table covers different scenarios of what will be programmed in SAI when override is supported and not supported for various combinations of FEC and autoneg. The override supported column is updated based on querying SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE from SAI , while Autoneg and FEC comes from user configuration.


| Idx | Override supported (SAI capability) | Autoneg | FEC | SAI Attributes set by orchagent |
|:---:|:------------------:|:----------:|:----------:|---------------------------------------------------------------------------------|
| 1 | False | False | none/rs/fc | SAI_PORT_ATTR_FEC_MODE=none/rs/fc |
| 2 | False | False | auto | CLI will throw error. No FEC attributes will be set |
| 3 | False | False | N/A | No FEC attributes will be set |
| 4 | False | True | none/rs/fc | SAI_PORT_ATTR_FEC_MODE=none/rs/fc. Behavior is undeterministic when AN is enabled and user has configured FEC |
| 5 | False | True | auto | CLI will throw error. No FEC attributes will be set |
| 6 | False | True | N/A | No FEC attributes will be set |
| 7 | True | True | none/rs/fc | SAI_PORT_ATTR_FEC_MODE=none/rs/fc SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE=True |
| 8 | True | True | auto | SAI_PORT_ATTR_FEC_MODE=none, SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE=False |
| 9 | True | True | N/A | SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE will not be set |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dgsudharsan why not set override = False. What is the issue?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the case when there is no fec config. N/A means not available. FEC override will be set only when FEC is configured.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dgsudharsan FEC override = False or FEC override not set aren't the same?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FEC override attribute will be set only in the flow of setting FEC. When FEC itself is not set there will be no override attribute that needs to be programmed.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In addition by default the attribute is false, so if not set the default value expected from SAI is false. However the table is to capture what is programmed from orchagent perspective on specific combinations

| 10 | True | False | None/rs/fc | SAI_PORT_ATTR_FEC_MODE=none/rs/fc |
| 11 | True | False | auto | SAI_PORT_ATTR_FEC_MODE=none, SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE=False. However the auto will take effect only when AN is enabled and until then the mode will be none. |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dgsudharsan please throw the error to make it clear to the user that auto need AN to be enabled.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this is an error scenario. When the configuration is done, AN can be configured first followed by FEC and vice-versa. Throwing error will mislead the user. Instead I can have a notice log.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dgsudharsan ok. please add notice log

| 12 | True | False | N/A | No FEC attributes will be set |

When auto FEC mode is configured without AN enabled, or the configurations order is first FEC mode auto, followed by autoneg, the below notice log will be seen to notify user that auto FEC will work only with autoneg enabled

```
NOTICE swss#orchagent: :- isFecModeSupported:Autoneg must be enabled for port fec mode auto to work
```
The portsorch will also be responsible to update operational FEC. When oper up is detected, SAI_PORT_ATTR_OPER_FEC will be queried and updated in the STATE_DB PORT_TABLE field 'fec'.
If the vendor SAI does not support SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE, and mode auto is configured through config_db.json the following error log will be thrown

```
ERR #orchagent: :- doPortTask: Unsupported port Ethernet0 FEC mode auto
```

### Configuration and management

#### Config command

No new CLI commands are introduced to support auto FEC. The existing 'config interface fec' is extended to have additional option called 'auto'. If this option is set without autoneg enabled, it will default to 'none'

```
Format:
config interface fec <interface_name> <mode>

Arguments:
interface_name: name of the interface to be configured. e.g: Ethernet0
mode: none/rs/fc/auto

Example:
config interface fec Ethernet0 auto

Return:
error message if interface_name or mode is invalid otherwise empty
```

If a vendor doesn't support auto mode, an error will be thrown when 'auto' mode is configured.
```
sonic# config interface fec Ethernet0 auto
fec auto is not in ['rs', 'fc', 'none']
```

#### Show command

Currently the configured FEC mode is displayed in "show interfaces status" command. With the introduction of mode 'auto' it becomes necessary to display operational FEC. The operational FEC will be queried from SAI during oper up sequence using SAI_PORT_ATTR_OPER_FEC. This will be updated to state_db PORT_TABLE field "fec".
A new show command is introduced to display the FEC admin and oper status.
The show command will query the state DB and if there is FEC field, it would be displayed.

````
admin@sonic:~$ show interfaces fec status
Interface FEC Oper FEC Admin
----------- ---------- -----------
Ethernet0 N/A rs
Ethernet32 N/A rs
Ethernet36 N/A N/A
Ethernet112 N/A rs
Ethernet116 N/A rs
Ethernet120 N/A rs
Ethernet124 rs auto
````

### YANG model changes

The yang model will be modified to accept additional value 'auto' for FEC

```
leaf fec {
type string {
pattern "rs|fc|none|auto";
}
}
```

### Warmboot and Fastboot Considerations

No impact to warm or fastboot

### Restrictions/Limitations

Since previously the behavior of FEC with autoneg is undefined, if a vendor always gives precedence for auto negotiated FEC over user configured FEC, implementing the new attribute may lead to backward incompatibility issues when SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE is implemented. Since orchagent will always set SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE to true when FEC is explicitly configured and the attribute is supported by SAI, there will be difference in behavior before and after upgrade.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE support by the platform itself means that the platform is going to OVERRIDE its existing behavior. isn't it? If so, the difference in behavior is expected...i mean it will be a breaking change though...If the platform choose to keep the original behavior, then it means the platform is not supporting the override SAI attribute in which case why support override attribute?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If there is difference in behavior, it should be also made backward compatible through db_migrator. It is upto the vendors to decide whether they want to support new attribute and introduce db_migrator if they need it for solving the backward incompatibility or avoid introducing the attribute altogether.


In order to mitigate for those platforms, a db migrator plugin can be introduced which will be executed based on platform check. This plugin will change 'fec' to 'auto' if the attribute exists in port table and 'autoneg' is enabled. This will make sure that previously when autoneg was given precedence over user configuration, it will continue to happen even after the upgrade.
Below table gives details on when db_migrator will be needed when vendor implements FEC override. The previous behavior details when user has configured FEC as well as autoneg enabled.

| Idx | Previous behavior | DB Migrator required |
|:---:|:----------------------------------------------------------:|:-----------------------:|
| 1 | Auto negotiation takes precedence over user configured FEC | Yes |
| 2 | User configured FEC takes precedence over auto negotiation | No |

### Testing Design

#### VS Test cases

1. Add SWSS VS test to query SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE and if supported expect SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE to be set to true when FEC is configured.
2. If SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE is not suppored it should not be set when configuring FEC
3. Set FEC mode to auto and AN=true verify SAI_PORT_ATTR_AUTO_NEG_FEC_MODE_OVERRIDE is set to false
4. Set FEC mode to auto and AN=false verify no FEC mode is programmed