The following output displays an example configuration and explanation with and without dist-lag-rate-shared.
*B:ALU-A>config>port# info
----------------------------------------------
ethernet
mode access
egress-scheduler-policy "psp"
autonegotiate limited
exit
no shutdown
----------------------------------------------
*B:ALU-A>config>port# /configure lag 30
*B:ALU-A>config>lag# info
----------------------------------------------
description "Description For LAG Number 30"
mode access
port 2/1/6
port 2/1/10
port 3/2/1
port 3/2/2
no shutdown
*B:ALU-A>config>service>ies>if>sap# /configure qos port-scheduler-policy "psp"
*B:ALU-A>config>qos>port-sched-plcy# info
----------------------------------------------
max-rate 413202
In this example, before enabling dist-lag-rate-shared, in the port-scheduler-policy psp, the max-rate achieved is twice 413202 kb/s (826 Mb/s). This is because LAG has members from two different cards.
Two port-scheduler-instances are created: one on each card with the max-rate of 413202 kb/s. This can be confirmed using the following show output.
When dist-lag-rate-shared is enabled in port-scheduler-policy, this max-rate is enforced across all members of the LAG.
*B:ALU-A>config>service>ies>if>sap# /show qos scheduler-hierarchy sap lag-30 egress
detail
===============================================================================
Scheduler Hierarchy - Sap lag-30
===============================================================================
Egress Scheduler Policy :
-------------------------------------------------------------------------------
Legend :
(*) real-time dynamic value
(w) Wire rates
B Bytes
-------------------------------------------------------------------------------
Root (Egr)
| slot(2)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:2000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:2000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:413202(w) Offered:2000000(w) <----without dist-lag-rate-shared 413MB
is assigned to slot 2
| | Consumed:413202(w)
| |
| |
| | TotalConsumed:413202(w)
| | OperPIR:406494
| |
| | [As Parent]
| | OperPIR:406494 OperCIR:0
| | ConsumedByChildren:406494
| |
| |
| |--(Q) : 1->lag-30(2/1/6)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:1045760 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:203247 Offered:1000000
| | | Consumed:203247
| | |
| | | OperPIR:205000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(2/1/10)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:1048320 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:203247 Offered:1000000
| | | Consumed:203247
| | |
| | | OperPIR:205000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| slot(3)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:2000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:2000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:413202(w) Offered:2000000(w) <----without dist-lag-rate-shared 413MB
is assigned to slot 3
| | Consumed:413202(w)
| |
| |
| | TotalConsumed:413202(w)
| | OperPIR:406494
| |
| | [As Parent]
| | OperPIR:406494 OperCIR:0
| | ConsumedByChildren:406494
| |
| |
| |--(Q) : 1->lag-30(3/2/2)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1106976 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:203247 Offered:1000000
| | | Consumed:203247
| | |
| | | OperPIR:203125 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(3/2/1)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1106976 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:203247 Offered:1000000
| | | Consumed:203247
| | |
| | | OperPIR:203125 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
The following output shows dist-lag-rate-shared enabled.
*B:ALU-A>config>qos>port-sched-plcy# dist-lag-rate-shared
*B:ALU-A>config>qos>port-sched-plcy# info
----------------------------------------------
dist-lag-rate-shared
max-rate 413202
----------------------------------------------
*B:ALU-A>config>qos>port-sched-plcy# !/show
*B:ALU-A>config>qos>port-sched-plcy# /show qos scheduler-hierarchy sap lag-30 egress\
detail
===============================================================================
Scheduler Hierarchy - Sap lag-30
===============================================================================
Egress Scheduler Policy :
-------------------------------------------------------------------------------
Legend :
(*) real-time dynamic value
(w) Wire rates
B Bytes
-------------------------------------------------------------------------------
Root (Egr)
| slot(2)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:2000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:2000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:206601(w) Offered:2000000(w) <----with dist-lag-rate-shared 206 Mb
is assigned to slot 2
| | Consumed:206601(w)
| |
| |
| | TotalConsumed:206601(w)
| | OperPIR:203247
| |
| | [As Parent]
| | OperPIR:203247 OperCIR:0
| | ConsumedByChildren:203247
| |
| |
| |--(Q) : 1->lag-30(2/1/6)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:1045760 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:101624 Offered:1000000
| | | Consumed:101624
| | |
| | | OperPIR:102000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(2/1/10)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:1047040 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:101624 Offered:1000000
| | | Consumed:101624
| | |
| | | OperPIR:102000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| slot(3)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:2000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:2000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:206601(w) Offered:2000000(w) <----with dist-lag-rate-shared 206 Mb
is assigned to slot 3
| | Consumed:206601(w)
| |
| |
| | TotalConsumed:206601(w)
| | OperPIR:203247
| |
| | [As Parent]
| | OperPIR:203247 OperCIR:0
| | ConsumedByChildren:203247
| |
| |
| |--(Q) : 1->lag-30(3/2/2)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1105728 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:101624 Offered:1000000
| | | Consumed:101624
| | |
| | | OperPIR:101500 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(3/2/1)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1105728 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:101624 Offered:1000000
| | | Consumed:101624
| | |
| | | OperPIR:101500 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
===============================================================================
*B:ALU-A>config>qos>port-sched-plcy#
If one of the member links of the LAG goes down, the max-rate is divided among the remaining lag members.
Card 2 is assigned 137734 (1/3 of max-rate 413202).
Card 3 is assigned 275468 (2/3 of max-rate 413202).
*B:ALU-A>config>qos>port-sched-plcy# /show lag 30 detail
===============================================================================
LAG Details
===============================================================================
Description : Description For LAG Number 30
-------------------------------------------------------------------------------
Details
-------------------------------------------------------------------------------
Lag-id : 30 Mode : access
Adm : up Opr : up
Thres. Exceeded Cnt : 11 Port Threshold : 0
Thres. Last Cleared : 06/25/2014 21:47:49 Threshold Action : down
Dynamic Cost : false Encap Type : null
Configured Address : 00:1a:f0:1d:8b:c9 Lag-IfIndex : 1342177310
Hardware Address : 00:1a:f0:1d:8b:c9 Adapt Qos (access) : distribute
Hold-time Down : 0.0 sec Port Type : standard
Per-Link-Hash : disabled
Include-Egr-Hash-Cfg: disabled
Per FP Ing Queuing : disabled Per FP Egr Queuing : disabled
Per FP SAP Instance : disabled
LACP : disabled
Standby Signaling : lacp
Port weight : 0 gbps Number/Weight Up : 3
Weight Threshold : 0 Threshold Action : down
-------------------------------------------------------------------------------
Port-id Adm Act/Stdby Opr Primary Sub-group Forced Prio
-------------------------------------------------------------------------------
2/1/6 up active down yes 1 - 32768
2/1/10 up active up 1 - 32768
3/2/1 up active up 1 - 32768
3/2/2 up active up 1 - 32768
===============================================================================
*B:ALU-A>config>qos>port-sched-plcy# /show qos scheduler-hierarchy sap lag-30 egress
detail
===============================================================================
Scheduler Hierarchy - Sap lag-30
===============================================================================
Egress Scheduler Policy :
-------------------------------------------------------------------------------
Legend :
(*) real-time dynamic value
(w) Wire rates
B Bytes
-------------------------------------------------------------------------------
Root (Egr)
| slot(2)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:1000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:1000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:137734(w) Offered:1000000(w)
| | Consumed:137734(w)
| |
| |
| | TotalConsumed:137734(w)
| | OperPIR:135498
| |
| | [As Parent]
| | OperPIR:135498 OperCIR:0
| | ConsumedByChildren:135498
| |
| |
| |--(Q) : 1->lag-30(2/1/6)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:0 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:67749 Offered:0
| | | Consumed:0
| | |
| | | OperPIR:68000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(2/1/10)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1310720 B
| | | Depth:1044480 B HiPrio:262144 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:135498 Offered:1000000
| | | Consumed:135498
| | |
| | | OperPIR:135000 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| slot(3)
|--(S) : Tier0Egress:1->lag-30:0.0->1 (Port lag-30 Orphan)
| | AdminPIR:2000000 AdminCIR:0(sum)
| | Parent Limit Unused Bandwidth: not-found
| |
| | AvgFrmOv:101.65(*)
| | AdminPIR:2000000(w) AdminCIR:0(w)
| |
| | [Within CIR Level 0 Weight 0]
| | Assigned:0(w) Offered:0(w)
| | Consumed:0(w)
| |
| | [Above CIR Level 1 Weight 0]
| | Assigned:275468(w) Offered:2000000(w)
| | Consumed:275468(w)
| |
| |
| | TotalConsumed:275468(w)
| | OperPIR:270996
| |
| | [As Parent]
| | OperPIR:270996 OperCIR:0
| | ConsumedByChildren:270996
| |
| |
| |--(Q) : 1->lag-30(3/2/2)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1106976 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:135498 Offered:1000000
| | | Consumed:135498
| | |
| | | OperPIR:135625 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
| |--(Q) : 1->lag-30(3/2/1)->1
| | | AdminPIR:1000000 AdminCIR:0
| | | Parent Limit Unused Bandwidth: not-found
| | | AvgFrmOv:101.65(*)
| | | CBS:0 B MBS:1253376 B
| | | Depth:1105728 B HiPrio:147456 B
| | |
| | | [CIR]
| | | Assigned:0 Offered:0
| | | Consumed:0
| | |
| | | [PIR]
| | | Assigned:135498 Offered:1000000
| | | Consumed:135498
| | |
| | | OperPIR:135625 OperCIR:0
| | |
| | | PktByteOffset:add 0*
| | | OnTheWireRates:false
| | | ATMOnTheWireRates:false
| | | LastMileOnTheWireRates:false
| |
===============================================================================
*B:ALU-A>config>qos>port-sched-plcy#
The following output shows the max-rate percent value.
*B:ALU-A>config>qos>port-sched-plcy# info
----------------------------------------------
max-rate percent 50.00
----------------------------------------------
With max-rate percent, the max-rate is capped to the percent of the active LAG capacity.
When max-rate is configured as a percentage, the dist-lag-rate-shared is ignored.
The group rate, level PIR, and CIR rate can be entered as a percent.
*B:ALU-A>config>qos>port-sched-plcy# info
----------------------------------------------
dist-lag-rate-shared
max-rate percent 30.00
group "test" create
percent-rate 20.00 cir 20.00
exit
level 1 percent-rate 10.00 percent-cir 10.00
level 2 percent-rate 20.00 percent-cir 20.00
level 3 percent-rate 30.00 percent-cir 30.00
level 4 percent-rate 40.00 percent-cir 40.00
level 5 percent-rate 50.00 percent-cir 50.00
level 6 percent-rate 60.00 percent-cir 60.00
level 7 percent-rate 70.00 percent-cir 70.00
level 8 percent-rate 80.00 percent-cir 80.00
Port Scheduler-Overrides:
Both max-rate and level can be overridden if they are of the same type as in the policy being overridden.
*B:ALU-A>config>port>ethernet>egr-sched-override$ info
----------------------------------------------
max-rate percent 50.00
level 1 percent-rate 10.00 percent-cir 10.00
level 2 percent-rate 20.00 percent-cir 20.00
level 3 percent-rate 30.00 percent-cir 30.00
level 4 percent-rate 40.00 percent-cir 40.00
level 5 percent-rate 50.00 percent-cir 50.00
level 6 percent-rate 60.00 percent-cir 60.00
level 7 percent-rate 70.00 percent-cir 70.00
level 8 percent-rate 80.00 percent-cir 80.00
The following example shows the QoS port scheduler policy output:
*B:ALU-A>config>qos>port-sched-plcy# /show qos port-scheduler-policy "psp2"
===============================================================================
QoS Port Scheduler Policy
===============================================================================
Policy-Name : psp2
Description : (Not Specified)
HQoS Algorithm : default
Max Rate : max Max Rate Percent : 30.00
Dist LAG Rate : True Last changed : 07/16/2014 21:31:51
Group : test
Group PIR : max Group CIR : max
Group PIR Percent : 20.00 Group CIR Percent : 20.00
Lvl1 PIR : max Lvl1 CIR : max
Lvl1 PIR Percent : 10.00 Lvl1 CIR Percent : 10.00
Lvl2 PIR : max Lvl2 CIR : max
Lvl2 PIR Percent : 20.00 Lvl2 CIR Percent : 20.00
Lvl3 PIR : max Lvl3 CIR : max
Lvl3 PIR Percent : 30.00 Lvl3 CIR Percent : 30.00
Lvl4 PIR : max Lvl4 CIR : max
Lvl4 PIR Percent : 40.00 Lvl4 CIR Percent : 40.00
Lvl5 PIR : max Lvl5 CIR : max
Lvl5 PIR Percent : 50.00 Lvl5 CIR Percent : 50.00
Lvl6 PIR : max Lvl6 CIR : max
Lvl6 PIR Percent : 60.00 Lvl6 CIR Percent : 60.00
Lvl7 PIR : max Lvl7 CIR : max
Lvl7 PIR Percent : 70.00 Lvl7 CIR Percent : 70.00
Lvl8 PIR : max Lvl8 CIR : max
Lvl8 PIR Percent : 80.00 Lvl8 CIR Percent : 80.00
Orphan Lvl : default Orphan Weight : default
Orphan CIR-Lvl : default Orphan CIR-Weight : default
--snip--
-------------------------------------------------------------------------------
Egr Port Sched Override
-------------------------------------------------------------------------------
Max Rate : max* Max Rate Percent : 50.00
Lvl1 PIR : max* Lvl1 CIR : max*
Lvl1 PIR Percent : 10.00 Lvl1 CIR Percent : 10.00
Lvl2 PIR : max* Lvl2 CIR : max*
Lvl2 PIR Percent : 20.00 Lvl2 CIR Percent : 20.00
Lvl3 PIR : max* Lvl3 CIR : max*
Lvl3 PIR Percent : 30.00 Lvl3 CIR Percent : 30.00
Lvl4 PIR : max* Lvl4 CIR : max*
Lvl4 PIR Percent : 40.00 Lvl4 CIR Percent : 40.00
Lvl5 PIR : max* Lvl5 CIR : max*
Lvl5 PIR Percent : 50.00 Lvl5 CIR Percent : 50.00
Lvl6 PIR : max* Lvl6 CIR : max*
Lvl6 PIR Percent : 60.00 Lvl6 CIR Percent : 60.00
Lvl7 PIR : max* Lvl7 CIR : max*
Lvl7 PIR Percent : 70.00 Lvl7 CIR Percent : 70.00
Lvl8 PIR : max* Lvl8 CIR : max*
Lvl8 PIR Percent : 80.00 Lvl8 CIR Percent : 80.00
* means the value is inherited
-------------------------------------------------------------------------------