Health Monitoring and Predictive Maintenance

Health, alarm, and troubleshooting enhancements

Ability to quickly identify and assess the extent of subscriber Internet outages by:

• Visualizing Internet service outages on a geomap.
• Receiving an Internet Outage email notification when subscribers are impacted by an outage over a 15-minute interval.
• Delivering a subscriber outage message on the subscriber page in Support Cloud (requires both Operations Cloud and Support Cloud entitlements).

Support for a weekly report on ONT optical light level outliers based on machine learning of potential PON service issues.

On-demand access to a real-time snapshot of OLT or ONT performance data and statistics, enabling quick troubleshooting and verification.

Ability to monitor:

• Active Ethernet health on EXA systems CMS-managed AE ONTs.
• PON/Ethernet on EXA systems with mixed PON and DSL cards.

Network and Subscriber Operations

Workflow enhancements

Support for access control list RG profiles to block unsolicited Internet traffic to remote management and VoIP interfaces via workflows.

Support for an on boot workflow triggered when the CPE is powered on by the user, pushing upgrades and service provisioning on boot to eliminate additional maintenance windows.

Improved management of software images, including identification of supported Calix ONU images and a sortable image table.

Notification of scheduled performance test conflicts with Calix Cloud maintenance windows.

Subscriber Services

Support for end-to-end MVR and non-MVR video service provisioning on AXOS systems, simplifying provisioning across the network.

Ability to provision all POTs voice services on a single ONT or RG.

Calix AXOS Systems Hardware

Min. Software

E9-2 OLT

• E9-2 CLX3001 control & aggregation switch card
• E9-2 GP1612 line card
• E9-2 NG1601 line card

AXOS R22.2

• E9-2 XG3201 line card

AXOS R23.2

E9-2 ASM

• E9-2 ASM3001 aggregation service manager card

AXOS R22.2

E7-2 OLT

• E7-2 CE201 aggregation card¹
• E7-2 GE-24 r2 line card¹
• E7-2 10GE-12 aggregation card¹
• E7-2 GPON-8 r2 line card
• E7-2 XG801 line card
• E7-2 NGPON2-4 line card

E3-2 OLT

• GP401 interface module
• NG201 interface module

Calix EXA Systems Hardware

Min. Software

E7-2 OLT
(or DSLAM)

• E7-2 GPON-8 line card
• E7-2 GPON-4/ r2 line card

EXA R3.4.40²

• E7-2 GE-24 line card
• E7-2 GE-12 aggregation line card
• E7-2 VDSL2-48 r2 line card ³
• E7-2 VDSL2-48C r2 line card ³

EXA R3.4.50⁴

E7-20 OLT

• E7-20 GPON-16x line card
• E7-20 GPON-8x line card
• E7-20 GPON-4x line card

EXA R3.4.40²

• E7-20 GE-24x line card

EXA R3.4.50

Systems Management

Min. Software

Calix Management System (CMS)

R15.1.621⁴

CMS Probe for Operations Cloud

CMSPROBE-R23.1⁵

¹ Supports operation as an Active Ethernet OLT.
² For EXA systems, the minimum EXA software version to support health data via IPFIX is R3.4.40 (GPON or VDSL only); however Calix recommends upgrading to EXA version 3.4.50 for full system and feature robustness.
³ On EXA DSL cards, IPFIX is supported for Ethernet ports only.
⁴ EXA R3.4.50 requires CMS R15.1.764.
⁵ You may download the CMS probe from the Calix Software Center for use with an earlier CMS version (other than the current production release).

Calix Subscriber Systems

Product Family

Model

Type

Min. Firmware

GigaSpire BLAST⁴
Edge Systems

• u10xe (GS4237)

ONT³ + RG

R23.2.0 (PON), (AE-future)

• u4g (GS2128G)

ONT + RG

R23.2.0

• u4hm (GM1028H)

Mesh satellite

• u4xg (GS2128XG)

ONT + RG²

R23.1.0

• u6x (GS4227)⁸
• u6xw (GS4227W)

ONT³ + RG

R22.4.0 (PON, AE)

• u6.1 (GS4220E)
• u6.2 (GS4227E)
• u6e (GS2037E)
• u4 (GS2028E)

RG

R22.4.0

• u6me (GM2037)
• u4m (GM1028)

Mesh satellite

GigaPro Edge Systems and ONTs

• p6he (GPR2032H)

Outdoor RG or mesh satellite, PoE

R22.4.0

• GPR8802x

ONT + PoE switch

R22.4.0 (PON), (AE-future)

GigaCenter⁴

• 844GE

ONT¹ + RG

R12.2.13 (GPON, AE)

• 854G
• 844G

R12.2.13

• 844E

RG

GigaPoint⁴ ONTs

• GP1000G
• GP1100G

ONT¹

R23.2.0

• GP1007X

ONT²

• GP4200AH

ONT⁷

R23.2.0 (GPON), (AE-future)

• GP1100X
• GP1101X
• GP1000X
• GP4200XH

ONT²

R21.3.0

• 801Gv1
• 803Gv1

ONT¹

R12.2.13

• 801Gv2

ONT¹

R1.0.5

GigaHub⁴ ONTs

• GH3200X

ONT²

R21.3.0

• 813G
• 812G

ONT¹

R12.2.13

P-Series ONTs⁵

• 700GE SFUs

ONT⁷

R10.8.110 (GPON), R10.7.122 (AE)

¹ GPON ONT (or GPON mode for auto-detect)
² XGS-PON ONT
³ everyPON or AE ONT (SFP+ ONT module in WAN port)
⁴ Supports optical signal levels
⁵ Support for optical signal levels varies by part number; for more information see the Quick Tip Identifying the Optical Signal Level (OSL) Reading at the ONT or use the CLI 'show ont [id] detail' command (CCL-44061)
⁶ On the 717GE, POTs ports 'pot3' and 'pot4' are not supported (CCL-39777)
⁷ GPON/AE auto-sense ONT
⁸ Does not support untagged WAN configurations if the WAN_TYPE is GPON or XGSPON

CCL-62099

When moving an ONT from one AXOS system to another without properly removing the ONT, the old AXOS system may report an ont-missing alarm against the previous ONT ID, resulting in the geomap reporting an outage.

CCL-60689

After suppressing alarms from a config object in an AXOS OLT, newly triggered alarms from that config object do not display in the active report or history reports in Operations Cloud, causing a mismatch with the AXOS system CLI until the OLT is disconnected and reconnected.

CCL-58348

After disabling and then re-enabling the service or updated service with another data plan for a two-box model, the service status displays an error message which changes to "Successfully Provisioned" following a retry. This can take ~10 min.

CCL-58048

After disabling and then re-enabling service on an RG, the service status displays an error message which changes to "Successfully Provisioned" following a retry.

CCL-57854

When selecting service type "MGCP" or "TDM GW" in the service profile, the primary and secondary DNS fields display under the ONT parameters.

CCL-56268

When using API endpoint POST/subscribers/{subscriberId}/services to attach voice and data together, the response is error code 400. Workaround:

• Use PUT/subscribers/{subscriberId}/services to attach voice and data together.
• Use POST/subscribers/{subscriberId}/services to create the services one by one—first data and then voice.

CCL-54599

For a standalone RG, after editing parameters in an existing service profile associated to a subscriber, you must disable and then re-enable the service. For a two-box deployment or standalone ONT, once the service definition template (policy map) is provisioned on the OLT, for any bandwidth to be applied you must create a new service definition template and update the service with it.

CCL-52184

After successfully connecting to Operations Cloud via Call Home, it may take up to 5 minutes for the OLT pushpin with the total number of alarms to display in the Issues > Real Time > Map View. Workaround: Use the Table View.

CCL-51250

The search bar on the System Groups page does not:

• Display partial results as you type. Workaround: Click the magnifying glass to view results.
• Provide an option to clear the search. Workaround: Manually delete text from the search bar.

CCL-49238

When replacing a GPON RG associated with an EXA OLT, delete the old RG from the subscriber and then perform a force sync operation.

CCL-49007

ONT auto-delete does not occur when moving an ONT from one RG to another RG. Workaround: Disconnect the ONT cable from the RG and then manually delete the ONT from the UI.

CCL-48726

When replacing the ONT in a two box solution, you must manually disassociate and delete the ONT from the subscriber.

CCL-45260

When both an ont-missing alarm schedule (separately or combined with other alarms) and a transform alarm schedule are created, Operations Cloud only monitors and emails an alarm report for the transformed alarm.

CCL-44758

When the USOC for an existing subscriber service is replaced, immediately followed by a connection error with the OLT, the data plan may not be updated.

CCL-44562

When an ONT resets, the ONT Health Timeseries chart displays gaps in the lines which may not align, as some data is binned while other data is running time.

CCL-44061

Operations Cloud ONT health does not report ONT RX power levels for 760-series ONTs because those ONTs do not report RX power level.

CCL-43051

When moving an existing subscriber from an Ethernet policy-map to an IP policy-map in SMx prior to provisioning services in Operations Cloud on the same VLAN, you must manually delete the Ethernet policy-map applied to the VLAN, which impacts ONTs using the VLAN.

CCL-42790

When an ONT name that uses the account ID format is updated in Operations Cloud, the AXOS system continues using the original ONT name.

CCL-42701

The Alarm Status displayed on the Systems > Network Systems page may not be accurate because the CMS probe synchronizes alarms irrespective of the CMS and/or EXA OLT state in Operations Cloud.

CCL-41139

Updating the data service associated with a two box deployment from DHCPv4 to dual stack removes the default WAN setting from a GigaFamily RG.

CCL-41100

Even if provisioning an IPv6-only service, Operations Cloud enables both IPv4 and IPv6 interfaces for TR069, so the web-UI of the RG will indicate the WAN is provisioned for both IPv4 and v6.

CCL-40774

After adding a new ONT via CMS/EXA, the health KPIs may not display in Operations Cloud within 24 hours as expected. Workaround: Wait one more day for CMS to sync with Operations Cloud.

CCL-40773

Operations Cloud provisions the 803Gv2 as an 844G on E7 EXA systems because there is no 803Gv2 profile in EXA.

CCL-40042,
CCL-40797

Disabling the data service via Operations Cloud on an RG loaded with a firmware version below R21.4 affects the TR-069 connection to Calix Cloud. Workaround: Do not disable the data service from Operations Cloud. If this occurs, factory reset the RG to bring it back online.

CCL-35654

When an ONT fiber is unplugged for less than 15 minutes with the power on, then re-connected, the AXOS OLT may report uptime continuously, causing the Health page to report an uptime larger than 900 seconds in 15 minutes.

CCL-58934

The Top Subscribers applications report does not show data when yesterday is specified as the "From Date" and "Rate" is specified as the "Criteria."

CCL-58131

After replacing an ONT using the same Reg ID, both the new and old ONTs are associated to the subscriber.

CCL-57937

Operations Cloud does not support data and voice services using the default untagged WAN and the same S-VLAN.

CCL-57859

In the subscriber record summary page, a retry button does not display to re-provision a failed RG service.

CCL-57446

After deleting and re-adding an AXOS OLT to Operations Cloud, alarms that display in the Issues > Active Reports page may not match alarms generated via the AXOS CLI 'show alarm active' command. This occurs when alarms are raised and cleared continuously during the sync process.

CCL-56709

Operations Cloud does not support integrated ONTs in the Active Systems Geomap.

CCL-56298

After modifying an OLT’s region/location, both the old and new region/location display in the Top PON Interface table.

CCL-56052

When filtering by ONT FSAN, inventory info is lost on the AE Timeseries and ONT Timeseries charts.

CCL-55935

Operations Cloud does not support provisioning two voice services on a single ONT or RG.

CCL-55731

Operations Cloud will not configure the secondary DNS on a static data service if the primary DNS isn't also configured.

CCL-55506

When configuring a voice service with an ONT line and an RG line, only one IP addressing field displays in the UI.

CCL-53672

The geomap alarm count does not update for an ONT that is not associated with a Reg ID or FSAN (serial number and vendor ID).

CCL-52637

After deleting the RG association from a two-box model where Operations Cloud auto-mapped the ONT to the subscriber record, the subscriber record cannot be deleted.

CCL-49291

The OLT/ONT alarm number in the Issues > Alarm Map View updates after a delay of ~5 minutes following a newly triggered alarm, causing a mismatch with the Active Reports.

CCL-43513

Configuring a subscriber data service with a L2 static host does not enable IP Source Verification on the VLAN. Workaround: After configuring the static host, manually configure the source-verify VLAN setting from the network system CLI.

CCL-31663

Any port/any service (APAS) is an RG feature that detects the OUI of the device plugged into the RG's Ethernet port, and if it matches a set-top box OUI, the RG applies the full bridge video service to that port. Otherwise, the ONT applies the RG data service to the port. Operations Cloud does not support any port/any service (APAS).

CCL-63526

EXA system alarms that have been acknowledged or shelved in Operations Cloud will reset when resynchronized via the Alarms Force Sync operation.

CCL-63603

Alarms from an EXA system continue to synchronize with Operations Cloud when the CMS is disconnected. Workaround: To stop the alarms from synchronizing with Operations Cloud, delete the CMS.

CCL-63246

After rebooting a connected and synchronized EXA OLT, an alarm count mismatch may occur between the OLT CLI and Operations Cloud.

CCL-61372

After adding a service address to an existing OLT, the geomap alarm count does not update.

CCL-61261

After associating an ONT with an existing ont-missing or loss-of-pon alarm to a subscriber, the geomap may take up to 12 hours to indicate an Internet outage.

CCL-60781

After successfully upgrading the CMS and re-installing the CMS probe, EXA alarms are duplicated or mismatched in Operations Cloud. Workaround: Manually trigger an alarm force sync.

CCL-60671

After suppressing and unsuppressing alarms, the alarm history report in Operations Cloud does not match alarms displayed in the AXOS CLI due to an AXOS alarm handling issue.

CCL-60580

When an ONT is auto-mapped to a subscriber with existing services (an associated RG and/or pre-provisioned services), the ONT will be managed by Operations Cloud.

CCL-58063

For the two-box model, the "option82-action-pass" command cannot be set causing IPv4 DHCP to fail.

CCL-57934

The following API endpoint may not properly update a SIP service:
PUT API /subscribers/{subscriberId}/services/{serviceId}

CCL-57457

The "notification_device_disconnected" alarm from CMS does not display in the alarm notification email when expected.

CCL-56382

If the IPFIX flow record is missed for a PON port, Ethernet port, or an ONT that has a threshold crossing alarm, then the alarm will be cleared. Upon arrival of the next IPFIX flow record, if the condition for the threshold crossing alarm is still true, then a new alarm will be generated.

CCL-56030

After deleting and re-adding a device/region, the device/region name displays in health report charts with an extra five characters appended to the name.

CCL-55943

After drilling down to the location level in the Health > PON > Reports page, the System filter field is empty.

CCL-54905

Operations Cloud will not provision voice services with static IP addresses on RG interfaces. Workaround: Provision voice services that require static IP addresses on an ONT POTs interface.

CCL-54433

The duplicate-ont-reg-id notification is an event in AXOS systems and an alarm in EXA systems, and therefore reported differently in Operations Cloud.

CCL-52424

Data does not display in the one-minute Network Traffic report for a flow that arrives late.

CCL-52157

For a GPON ONT connected to an E7-2 XG801 line card, the ONT/OLT "Rx Light Level for GPON" thresholds do not work but the ONT/OLT "Rx Light Level for XGS-PON" thresholds work.

CCL-51598

The AXOS E9-2 ASM3001 system does not display in the Geo Map View.

CCL-49568

On occasion, an AXOS PON interface that does not exceed the 40% throughput threshold may be counted as a PON capacity hit.

CCL-49357

The multiple-ONTs-down-network alarm report does not list all affected regions/locations under the Resource field.

CCL-46854

When replacing or connecting a new AE ONT, more than one timeseries chart displays in the Health page for the same ONT.

CCL-44635

Service provisioning is incompatible with type-B PON protection on both EXA and AXOS systems. Service provisioning will not complete and Operations Cloud will not update the PON port name on the status page when a type-B PON failover occurs.

CCL-41147

Service provisioning cannot be deleted when associated to an XGS ONT with a Reg ID longer than 10 characters. Workaround: Configure a Reg ID consisting of 10 or fewer characters.

CCL-41114

After updating the bandwidth tier profile for an existing data service via the API or GUI, the new bandwidth is not applied.

CCL-40446,
CCL-41053

The length of the ONT Reg ID is limited to 10 or fewer characters.

CCL-39566

On the Health page, the Total PON and Total ONT counts do not immediately change after adding or deleting and EXA/ONT in an existing CMS region. Workaround: Wait 24 hours or perform an on-demand inventory sync from CMS.

CCL-35838

After changing the transport type on an interface from PON to GPON, the Health page displays upstream/downstream capacity for a PON interface rather than a GPON interface.