Monday, April 9, 2012

TROUBLESHOOTING NETWORK ADAPTER ERROR

ALL DOCUMENT ARE PROPERTY OF SHIVAKANT , DO NOT COPY IBM , AIX , HACMP , ARE REGISTERED TRADE MARK OF IBM

 
TROUBLESHOOTING NETWORD ADAPTER ERROR

Step1) Gathering error information

# errpt|more

IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION

F3931284 0830164310 I H ent0 ETHERNET NETWORK RECOVERY MODE

EC0BCCD4 0830164110 T H ent0 ETHERNET DOWN

F3931284 0829230110 I H ent0 ETHERNET NETWORK RECOVERY MODE

EC0BCCD4 0829230110 T H ent0 ETHERNET DOWN

F3931284 0829225610 I H ent0 ETHERNET NETWORK RECOVERY MODE

View details of the error

# errpt -aj F3931284|more

---------------------------------------------------------------------------

LABEL: GOENT_RCVRY_EXIT

IDENTIFIER: F3931284

Date/Time: Mon Aug 30 16:43:57 PAKDT 2010

Sequence Number: 85

Machine Id: 00C402DB4C00

Node Id: galaxy

Class: H

Type: INFO

Resource Name: ent0

Resource Class: adapter

Resource Type: 14108902

Location: U787E.001.1234567-P1-T1

VPD:

Product Specific.( ).......2-Port 10/100/1000 Base-TX PCI-X

Adapter

Network Address.............000D60DEFDAE

ROM Level.(alterable).......DV0210

Description

ETHERNET NETWORK RECOVERY MODE

September

21, 2010

AIX TROUBLESHOOTING

DOCUMENT CREATED BY SHIVAKANT ALL RIGHTS RESERVED

Recommended Actions

PERFORM PROBLEM DETERMINATION PROCEDURES

# errpt -aj EC0BCCD4|more

---------------------------------------------------------------------------

LABEL: GOENT_LINK_DOWN

IDENTIFIER: EC0BCCD4

Date/Time: Mon Aug 30 16:41:56 PAKDT 2010

Sequence Number: 84

Machine Id: 00C402DB4C00

Node Id: galaxy

Class: H

Type: TEMP

Resource Name: ent0

Resource Class: adapter

Resource Type: 14108902

Location: U787E.001.1234567-P1-T1

VPD:

Product Specific.( ).......2-Port 10/100/1000 Base-TX PCI-X

Adapter

Network Address.............000D60DEFDAE

ROM Level.(alterable).......DV0210

Description

ETHERNET DOWN

Recommended Actions

PERFORM PROBLEM DETERMINATION PROCEDURES

Step2) Analyzing the error

The error shows that the network adapter ent0 is down

Resource Name: ent0

Resource Class: adapter

Location: U787E.001.1234567-P1-T1

Step3 )Troubleshooting the error

See the status of adapters

# lsdev -Cc if

en0 Available 02-08 Standard Ethernet Network Interface

en1 Defined 02-09 Standard Ethernet Network Interface

en2 Defined Standard Ethernet Network Interface

et0 Defined 02-08 IEEE 802.3 Ethernet Network Interface

et1 Defined 02-09 IEEE 802.3 Ethernet Network Interface

et2 Defined IEEE 802.3 Ethernet Network Interface

lo0 Available Loopback Network Interface

See details of network interface

TO VIEW  DETAILED OUTPUT USE THE COMMAND BELOW

netstat -v|grep -E "ETHERNET|Adapter|Errors|State"

TO VIEW  SUMMARY  OUTPUT USE THE COMMAND BELOW
netstat -v|grep -E "ETHERNET|Adapter|State"

TO VIEW  LINK STATE AND STATUS  OUTPUT USE THE COMMAND BELOW

netstat -v|grep -E "ETHERNET|Device|State"




# entstat ent1

-------------------------------------------------------------

ETHERNET STATISTICS (ent1) :

Device Type: 2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)

Hardware Address: 00:0d:60:de:fd:af

Elapsed Time: 0 days 0 hours 0 minutes 0 seconds

Transmit Statistics: Receive Statistics:

-------------------- -------------------

Packets: 0 Packets: 0

Bytes: 0 Bytes: 0

Interrupts: 0 Interrupts: 0

Transmit Errors: 0 Receive Errors: 0

Packets Dropped: 1 Packets Dropped: 0

Bad Packets: 0

Max Packets on S/W Transmit Queue: 1

S/W Transmit Queue Overflow: 0

Current S/W+H/W Transmit Queue Length: 1

Broadcast Packets: 0 Broadcast Packets: 0

Multicast Packets: 0 Multicast Packets: 0

No Carrier Sense: 0 CRC Errors: 0

DMA Underrun: 0 DMA Overrun: 0

Lost CTS Errors: 0 Alignment Errors: 0

Max Collision Errors: 0 No Resource Errors: 0

Late Collision Errors: 0 Receive Collision Errors: 0

Deferred: 0 Packet Too Short Errors: 0

SQE Test: 0 Packet Too Long Errors: 0

Timeout Errors: 0 Packets Discarded by Adapter: 0

Single Collision Count: 0 Receiver Start Count: 0

Multiple Collision Count: 0

Current HW Transmit Queue Length: 1

General Statistics:

-------------------

No mbuf Errors: 0

Adapter Reset Count: 0

Adapter Data Rate: 2000

Driver Flags: Up Broadcast Simplex

Limbo 64BitSupport ChecksumOffload

PrivateSegment LargeSend DataRateSet

#

See for any physical link status , cable connection and ip configuration


4) TROUBLESHOOTING NETWORK CARD ON VIO


View details of the problem

# errpt -aj 40D97644|pg

LABEL: SEAHA_PRIMARY

IDENTIFIER: E136EAFA

Date/Time: Sun Sep 5 11:06:47 EDT 2010

Sequence Number: 19824

Machine Id: 00CC98AE4C00

Node Id: naboo-vio2

Class: H

Type: INFO

Resource Name: ent10

Resource Class: adapter

Resource Type: sea

Location:

Description

BECOME PRIMARY

Probable Causes

BECOME PRIMARY

Failure Causes

BECOME PRIMARY

Recommended Actions

BECOME PRIMARY

Detail Data

Become the Primary SEA


--------------------------------------------------------------------------

LABEL: SEAHA_BACKUP

IDENTIFIER: 40D97644

Date/Time: Sun Sep 5 11:06:47 EDT 2010

Sequence Number: 19825

Machine Id: 00CC98AE4C00

Node Id: naboo-vio2

Class: H

Type: INFO

Resource Name: ent10

Resource Class: adapter

Resource Type: sea

Location:

Description

BECOME BACKUP

Probable Causes

BECOME BACKUP

Failure Causes

BECOME BACKUP

Recommended Actions

BECOME BACKUP

Detail Data

Become the Backup SEA

Check for all the sea adapters and its availability

padmin@[/home/padmin]-> lsmap -all –net

SVEA Physloc

------ --------------------------------------------

ent4 U9117.570.10C98AE-V2-C2-T1

SEA ent10

Backing device ent0

Status Available

Physloc U7879.001.DQD0KHE-P1-T6

SVEA Physloc

------ --------------------------------------------

ent5 U9117.570.10C98AE-V2-C3-T1

SEA ent11

Backing device ent1

Status Available

Physloc U7879.001.DQD0KHE-P1-T7

SVEA Physloc

------ --------------------------------------------

ent6 U9117.570.10C98AE-V2-C4-T1

SEA NO SHARED ETHERNET ADAPTER FOUND

SVEA Physloc

------ --------------------------------------------

ent7 U9117.570.10C98AE-V2-C5-T1

SEA NO SHARED ETHERNET ADAPTER FOUND

SVEA Physloc

------ --------------------------------------------

ent8 U9117.570.10C98AE-V2-C6-T1

SEA NO SHARED ETHERNET ADAPTER FOUND

SVEA Physloc

------ --------------------------------------------

ent9 U9117.570.10C98AE-V2-C7-T1

SEA NO SHARED ETHERNET ADAPTER FOUND


CHECK BACKUP ADAPTER AS WE CHECKED PRIMARY ADAPTER
 TROUBLESHOOTING ADAPTER IN A DUAL VIO SCENARIO
CHECK FOR THEIR CHANNEL VLAN ID (ID USED TO CREATE CONTROL CHANNEL)
CHECK FOR THEIR STATUS
USING ENTSTAT COMMAND
FOR EXAMPLE
for x in $(lsdev -Cc adapter |grep -i shared|awk '{print $1}')
do
echo $x
entstat -d $x|grep -E State
done

CHECK THE ADAPTERS ATTRIBUTES AND CORRECT IF THEY ARE NOT , CHECK FOR THE TRUNK PRIORITY AND IF THE TRUNK PRIORITY IS DEFINED CORRECTLY MAKE SURE THAT THE ADAPTERS ha_mode ATTRIBUTE SHOULD BE AUTO
for x in $(lsdev -Cc adapter|grep en|awk '{print $1}')
do
echo $x
lsattr -El $x|grep -E "ctl_chan|ha_mode|pvid|virt"
done


1 comment:

  1. Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or something.
    I think that you can do with some pics to drive the message home a little bit, but
    other than that, this is magnificent blog. A fantastic
    read. I will definitely be back.
    My web site > mailRecovery in exchange server

    ReplyDelete