DISK OPERATION ERROR in AIX

Last month, we noted errpt showing an error:

1
2
3
4
5
6
7
8
9
10
11
[root@aix:/] errpt -a
IDENTIFIER TIMESTAMP  T C RESOURCE_NAME  DESCRIPTION
DCB47997   1122091816 T H hdisk29        DISK OPERATION ERROR
F31FFAC3   1122091816 I H hdisk29        PATH HAS RECOVERED
DE3B8540   1122091816 P H hdisk29        PATH HAS FAILED
DCB47997   1122075216 T H hdisk26        DISK OPERATION ERROR
F31FFAC3   1122075216 I H hdisk26        PATH HAS RECOVERED
DE3B8540   1122075216 P H hdisk26        PATH HAS FAILED
DCB47997   1122070516 T H hdisk31        DISK OPERATION ERROR
F31FFAC3   1122070516 I H hdisk31        PATH HAS RECOVERED
DE3B8540   1122070516 P H hdisk31        PATH HAS FAILED

A way to find what’s causing this error is using ‘lsmpio’ command to display detailed device statistics for the hdisks devices.
NOTE: lsmpio command was introduce in AIX 7.1 TL3 and 6.1 TL9.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
[root@aix:/] lsmpio -Sdl hdisk29
Disk: hdisk29
    Path statistics since Fri Dec 09 12:56:32 CET 2016
    Path 0: (fscsi0:500a09829af63ecf,7000000000000)
        Path Selections:                              1282755
        Adapter Errors:                                     0
            Software:                        0
            Hardware:                        0
            Transport Dead:                  0
            Transport Busy:                  0
            Transport Fault:                 0
            No Device Response:              0
            Target Port ID Changed:          0
        Command Timeouts:                                   0
        Reservation Conflicts:                              0
        SCSI Queue Full:                                    0
        SCSI Busy:                                          0
        SCSI ACA Active:                                    0
        SCSI Task Aborted:                                  0
        SCSI Aborted Command:                               0
        SCSI Check Condition:                               0
            Medium Error:                    0
            Hardware Error:                  0
            Not Ready:                       0
            Other:                           0
        Last Error:                                       N/A
        Last Error Time:                                  N/A
        Path Failure Count:                                 0
            Due to Adapter Error:            0
            Due to I/O Error:                0
            Due to Health Check:             0
            Due to SCSI Sense:               0
            Due to Qualifier Bit:            0
            Due to Opening Error:            0
        Last Path Failure:                                N/A
        Last Path Failure Time:                           N/A
Disk: hdisk29
    Path statistics since Fri Dec 09 12:56:31 CET 2016
    Path 1: (fscsi1:500a09828af63ecf,7000000000000)
        Path Selections:                              1254441
        Adapter Errors:                                     3
            Software:                        0
            Hardware:                        0
            Transport Dead:                  0
            Transport Busy:                  0
            Transport Fault:                 0
            No Device Response:              0
            Target Port ID Changed:          0
        Command Timeouts:                                   3
        Reservation Conflicts:                              0
        SCSI Queue Full:                                    0
        SCSI Busy:                                          0
        SCSI ACA Active:                                    0
        SCSI Task Aborted:                                  0
        SCSI Aborted Command:                               0
        SCSI Check Condition:                               0
            Medium Error:                    0
            Hardware Error:                  0
            Not Ready:                       0
            Other:                           0
        Last Error:                                  SCSI Command Timeout
        Last Error Time:                             Mon Dec 12 09:12:08 CET 2016
        Path Failure Count:                                 0
            Due to Adapter Error:            0
            Due to I/O Error:                0
            Due to Health Check:             0
            Due to SCSI Sense:               0
            Due to Qualifier Bit:            0
            Due to Opening Error:            0
        Last Path Failure:                                N/A
        Last Path Failure Time:                           N/A

As you can see in the output, the cause of the issue is “SCSI Command Timeout” on FC adapter.
Please, check FC network (VIOS, NPIV, SAN zonning).

5 (1)
Article Rating (1 Votes)
Rate this article
Attachments
There are no attachments for this article.
Comments
There are no comments for this article. Be the first to post a comment.
Full Name
Email Address
Security Code Security Code
Related Articles RSS Feed
IBM AIX MPIO: Best practices and considerations
Viewed 11196 times since Wed, May 30, 2018
Removing Failed or Missing Paths
Viewed 2696 times since Wed, May 30, 2018
NMON nmon
Viewed 11770 times since Tue, Apr 16, 2019
AIX: How to set automatic logoff (only for terminals)
Viewed 2967 times since Mon, Jun 11, 2018
Control Your Logs AIX
Viewed 18863 times since Wed, May 30, 2018
NTLMSSP, SPN and AIX CIFS
Viewed 8090 times since Fri, Jun 15, 2018
AIX, Networking Etherchannel failover testing
Viewed 2511 times since Fri, Apr 19, 2019
AIX, Red Hat, Security, System Admin↑ System-wide separated shell history files for each user and session
Viewed 2186 times since Fri, Apr 19, 2019
Monitoring Events with AIX Audit
Viewed 3913 times since Wed, May 30, 2018
The new VIOS performance advisor tool part util
Viewed 3161 times since Tue, Jun 4, 2019