Take the 2-minute tour ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.

we had to reboot server because storage administrators had to extend storage for db2data. We have 9.7 FP 0 on Linux. After that when we started the DB database is restarting itself after some time. It works completely OK and then restarts. ctginst1 is the instance. We can notice many errors, but maybe it begins with some SEVERE "disk error occurred" and following with other errors. Additionally in /var/log/messages I can notice many of these:

**`Feb 25 08:06:01 tt-db-01 kernel: attempt to access beyond end of device`** 
Feb 25 08:06:01 tt-db-01 kernel: dm-6: rw=1, want=65178824, limit=65126400

Below are from db2diag:

2014-02-25-07.58.52.978849+060 E106104582E920      LEVEL: Severe (OS)
PID     : 28497                TID  : 46949931673920PROC : db2sysc 0
INSTANCE: ctginst1             NODE : 000          DB   : MAXDB71
APPHDL  : 0-152                APPID: 10.232.52.28.58259.140225070002
AUTHID  : MAXIMO
EDUID   : 225                  EDUNAME: db2agent (MAXDB71) 0
FUNCTION: DB2 UDB, oper system services, sqloclose, probe:10
CALLED  : OS, -, fsync                            OSERR: EIO (5)
DATA #1 : File handle, PD_TYPE_SQO_FILE_HDL, 8 bytes
  File Handle              = 205
  File System Block Size   = 0 bytes
  File System Type         = UNKNOWN
  File Handle Flags :
    Require Sector Align   = No
    DIO/CIO Mode           = No
    Raw Block Device       = No
    Reserved Handle        = No
    Flush On Close         = Yes
    Thread-Level Lock      = No
    Write-through Mode     = No
    File Not Tracked       = No

2014-02-25-07.58.52.979062+060 I106105503E1926     LEVEL: Severe
PID     : 28497                TID  : 46949931673920PROC : db2sysc 0
INSTANCE: ctginst1             NODE : 000          DB   : MAXDB71
APPHDL  : 0-152                APPID: 10.232.52.28.58259.140225070002
AUTHID  : MAXIMO
EDUID   : 225                  EDUNAME: db2agent (MAXDB71) 0
FUNCTION: DB2 UDB, sort/list services, sqlsusda, probe:130
MESSAGE : ZRC=0x860F0003=-2045837309=SQLO_DERR "disk error occurred (DOS)"
          DIA8402C A disk error has occurred.
DATA #1 : String, 14 bytes
SRT file error
DATA #2 : SQLS_OVERFLOW_DATA, PD_TYPE_SQLS_OVERFLOW_DATA, 296 bytes
2014-02-25-08.04.57.109226+060 I109060406E908      LEVEL: Error
PID     : 32749                TID  : 47264697411904PROC : db2sysc 0
INSTANCE: ctginst1             NODE : 000
EDUID   : 119                  EDUNAME: db2pfchr (MAXDB71) 0
FUNCTION: DB2 UDB, buffer pool services, sqlbSMSDeleteObject, probe:0
DATA #1 : Object descriptor, PD_TYPE_SQLB_OBJECT_DESC, 88 bytes
    Obj: {pool:5;obj:32;type:128} Parent={5;32}
  lifeLSN:       0085965204082502
  tid:           0 0  0
  extentAnchor:                   0
  initEmpPages:                   0
  poolPage0:                      0
  poolflags:                   1111
  objectState:                   37
  lastSMP:                        0
  pageSize:                   32768
  extentSize:                    16
  bufferPoolID:                   2
  partialHash:           2149580805
  bufferPool:    0x00002afcb9b8c500
  pdef:          0x00002afcfae75ec0

2014-02-25-07.59.01.684598+060 E106430815E831      LEVEL: Critical
PID     : 28497                TID  : 46944881731904PROC : db2sysc 0
INSTANCE: ctginst1             NODE : 000
EDUID   : 54                   EDUNAME: db2pclnr (MAXDB71) 0
FUNCTION: DB2 UDB, RAS/PD component, pdStartFODC, probe:10
MESSAGE : ADM14001C  An unexpected and critical error has occurred: "Panic".
          The instance may have been shutdown as a result. "Automatic" FODC
          (First Occurrence Data Capture) has been invoked and diagnostic
          information has been recorded in directory
          "/home/ctginst1/sqllib/db2dump/FODC_Panic_2014-02-25-07.59.01.676539/
          ". Please look in this directory for detailed evidence about what
          happened and contact IBM support if necessary to diagnose the
          problem.


2014-02-25-08.04.57.119321+060 I109100478E615      LEVEL: Severe
PID     : 32749                TID  : 47264697411904PROC : db2sysc 0
INSTANCE: ctginst1             NODE : 000
EDUID   : 119                  EDUNAME: db2pfchr (MAXDB71) 0
FUNCTION: DB2 UDB, buffer pool services, sqlbSMSOpenContainer, probe:820
MESSAGE : ZRC=0x840F0001=-2079391743=SQLO_ACCD "Access Denied"
          DIA8701C Access denied for resource "", operating system return code
          was "".
DATA #1 : Object control block, PD_TYPE_SQLB_OBJECT, 12 bytes
Obj: {pool:5;obj:27;type:128} Parent={5;27}
DATA #2 : unsigned integer, 4 bytes
2014-02-25-08.05.04.796607+060 E109117163E549      LEVEL: Severe
PID     : 32747                TID  : 47920103549248PROC : db2wdog 0
INSTANCE: ctginst1             NODE : 000
EDUID   : 2                    EDUNAME: db2wdog 0
FUNCTION: DB2 UDB, base sys utilities, sqleWatchDog, probe:20
MESSAGE : ADM0503C  An unexpected internal processing error has occurred. All
          DB2 processes associated with this instance have been shutdown.
          Diagnostic information has been recorded. Contact IBM Support for
          further assistance.

014-02-25-08.05.10.517492+060 I109141867E398      LEVEL: Error
PID     : 1118                 TID  : 46941560111184PROC : db2fmp (
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 UDB, routine_infrastructure, sqlerFmpListener, probe:999
MESSAGE : FMP exiting with error. Last agent registered:
DATA #1 : Hexdump, 4 bytes
0x00007FFFF4BA5610 : 0000 0000                                  ....

2014-02-25-08.05.04.797641+060 I109142266E323      LEVEL: Error
PID     : 1092                 TID  : 47646086574160PROC : db2fmp (
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 UDB, common communication, sqlccipcdarihandshake, probe:4
RETCODE : ZRC=0x800F00FC=-2146500356=SQLO_INV_PARM "Invalid input parameter"

2014-02-25-08.05.10.817878+060 I109142590E398      LEVEL: Error
PID     : 1092                 TID  : 47646086574160PROC : db2fmp (
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 UDB, routine_infrastructure, sqlerFmpListener, probe:999
MESSAGE : FMP exiting with error. Last agent registered:
DATA #1 : Hexdump, 4 bytes
0x00007FFFCB5BAE70 : 0000 0000                                  ....

2014-02-25-08.05.04.797634+060 I109142989E323      LEVEL: Error
PID     : 1096                 TID  : 47327928942672PROC : db2fmp (
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 UDB, common communication, sqlccipcdarihandshake, probe:4
RETCODE : ZRC=0x800F00FC=-2146500356=SQLO_INV_PARM "Invalid input parameter"

2014-02-25-08.05.11.118869+060 I109143313E398      LEVEL: Error
PID     : 1096                 TID  : 47327928942672PROC : db2fmp (
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 UDB, routine_infrastructure, sqlerFmpListener, probe:999
MESSAGE : FMP exiting with error. Last agent registered:
DATA #1 : Hexdump, 4 bytes
0x00007FFFBA2A2F00 : 0000 0000                                  ....

2014-02-25-08.05.48.098482+060 I109143712E935      LEVEL: Error
PID     : 4393                 TID  : 47392039749856PROC : db2gcf
INSTANCE: ctginst1             NODE : 000
FUNCTION: DB2 Common, Generic Control Facility, gcf_kill, probe:220
MESSAGE : ECF=0x900002C1=-1879047487=ECF_GCF_DB2KILL_SERVICE_FAILED
share|improve this question
1  
Apparently, something went wrong when you were "extending storage", whatever that means. You'll need to describe exactly what was done on the OS side and on the database side. Meanwhile, you can use db2pd -tablespaces to determine what containers belong to the tablespace 5 and check if they are all properly defined and accessible by the instance owner. –  mustaccio Feb 25 at 13:20
    
thank you it seems because of the cluster setup for the db it wasn't extended and on the other server –  Dejan Feb 26 at 10:23
    
@Dejan you should post what it is as the answer. –  Chris Aldrich Mar 3 at 0:04
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.