Daemon not running check failed for process "avahi-daemon"

Daemon not running check failed for process "avahi-daemon"

This error can be fixed using cluvfy utility. It will generate an fix up scripts which need to execute as root user. Perform the following steps. You can download from here.

[grid@sbldcdb01 bin]$ ./cluvfy stage -pre crsinst -n sbldcdb01,sbldcdb02 -fixup -r 11gR2

...............

Following is the list of fixable prerequisites selected to fix in this session
******************************************************************************************

--------------                ---------------     ----------------  
Check failed.                 Failed on nodes     Reboot required?  
--------------                ---------------     ----------------  
Daemon "avahi-daemon" not     sbldcdb02           no                
configured and running        ,sbldcdb01                            

Execute "/tmp/CVU_12.1.0.2.0_grid/runfixup.sh" as root user on nodes "sbldcdb02,sbldcdb01" to perform the fix up operations manually
Press ENTER key to continue after execution of "/tmp/CVU_12.1.0.2.0_grid/runfixup.sh" has completed on nodes "sbldcdb02,sbldcdb01"

Fix: Daemon "avahi-daemon" not configured and running

ERROR:
PRVG-9023 : Manual fix up command "/tmp/CVU_12.1.0.2.0_grid/runfixup.sh" was not issued by root user on node "sbldcdb02"

PRVG-9023 : Manual fix up command "/tmp/CVU_12.1.0.2.0_grid/runfixup.sh" was not issued by root user on node "sbldcdb01"

"Daemon "avahi-daemon" not configured and running" could not be fixed on nodes "sbldcdb02,sbldcdb01"
[grid@sbldcdb01 bin]$
[grid@sbldcdb01 bin]$ su root
[root@sbldcdb01 bin]$ cd
[root@sbldcdb01 ~]# /tmp/CVU_12.1.0.2.0_grid/runfixup.sh
All Fix-up operations were completed successfully.

PRVG-11850 : The system call "connect" failed with error "113" while executing exectask on node

Check the status of firewall if it is enable stop and disabled

[root@sbldcdb02 ~]# service iptables stop
iptables: Flushing firewall rules: [  OK  ]

iptables: Setting chains to policy ACCEPT: filter [  OK  ]

iptables: Unloading modules: [  OK  ]

[root@sbldcdb02 ~]# chkconfig iptables off

Check: Node connectivity of subnet "172.31.36.0"
  Source                          Destination                     Connected?    
  ------------------------------  ------------------------------  ----------------
  sbldcdb01[172.31.36.18]         sbldcdb02[172.31.36.19]         yes            
Result: Node connectivity passed for subnet "172.31.36.0" with node(s) sbldcdb01,sbldcdb02


Check: TCP connectivity of subnet "172.31.36.0"
  Source                          Destination                     Connected?    
  ------------------------------  ------------------------------  ----------------
  sbldcdb01 : 172.31.36.18        sbldcdb01 : 172.31.36.18        passed        
  sbldcdb02 : 172.31.36.19        sbldcdb01 : 172.31.36.18        passed        
  sbldcdb01 : 172.31.36.18        sbldcdb02 : 172.31.36.19        failed          

ERROR:
PRVG-11850 : The system call "connect" failed with error "113" while executing exectask on node "sbldcdb01"
No route to host
  sbldcdb02 : 172.31.36.19        sbldcdb02 : 172.31.36.19        passed        
Result: TCP connectivity check failed for subnet "172.31.36.0"


Check: Node connectivity of subnet "172.31.36.128"
  Source                          Destination                     Connected?    
  ------------------------------  ------------------------------  ----------------
  sbldcdb01[172.31.36.162]        sbldcdb02[172.31.36.164]        yes            
Result: Node connectivity passed for subnet "172.31.36.128" with node(s) sbldcdb01,sbldcdb02


Check: TCP connectivity of subnet "172.31.36.128"
  Source                          Destination                     Connected?    
  ------------------------------  ------------------------------  ----------------
  sbldcdb01 : 172.31.36.162       sbldcdb01 : 172.31.36.162       passed        
  sbldcdb02 : 172.31.36.164       sbldcdb01 : 172.31.36.162       passed        
  sbldcdb01 : 172.31.36.162       sbldcdb02 : 172.31.36.164       failed          

ERROR:
PRVG-11850 : The system call "connect" failed with error "113" while executing exectask on node "sbldcdb01"
No route to host
  sbldcdb02 : 172.31.36.164       sbldcdb02 : 172.31.36.164       passed        
Result: TCP connectivity check failed for subnet "172.31.36.128"

How to remove Oracle Grid Infrastructure, CRS and Oracle Restart.

As root user perform the following steps.

Deconfigure the CRS across the all nodes of the cluster

/u01/app/11.2.4/grid/crs/install/rootcrs.pl -deconfig  -verbose -force

In last node

/u01/app/11.2.4/grid/crs/install/rootcrs.pl -deconfig  -lastnode -force

Deconfigure the Oracle Restart SIHA and ASM

/u01/app/11.2.4/grid/crs/install/roothas.pl -deconfig -verbose -force

Modify /etc/inittab: (CRS and Oracle Restart)

vi /etc/inittab

#h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
init q

Clean up files

rm -f /etc/init.d/init.ohasd
rm -f /etc/inittab.crs
rm -rf /etc/oracle
rm -f /usr/tmp/.oracle/*
rm -f /tmp/.oracle/*
rm -f /var/tmp/.oracle/*
[Be carefull it will remove oratab entries for all database running on this server]
rm -f /etc/oratab
rm -rf /var/opt/oracle

rm -rf /u01/app/* 

Log

[root@sbldcdb01 install]# ./rootcrs.pl -deconfig  -lastnode -force
Using configuration parameter file: ./crsconfig_params
CRS resources for listeners are still configured
Network exists: 1/172.31.36.0/255.255.255.128/, type static
VIP exists: /sbldcdb01-vip/172.31.36.26/172.31.36.0/255.255.255.128/, hosting node sbldcdb01
VIP exists: /sbldcdb02-vip/172.31.36.27/172.31.36.0/255.255.255.128/, hosting node sbldcdb02
GSD exists
ONS exists: Local port 6100, remote port 6200, EM port 2016
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'sbldcdb01'
CRS-2677: Stop of 'ora.registry.acfs' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.crsd' on 'sbldcdb01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.oc4j' on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'sbldcdb01'
CRS-2677: Stop of 'ora.oc4j' on 'sbldcdb01' succeeded
CRS-2677: Stop of 'ora.OCR.dg' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'sbldcdb01'
CRS-2677: Stop of 'ora.asm' on 'sbldcdb01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'sbldcdb01' has completed
CRS-2677: Stop of 'ora.crsd' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.evmd' on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.asm' on 'sbldcdb01'
CRS-2677: Stop of 'ora.evmd' on 'sbldcdb01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'sbldcdb01' succeeded
CRS-2677: Stop of 'ora.asm' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'sbldcdb01'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'sbldcdb01'
CRS-2677: Stop of 'ora.cssd' on 'sbldcdb01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sbldcdb01'
CRS-2676: Start of 'ora.cssdmonitor' on 'sbldcdb01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'sbldcdb01'
CRS-2672: Attempting to start 'ora.diskmon' on 'sbldcdb01'
CRS-2676: Start of 'ora.diskmon' on 'sbldcdb01' succeeded
CRS-2676: Start of 'ora.cssd' on 'sbldcdb01' succeeded
CRS-4611: Successful deletion of voting disk +OCR.
ASM de-configuration trace file location: /tmp/asmcadc_clean2016-05-02_06-50-58-PM.log
ASM Clean Configuration START
ASM Clean Configuration END

ASM with SID +ASM1 deleted successfully. Check /tmp/asmcadc_clean2016-05-02_06-50-58-PM.log for details.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.ctssd' on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'sbldcdb01'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'sbldcdb01'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'sbldcdb01' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'sbldcdb01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'sbldcdb01'
CRS-2677: Stop of 'ora.cssd' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'sbldcdb01'
CRS-2677: Stop of 'ora.crf' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'sbldcdb01'
CRS-2677: Stop of 'ora.gipcd' on 'sbldcdb01' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'sbldcdb01'
CRS-2677: Stop of 'ora.gpnpd' on 'sbldcdb01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'sbldcdb01' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Removing Trace File Analyzer
Successfully deconfigured Oracle clusterware stack on this node
[root@sbldcdb01 install]#
[root@sbldcdb01 install]# ./roothas.pl -deconfig -verbose -force 
Using configuration parameter file: ./crsconfig_params
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Delete failed, or completed with errors.
CRS-4047: No Oracle Clusterware components configured.
CRS-4000: Command Stop failed, or completed with errors.
You must kill ohasd processes or reboot the system to properly
cleanup the processes started by Oracle clusterware
ACFS-9313: No ADVM/ACFS installation detected.
Either /etc/oracle/olr.loc does not exist or is not readable
Make sure the file exists and it has read and execute access
Failure in execution (rc=-1, 256, No such file or directory) for command /etc/init.d/ohasd deinstall
Successfully deconfigured Oracle Restart stack
[root@sbldcdb01 install]#
[root@sbldcdb01 install]# rm -f /etc/init.d/init.ohasd
[root@sbldcdb01 install]# rm -f /etc/inittab.crs
[root@sbldcdb01 install]# rm -rf /etc/oracle
[root@sbldcdb01 install]# rm -f /usr/tmp/.oracle/*
[root@sbldcdb01 install]# rm -f /tmp/.oracle/*
[root@sbldcdb01 install]# rm -f /var/tmp/.oracle/*
[root@sbldcdb01 install]# rm -f /etc/oratab
[root@sbldcdb01 install]# rm -rf /var/opt/oracle