Comments (6)
dennishuo
commented on September 5, 2024
86c7b09 fixes the missing /usr/local/share/google directory; at head we see:
dhuo-ubuntu-m: No boot process configuration tool found.
This means "which insserv" and "which chkconfig" both failed running as root. Various Ubuntu forum threads indicate insserv residing in /usr/lib/insserv/insserv, and needing to symlink into /sbin before usage:
sudo ln -s /usr/lib/insserv/insserv /sbin/insserv
Applying this fix to configure_startup_processes.sh appears to allow the deployment to proceed at least to the NFS-setup steps.
from bdutil.
dennishuo
commented on September 5, 2024
The second failure is on setup_master_nfs.sh with:
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 1 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 2 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 3 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 4 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
This is a neat quirk of Ubuntu; whereas on plain Debian, running service nfs-kernel-server stop still retains the /proc/fs/nfsd files for edit, on Ubuntu the files disappear when the service is stopped, and are no longer editable.
# service nfs-kernel-server stop
[ ok ] Stopping NFS kernel daemon: mountd nfsd.
[ ok ] Unexporting directories for NFS kernel daemon....
# ls -l /proc/fs/nfsd
total 0
-r--r--r-- 1 root root 0 May 15 00:42 export_features
-r--r--r-- 1 root root 0 May 15 00:42 exports
-rw------- 1 root root 0 May 15 00:42 filehandle
-rw-r--r-- 1 root root 0 May 15 00:42 max_block_size
-rw------- 1 root root 0 May 15 00:42 nfsv4gracetime
-rw------- 1 root root 0 May 15 00:42 nfsv4leasetime
-rw------- 1 root root 0 May 15 00:42 nfsv4recoverydir
-r--r--r-- 1 root root 0 May 15 00:42 pool_stats
-rw------- 1 root root 0 May 15 00:42 pool_threads
-rw-r--r-- 1 root root 0 May 15 00:42 portlist
-r--r--r-- 1 root root 0 May 15 00:42 reply_cache_stats
-r--r--r-- 1 root root 0 May 15 00:42 supported_krb5_enctypes
-rw------- 1 root root 0 May 15 00:42 threads
-rw------- 1 root root 0 May 15 00:42 unlock_filesystem
-rw------- 1 root root 0 May 15 00:42 unlock_ip
-rw------- 1 root root 0 May 15 00:42 versions
Compared to Ubuntu:
root@dhuo-ubuntu2-m:/home/dhuo# ls -l /proc/fs/nfsd
total 0
-r--r--r-- 1 root root 0 May 15 01:06 export_features
-r--r--r-- 1 root root 0 May 15 01:06 exports
-rw------- 1 root root 0 May 15 01:06 filehandle
-rw-r--r-- 1 root root 0 May 15 01:06 max_block_size
-rw------- 1 root root 0 May 15 01:06 nfsv4gracetime
-rw------- 1 root root 0 May 15 01:06 nfsv4leasetime
-rw------- 1 root root 0 May 15 01:06 nfsv4recoverydir
-r--r--r-- 1 root root 0 May 15 01:06 pool_stats
-rw------- 1 root root 0 May 15 01:06 pool_threads
-rw-r--r-- 1 root root 0 May 15 01:06 portlist
-r--r--r-- 1 root root 0 May 15 01:06 reply_cache_stats
-r--r--r-- 1 root root 0 May 15 01:06 supported_krb5_enctypes
-rw------- 1 root root 0 May 15 01:06 threads
-rw------- 1 root root 0 May 15 01:06 unlock_filesystem
-rw------- 1 root root 0 May 15 01:06 unlock_ip
-rw------- 1 root root 0 May 15 01:06 versions
root@dhuo-ubuntu2-m:/home/dhuo# service nfs-kernel-server stop
* Stopping NFS kernel daemon [ OK ]
* Unexporting directories for NFS kernel daemon... [ OK ]
root@dhuo-ubuntu2-m:/home/dhuo# ls -l /proc/fs/nfsd
total 0
root@dhuo-ubuntu2-m:/home/dhuo#
from bdutil.
dennishuo
commented on September 5, 2024
It appears there's no easy way to modify nfsv4gracetime for Ubuntu, aside from editing /etc/init.d/nfs-kernel-server, as described in this serverfault.com post and in our case the edited gracetime wouldn't have survived across reboots anyhow. Since it's just a best-effort setting to speed up boot time, it's probably not appropriate to try to deeply modify /etc/init.d/nfs-kernel-server and instead just print a warning if the file is non-existent for editing.
from bdutil.
dennishuo
commented on September 5, 2024
For posterity, the root cause of the existence/nonexistence of nfsv4gracetime is that in Debian, /etc/init.d/nfs-kernel-server's "stop" command ends like this:
if mountpoint -q $PROCNFSD_MOUNTPOINT
then
$PREFIX/sbin/exportfs -f
fi
;;
Compared to Ubuntu's ending like this:
if mountpoint -q $PROCNFSD_MOUNTPOINT
then
$PREFIX/sbin/exportfs -f
umount $PROCNFSD_MOUNTPOINT
fi
;;
So the extra umount $PROCNFSD_MOUNTPOINT seems to unfortunately clean up the procfs bits.
from bdutil.
dennishuo
commented on September 5, 2024
The fix has been tested successfully in several setups now and pull request has been sent: #30
from bdutil.
dennishuo
commented on September 5, 2024
Merged into master: 84fdd46
from bdutil.
Related Issues (20)
- gcloud compute ssh tunneling refusing connection HOT 1
- Can't install with Ambari 2.5+ HOT 2
- hortonworks on mac os 10.12.6
- ERROR: (gcloud.compute.ssh) could not fetch resource: The resource 'projects/recommendationshashiproject/zones/us-central1-a/instances/hadoop-m' was not found HOT 5
- subnetwork error HOT 1
- Error Deploy bdutil : Invalid value for field resource.networkInterfaces HOT 1
- Unable to start Ambari NameNode Security Exception
- Command failed: wait ${SUBPROC} on line 326 HOT 2
- unable to deploy ambari using bdutil
- Nonissue..delete
- Command failed line 326, and SSH Key HOT 2
- Cluster creation can fail if apt-get update has warnings
- How to create HDP cluster with High Availability? HOT 1
- Cluster creation is failing with "Failed to find image for alias [debian-7-backports]..."
- Upgrade bdutil to Debian 8
- Does not seem to working with Custom network HOT 2
- bdutil deploy fails with ssh error
- Add a "version" command|flag
- bdutil confusingly reports "using project ${GCE_ZONE}"
- unable to deploy ambari using bdutil HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bdutil.