Comments (6)
86c7b09 fixes the missing /usr/local/share/google directory; at head we see:
dhuo-ubuntu-m: No boot process configuration tool found.
This means "which insserv" and "which chkconfig" both failed running as root. Various Ubuntu forum threads indicate insserv residing in /usr/lib/insserv/insserv, and needing to symlink into /sbin before usage:
sudo ln -s /usr/lib/insserv/insserv /sbin/insserv
Applying this fix to configure_startup_processes.sh appears to allow the deployment to proceed at least to the NFS-setup steps.
from bdutil.
The second failure is on setup_master_nfs.sh with:
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 1 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 2 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 3 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
dhuo-ubuntu2-m: 'overwrite_file_with_strings /proc/fs/nfsd/nfsv4gracetime 10' attempt 4 failed! Sleeping 10.
dhuo-ubuntu2-m: ./hadoop-env-setup.sh: line 531: /proc/fs/nfsd/nfsv4gracetime: No such file or directory
This is a neat quirk of Ubuntu; whereas on plain Debian, running service nfs-kernel-server stop
still retains the /proc/fs/nfsd
files for edit, on Ubuntu the files disappear when the service is stopped, and are no longer editable.
# service nfs-kernel-server stop
[ ok ] Stopping NFS kernel daemon: mountd nfsd.
[ ok ] Unexporting directories for NFS kernel daemon....
# ls -l /proc/fs/nfsd
total 0
-r--r--r-- 1 root root 0 May 15 00:42 export_features
-r--r--r-- 1 root root 0 May 15 00:42 exports
-rw------- 1 root root 0 May 15 00:42 filehandle
-rw-r--r-- 1 root root 0 May 15 00:42 max_block_size
-rw------- 1 root root 0 May 15 00:42 nfsv4gracetime
-rw------- 1 root root 0 May 15 00:42 nfsv4leasetime
-rw------- 1 root root 0 May 15 00:42 nfsv4recoverydir
-r--r--r-- 1 root root 0 May 15 00:42 pool_stats
-rw------- 1 root root 0 May 15 00:42 pool_threads
-rw-r--r-- 1 root root 0 May 15 00:42 portlist
-r--r--r-- 1 root root 0 May 15 00:42 reply_cache_stats
-r--r--r-- 1 root root 0 May 15 00:42 supported_krb5_enctypes
-rw------- 1 root root 0 May 15 00:42 threads
-rw------- 1 root root 0 May 15 00:42 unlock_filesystem
-rw------- 1 root root 0 May 15 00:42 unlock_ip
-rw------- 1 root root 0 May 15 00:42 versions
Compared to Ubuntu:
root@dhuo-ubuntu2-m:/home/dhuo# ls -l /proc/fs/nfsd
total 0
-r--r--r-- 1 root root 0 May 15 01:06 export_features
-r--r--r-- 1 root root 0 May 15 01:06 exports
-rw------- 1 root root 0 May 15 01:06 filehandle
-rw-r--r-- 1 root root 0 May 15 01:06 max_block_size
-rw------- 1 root root 0 May 15 01:06 nfsv4gracetime
-rw------- 1 root root 0 May 15 01:06 nfsv4leasetime
-rw------- 1 root root 0 May 15 01:06 nfsv4recoverydir
-r--r--r-- 1 root root 0 May 15 01:06 pool_stats
-rw------- 1 root root 0 May 15 01:06 pool_threads
-rw-r--r-- 1 root root 0 May 15 01:06 portlist
-r--r--r-- 1 root root 0 May 15 01:06 reply_cache_stats
-r--r--r-- 1 root root 0 May 15 01:06 supported_krb5_enctypes
-rw------- 1 root root 0 May 15 01:06 threads
-rw------- 1 root root 0 May 15 01:06 unlock_filesystem
-rw------- 1 root root 0 May 15 01:06 unlock_ip
-rw------- 1 root root 0 May 15 01:06 versions
root@dhuo-ubuntu2-m:/home/dhuo# service nfs-kernel-server stop
* Stopping NFS kernel daemon [ OK ]
* Unexporting directories for NFS kernel daemon... [ OK ]
root@dhuo-ubuntu2-m:/home/dhuo# ls -l /proc/fs/nfsd
total 0
root@dhuo-ubuntu2-m:/home/dhuo#
from bdutil.
It appears there's no easy way to modify nfsv4gracetime for Ubuntu, aside from editing /etc/init.d/nfs-kernel-server
, as described in this serverfault.com post and in our case the edited gracetime wouldn't have survived across reboots anyhow. Since it's just a best-effort setting to speed up boot time, it's probably not appropriate to try to deeply modify /etc/init.d/nfs-kernel-server
and instead just print a warning if the file is non-existent for editing.
from bdutil.
For posterity, the root cause of the existence/nonexistence of nfsv4gracetime is that in Debian, /etc/init.d/nfs-kernel-server
's "stop" command ends like this:
if mountpoint -q $PROCNFSD_MOUNTPOINT
then
$PREFIX/sbin/exportfs -f
fi
;;
Compared to Ubuntu's ending like this:
if mountpoint -q $PROCNFSD_MOUNTPOINT
then
$PREFIX/sbin/exportfs -f
umount $PROCNFSD_MOUNTPOINT
fi
;;
So the extra umount $PROCNFSD_MOUNTPOINT
seems to unfortunately clean up the procfs bits.
from bdutil.
The fix has been tested successfully in several setups now and pull request has been sent: #30
from bdutil.
Merged into master: 84fdd46
from bdutil.
Related Issues (20)
- gcloud compute ssh tunneling refusing connection HOT 1
- Can't install with Ambari 2.5+ HOT 2
- hortonworks on mac os 10.12.6
- ERROR: (gcloud.compute.ssh) could not fetch resource: The resource 'projects/recommendationshashiproject/zones/us-central1-a/instances/hadoop-m' was not found HOT 5
- subnetwork error HOT 1
- Error Deploy bdutil : Invalid value for field resource.networkInterfaces HOT 1
- Unable to start Ambari NameNode Security Exception
- Command failed: wait ${SUBPROC} on line 326 HOT 2
- unable to deploy ambari using bdutil
- Nonissue..delete
- Command failed line 326, and SSH Key HOT 2
- Cluster creation can fail if apt-get update has warnings
- How to create HDP cluster with High Availability? HOT 1
- Cluster creation is failing with "Failed to find image for alias [debian-7-backports]..."
- Upgrade bdutil to Debian 8
- Does not seem to working with Custom network HOT 2
- bdutil deploy fails with ssh error
- Add a "version" command|flag
- bdutil confusingly reports "using project ${GCE_ZONE}"
- unable to deploy ambari using bdutil HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bdutil.