void-linux / xmandump Goto Github PK

While submitting void-linux/void-docs#663, CI failed on broken links

• https://man.voidlinux.org/xlocate.1
• https://man.voidlinux.org/mkfs.vfat.8

Both are symlinks to other manual pages and work on my system, but not in the dumped pages.

It would be nice to support writing the man pages to a remote object store using an S3 compatible API. This would enable the reading of the data to happen on a clock, and then to asynchronously refresh the data the CGI application is serving using something like rclone again running on a timer.

During the initial scan, the memory usage is proportional to the number of packages scanned. At the time of writing using about 36GB of memory during the scan. There is probably some room for optimizations here to improve the memory usage and not require ever larger boxes to do the scan.

I believe this should be a blocker for deploying, given that it can't be downloaded.

go get go.spiff.io/mandump

# cd .; git clone -- https://github.com/nilium/mandump /home/ericonr/.cache/go/src/go.spiff.io/mandump
Cloning into '/home/ericonr/.cache/go/src/go.spiff.io/mandump'...
fatal: could not read Username for 'https://github.com': terminal prompts disabled
package go.spiff.io/mandump: exit status 128

, go get go.spiff.io/xmandump

can't load package: package go.spiff.io/xmandump: no Go files in /home/ericonr/.cache/go/src/go.spiff.io/xmandump

and go get -u go.spiff.io/xmandump

package go.spiff.io/xmandump: no Go files in /home/ericonr/.cache/go/src/go.spiff.io/xmandump