Giter Club home page Giter Club logo

python-module-jk-uploadpack's Introduction

jk_uploadpack

Introduction

This python module provides a packer/unpacker based on 'tar' that reduces redundancies before packing.

Information about this module can be found here:

Why 'uploadpack'?

Classic compression tools work very well in general. But in very specific situations these tools won't work well enough: If you need to compress data containing redundant data that can't be compressed very well. This is the case with some directory trees for web sites hosted by webservers. And precisely that was the motivation to implement uploadpack.

So uploadpack is nothing more than a tar based compression tool. In fact an uploadpack is nothing else but a tar file (possibly compressed with gz, bzip2 or xz) with a very specific structure: It avoids redundancies.

Limitations of this module

This uploadpack currently only suppors files and directories, no links.

Preliminaries

Please include an import statement for this module into your application by using the following code:

import jk_uploadpack

How to compress a directory tree to an uploadpack archive

In order to create an uploadpack you need to instantiate a packer:

up = jk_uploadpack.Packer("archive.up.gz")

Now you can create a file group (here: "foo") and add a file to it (here: "foobar.txt"):

up.fileGroup("foo").addFile("/path/to/dir/foobar.txt", "dir/foobar.txt")

Of course you can repeat that with any number of files.

After having added all files you need to close the archive:

up.close()

You must always invoke close() as otherwise essential data will not be written.

A more secure way of doing this is by using Packer with with:

with jk_uploadpack.Packer("archive.up.gz") as up:
	up.fileGroup("foo").addFile("/path/to/dir/foobar.txt", "dir/foobar.txt")

In this case close() will be called automatically.

How to uncompress an uploadpack archive

In order to decompress an uploadpack you need to instantiate an unpacker:

up = jk_uploadpack.Unpacker("archive.up.gz")

Then you can unpack all files to a target directory:

up.fileGroup("default").unpackToDir("outdir")

After having extracted all files you can close the archive:

up.close()

You should always invoke close().

A more secure way of doing this is by using Unpacker with with:

with jk_uploadpack.Unpacker("archive.up.gz") as up:
	up.fileGroup("default").unpackToDir("outdir")

In this case close() will be called automatically.

Specific Features

File Groups

uploadpack always puts files in so called file groups. File groups are organizational units that can be considered as being an archive themselves. Characterstics of such a file group are:

  • A file group is identified by a name.
  • On decompression all files of a file group are always written to a specific directory.
  • Certain parameters can be set at a file group that take effect for all files in that file group.

If you don't need to use file groups for a specific reason, use "default" as a convention.

Contact Information

Author(s):

License

This software is provided under the following license:

  • Apache Software License 2.0

python-module-jk-uploadpack's People

Contributors

jkpubsrc avatar

Watchers

 avatar  avatar

Forkers

sunarch

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.