ivanovskywang / webspider Goto Github PK

Version 2.0********

1.AC Machine has something to be optimize in the next version

!!!Importent: 2.It should have a memory pool and I will realize it later

3.Can epoll used here, I will think for it later

4.Berkeley DB can will be used in the next version

//gzip and chunk parser will be added in the next version,

5.As I know, The HTTP 1.0 don't support chunk and don't suport gzip and deflate well.So I just realize the chunk decode.

6.When Match the url the response should be joint

7.JS parser, pdf,txt,office,rtf parser will be added in the next version

8.Dechunk.cpp used to decode chunked streaming